Tooling5d ago
DeepSeek Opens Its Full App Feature Set Through the API: deepseek-flash Gets Built-in Web Search, Deep Thinking Search, File Input, URL Reading and Safety Checks, Plus Standalone OCR, ASR and TTS APIs and an MIT Open-Source Chat Demo
On November 13, DeepSeek said the capabilities behind the DeepSeek App are now available through its API. V4.1-Flash (model name deepseek-flash) supports server-side web search (including image search with citations), deep thinking search, file input for PDF, Office and image files, automatic reading of links in user messages, and input/output safety checks across the Messages, Responses and Chat Completions protocols. OCR, speech-to-text (ASR) and text-to-speech (TTS) also launch as standalone APIs. Tool calls are billed on top of token charges: Search and Fetch cost $0.75 per 1K requests, OCR $0.225 per 1K pages, ASR $0.058 per hour and TTS $0.225 per 10K characters (both at a limited-time 50% discount). DeepSeek also open-sourced an MIT-licensed chat front end that can import DeepSeek chat history. Public-facing apps must enable safety checks.
Tooling5d ago
LMSYS Launches the SGLang Consortium at the First SGLang Summit: NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal and RadixArk Join as Founding Members to Help Shape the Open-Source Inference Engine Roadmap
On November 12, LMSYS Org, the nonprofit behind the open-source inference engine SGLang, announced the SGLang Consortium in the opening keynote of the first SGLang Summit in San Francisco. Founding members NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal and RadixArk will work with the SGLang maintainers on the roadmap, focusing on frontier model support, reasoning and multimodal workloads, distributed inference and hardware optimization. Each member names one technical representative and joins two roadmap meetings a year; SGLang maintainers keep authority over technical decisions and code acceptance, and the project stays open to the whole community.
Tooling5d ago
SGLang-Neuron v0.1.0 Goes Open Source in Public Preview: SGLang Runs Natively on AWS Trainium, with Kimi-K3 Disaggregated Across Three Nodes and GLM-5.2 at 1M Context, Apache 2.0
During the SGLang Summit on November 12, the SGLang team and AWS Annapurna Labs released SGLang-Neuron v0.1.0 as open source in public preview. It is an out-of-tree SGLang plugin: set SGLANG_PLATFORM=neuron and the same server and APIs serve models and generate RL rollouts on Trainium, running on native PyTorch through TorchNeuron. AWS also published a Deep Learning Container image. LLMs currently run on Trn3, and diffusion models on trn2.48xlarge.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.