Tooling1d ago
Anthropic Launches Message Threads in Public Beta on the Messages API: Server-Side Conversations Cut Claude Code TTFT About 35% on 500K-1M Token Requests
On November 2 (US time) Anthropic put message threads into public beta on the Messages API (beta header message-threads-2026-08-12). The API keeps the conversation on the server: the first request sends the full conversation and creates a thread, and each later request sends only new messages plus the previous response id. Anthropic says threads are on by default for most Claude Code users, cutting median time to first token by about 35% on 500K-1M token requests, while the median long-conversation request shrank from about 800 KB to 1.8 KB. Threads expire after 5 idle minutes; pricing and rate limits are unchanged.
Tooling48d ago
Databricks Rolls Out GPT-6 Astra to ~3500 Engineers
Databricks engineering lead Patrick Wendell said Astra is now rolled out to every engineer (N≈3500). Versus prior top models Opus 5 and Sol 5.6, Astra clearly wins on highly complex work—especially high-level system design and long-range horizontal tasks—and engineers with Astra increased overall coding spend by about 60% vs baseline. Gains on medium/low-complexity coding look unclear and may be saturated by earlier models. The company piloted with ~200 users via Unity Gateway cohort experiments, and gives engineers an Astra-specific sub-budget so they use it selectively on hard tasks while preferring cheaper models day to day. A robust Astra-vs-Fable comparison is not available yet because Fable has not been rolled out widely due to data-retention policies.
Tooling52d ago
Databricks day-0 DeepSeek 4.1 Flash via Unity Gateway; Pareto on OfficeQA Pro V2
Databricks shipped DeepSeek 4.1 Flash on Unity Gateway the day it launched. On OfficeQA Pro V2 it sits on the Pareto frontier, so teams can point governed Lakehouse data at the model for apps and agents under one access, spend, and performance layer.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.