AI Coding Live News

On 2026-11-05 Boson AI (the team of Mu Li and Alex Smola) released a research preview of Higgs Realtime Duplex: a 45B MoE front model that slices voice, video, and tool results into 160 ms chunks so it can listen, watch, speak, and render its own face at once, while thinking, calling tools, or delegating hard questions to a larger backend model without pausing. Vendor-reported scores include Big Bench Audio 98.9, tau-Voice 69.8, and Full-Duplex-Bench v1.5 75.5. The API is waitlist-only for now; the earlier Higgs Realtime is available today.

Zoom

On 2026-11-06, Cursor's changelog shipped Voice Chat with Agents: realtime two-way voice calls with coding agents in the Agents Window, IDE, web, and iOS. Dictation remains a separate feature. Grok Voice handles listening and speaking (voices include Ara, Eve, Leo, Rex, Sal); the coding agent still uses the model you picked. With Privacy Mode on, voice chat runs with zero data retention. A signed-in Cursor account is required (API-key-only sessions cannot start a call).

Zoom

On November 5 Meta AI (@AIatMeta) said Muse Realtime Avatar, previewed at Connect, is rolling out in the US Muse app, turning Muse Realtime Voice into interactive live avatars. The research blog describes an audio-driven Diffusion Transformer that shares the speech-token stream with voice for lip-sync and expression; a single GB200 session streams 448×768 at 25 fps with about 870 ms from end of user turn to first synchronized audio-video byte, with Meta Video Seal invisible watermarking. Muse is for users 18+; no global schedule or developer API was announced.

Zoom

On November 4, Justin Uberti, Head of Realtime AI at OpenAI, said the GPT-Live outbound telephony API is generally available: Live voice agents can dial through any SIP trunk such as Telnyx or Twilio, with HD Voice and bidirectional DTMF. Official docs describe Live API + SIP transport; Greg Brockman amplified the note.

Zoom

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Zoom

On Oct 20 ElevenLabs released Eleven Realtime, end-to-end speech-to-speech models where each model is a complete voice agent, removing the need to wire up speech recognition, an LLM and text-to-speech yourself. v1 Mini targets low-cost natural conversation and v1 Max targets support and multi-step tool use. Both cover 90+ languages and 17,000+ voices. Citing independent Artificial Analysis evals, Max answers 98.8% of Big Bench Audio correctly and starts speaking in 0.57s on average. The API is OpenAI Realtime compatible, so migrating means changing the endpoint and model name.

Zoom

On Oct 20 Mistral released Voxtral 3: the Voxtral Small/Mini Transcribe 3 speech-to-text models, Voxtral Mini Transcribe Realtime 3, the Voxtral Mini TTS 3 (Voxtral Speech 3) text-to-speech model, and a LiveKit-based voice agent SDK that streams listening, reasoning with tool calls, and speaking as one pipeline, with each turn completing in under a second per Mistral. Transcription covers 50+ languages with diarization and context biasing; TTS covers 35+ languages and 50+ dialects, plus Pro Voice cloning from 30 minutes of audio. It is live on the Mistral API (EU, US and global endpoints) and can be self-deployed.

Zoom

Official TypeScript SDK [email protected] (v7.25.0, 2026-09-29) adds Computer Use to beta.agents (#2837), mirroring Python 3.22.0. Prior v7.24.0 shipped Agents credential/session options (#2812), the gpt-6.1-sol model id (#2836), Responses Cyber access, Realtime Translation client secrets, and a dedicated Node translation WebSocket. 35 commits ahead of v7.23.0.

Zoom

OpenAI shipped Python SDK v3.20.0 on 2026-09-28: Agents credentials gain metadata and update-without-replace auth, sessions add ultrafast tier plus misalignment_policy_violation; Responses can select Cyber access programs (standard/daybreak_blue/daybreak_red); and an opt-in ResponsesWebSocketAccumulator yields immutable incremental text/tool snapshots. Live/Realtime WebSocket query/queue/TLS retry fixes land in the same cut.

Zoom

LiveKit published Python [email protected] on GitHub (2026-09-26; PyPI livekit-agents 1.8.3): Gemini 3.8 Live defaults tool_behavior=NON_BLOCKING and sends FunctionTool schemas as parameters_json_schema on the text API; OpenAI gains GPTLiveModel.with_azure and moves the Realtime inference client into agents core; STT adds AssemblyAI universal-3-6-pro plus language_confidence, and configurable ElevenLabs realtime chunk duration; voice fixes prevent parallel tools from canceling handoffs, pair tool outputs by call_id, forward frames as-is in fallback/stream adapters, and fix LiveAvatar interruption/plugin registration. Same-day JS @livekit/[email protected] deepens agent_turn telemetry and adaptive interruption.

Zoom

CopilotKit shipped v1.74.0 on 2026-09-25 (npm @copilotkit/react-core 1.74.0): SDKs can consume learned skills from multiple containers, expanding skill assets beyond a single runtime; Web Inspector gains targeted What's New notifications and launcher HUD impression/action tracking. Fixes: threads drawer no longer locks on unresolved entitlements, stop refreshing realtime credentials for sockets that never open, stop per-message state cloning / virtual-scroll tug-of-war in React, and a Memory policy that grants nothing no longer fails the run.

Zoom

Pydantic AI v2.51.0 (2026-09-25) adds OpenAILiveModel for OpenAI GPT-Live, exposes context_window_used on realtime sessions, tightens Gemini Live id/affective-dialog checks, and raises UserError for forced realtime tool_choice on OpenAI/Azure/xAI. PyPI pydantic-ai 2.51.0 is live.

Zoom

Pydantic AI 2.50.0 (2026-09-25) adds DecisionModel (TypeSafeModel implements it), named route questions with optional decision_route_threshold, Gemini 3.8 Live realtime, durable-context hooks, and audio_seconds usage pricing.

Zoom

Pydantic AI shipped v2.49.0 on 2026-09-24 (PyPI aligned). Highlights: GitHubCopilotOAuthFlow device auth, BoolCriteria for typed yes/no fields, RealtimeSession.wait_for_reply(), plus Bedrock Converse fixes for gpt-6-sol/gpt-6-luna/gpt-6-astra and dropping unsupported temperature/top_p on GPT-5.6/GPT-6.

Zoom