AI Coding Live News — Real-Time 𝕏/Twitter Updates & Breakthroughs

👀69

🔥97

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Key Takeaways

Mistral AI launched the Voxtral 3 suite spanning transcription, emotional TTS, studio-grade voice cloning, and a LiveKit-powered Voice-Agent SDK
Artificial Analysis independently verified Small Transcribe 3 at a 2.1% error index, outperforming ElevenLabs Scribe v2 (2.2%) and Grok Voice 2.0 (2.3%)
Realtime Transcribe 3 achieves sub-500ms latency, delivering sub-second full conversational voice-agent turns
Aggressive pricing: Mini Transcribe starts at $0.0035/min, and managed voice agent sessions cost just $0.04/min paired with Mistral Small 4

Read full story

Linked Models & Agents:

⚡ Voxtral 3⚡ Mistral Small 4 🤖 Mistral Voice Agent 🌐 Mistral AI 🌐 LiveKit

#Mistral AI#Voxtral 3#Voice Agent#STT#TTS#Artificial Analysis#LiveKit

Mistral AIMistralAI·Collected 13d ago

👀103

🔥86

View on 𝕏 ↗

Mistral launches the Voxtral 3 speech model family and a voice agent SDK: transcription in 50+ languages, TTS at $13 per 1M characters, EU-hosted or self-deployed

On Oct 20 Mistral released Voxtral 3: the Voxtral Small/Mini Transcribe 3 speech-to-text models, Voxtral Mini Transcribe Realtime 3, the Voxtral Mini TTS 3 (Voxtral Speech 3) text-to-speech model, and a LiveKit-based voice agent SDK that streams listening, reasoning with tool calls, and speaking as one pipeline, with each turn completing in under a second per Mistral. Transcription covers 50+ languages with diarization and context biasing; TTS covers 35+ languages and 50+ dialects, plus Pro Voice cloning from 30 minutes of audio. It is live on the Mistral API (EU, US and global endpoints) and can be self-deployed.

Key Takeaways

Multilingual transcription (vendor-reported): macro WER over 45 FLEURS languages is 4.1% (language forced) / 4.0% (inferred) for Voxtral Small Transcribe 3, tied with Microsoft AI Transcribe 2 and ahead of Scribe v2 (4.9%) and Whisper large-v3 (16.0%/14.9%)
Diarization (vendor-reported): cpWER of 18.4% for Small and 18.6% for Mini, vs 30.9% for the previous Voxtral Mini Transcribe 2 and 38.4% for Gemini 3.5 Transcribe
Pricing: Voxtral Mini Transcribe 3 is 4B parameters at $0.0035/min (docs list it as Public Preview with 32k context); Voxtral Speech 3 costs $13 per 1M characters
Realtime: Voxtral Mini Transcribe Realtime 3 runs below 500 ms latency; in Mistral's 35-language FLEURS chart the 480 ms setting scores 6.4% WER, still behind Gemini 3.5 Realtime Transcribe at 4.2%
The voice agent SDK is built on LiveKit with SIP telephony and WebRTC; each stage (LLM, voice, language) is swappable, and Pro Voice clones a voice from 30 minutes of audio

Read full story

Linked Models & Agents:

⚡ Voxtral Small Transcribe 3⚡ Voxtral Mini Transcribe 3⚡ Voxtral Mini Transcribe Realtime 3⚡ Voxtral Mini TTS 3🤖 Voxtral voice agent SDK 🌐 Mistral AI 🌐 LiveKit

#ASR#TTS#Mistral#Voxtral 3#LiveKit

LiveKit@livekit·Collected 37d ago

👀88

🔥91

LiveKit Agents 1.8.3: Gemini 3.8 Live NON_BLOCKING default, GPTLive Azure, AssemblyAI Universal, safer tool handoffs

LiveKit published Python [email protected] on GitHub (2026-09-26; PyPI livekit-agents 1.8.3): Gemini 3.8 Live defaults tool_behavior=NON_BLOCKING and sends FunctionTool schemas as parameters_json_schema on the text API; OpenAI gains GPTLiveModel.with_azure and moves the Realtime inference client into agents core; STT adds AssemblyAI universal-3-6-pro plus language_confidence, and configurable ElevenLabs realtime chunk duration; voice fixes prevent parallel tools from canceling handoffs, pair tool outputs by call_id, forward frames as-is in fallback/stream adapters, and fix LiveAvatar interruption/plugin registration. Same-day JS @livekit/[email protected] deepens agent_turn telemetry and adaptive interruption.

Key Takeaways

Shipped: [email protected] / PyPI 1.8.3; JS @livekit/[email protected] same day
Gemini 3.8 Live: default NON_BLOCKING tool_behavior; FunctionTool via parameters_json_schema on text API
OpenAI: GPTLiveModel.with_azure; Realtime inference client moved into agents core
STT: AssemblyAI universal-3-6-pro + language_confidence; configurable ElevenLabs realtime chunk duration
Voice correctness: parallel tools no longer cancel handoffs; pair tool outputs by call_id; adapters forward frames as-is

Read full story

Linked Models & Agents:

⚡ Gemini 3.8 Live⚡ GPT Live🤖 LiveKit Agents 🌐 livekit 🌐 Google DeepMind 🌐 OpenAI 🌐 assemblyai 🌐 elevenlabs

#LiveKit Agents#voice AI#Gemini 3.8 Live#GPTLive Azure#AssemblyAI#Realtime#Python

SpaceXAI@SpaceXAI·Collected 62d ago

👀41

🔥90

View on 𝕏 ↗

xAI brings Grok Voice to LiveKit: STT, Grok 4.3, and TTS in one ZDR AgentSession

SpaceXAI said Grok Voice models can now be used in LiveKit to build voice agents with full zero-data-retention support. LiveKit showed a patient-intake agent that cascades Grok STT, Grok 4.3, and Grok TTS through LiveKit Inference in a single AgentSession, with one set of credentials and billing. For developers, that is a three-string voice stack instead of a glued-together ASR, LLM, and TTS bill.

Key Takeaways

Grok Voice is available in LiveKit with zero-data-retention on every hop.
STT, Grok 4.3, and TTS cascade in one AgentSession with unified credentials and billing.
The reference build is a patient-intake agent for real-time, tool-using voice workflows.

Read full story

Linked Models & Agents:

⚡ Grok 4.3 ⚡ Grok 4.6 🌐 xAI

#Grok Voice#LiveKit#ZDR#Speech to speech#voice agents