AI Coding Live News

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Zoom

On Oct 20, French voice AI company Gradium open-sourced Phonon, a family of on-device text-to-speech models: the English Phonon 31m (64 MB q8 weights, Apache 2.0) and Phonon 40m (single-language English, French, German, Spanish and Portuguese variants plus a five-language model, CC BY-NC non-commercial). Built on Kyutai's Pocket TTS and the Mimi codec, it ships its own runtime for CPU, Metal, CUDA, Vulkan, WebGPU, Core ML and Snapdragon, running offline on phones, browsers and a Raspberry Pi. Gradium reports 7 ms to first audio on a MacBook Air M5 CPU versus 517 ms for Kokoro.

Zoom

On Oct 20 Mistral released Voxtral 3: the Voxtral Small/Mini Transcribe 3 speech-to-text models, Voxtral Mini Transcribe Realtime 3, the Voxtral Mini TTS 3 (Voxtral Speech 3) text-to-speech model, and a LiveKit-based voice agent SDK that streams listening, reasoning with tool calls, and speaking as one pipeline, with each turn completing in under a second per Mistral. Transcription covers 50+ languages with diarization and context biasing; TTS covers 35+ languages and 50+ dialects, plus Pro Voice cloning from 30 minutes of audio. It is live on the Mistral API (EU, US and global endpoints) and can be self-deployed.

Zoom

In the latest independent Text-to-Speech (TTS) evaluations published by Artificial Analysis, Ant Group's open-source Ming-3.0-tts achieved a 93.2% pronunciation accuracy score, ranking #1 among all 31 evaluated models (outperforming commercial leader ElevenLabs v4 at 91.7%). Offering both a dense 0.5B parameter variant and a 7.9B mixture-of-experts (MoE) model, it delivers voice cloning and preset voices with a Controlled Voice Elo score of 1,069 (#1 among open-weight models), fully released under the permissive MIT license.

Zoom

On October 19 Ant Ling (inclusionAI) open-sourced five Ming-3.0 models under MIT, spanning speech synthesis (tts-0.5B; tts-tiny, 7.9B total/1.3B active), audio understanding (audio-flash, 126B/6.5B active; audio-tiny, 9.3B/2.7B active) and speech recognition (asr-tiny, 8.6B/2B active). Per the vendor, tts-0.5B ranks #1 among open-weight models on Artificial Analysis Controlled Voice at 1069 Elo and ties #1 overall on pronunciation robustness at 93.2%; asr-tiny averages 4.41% error across four ASR categories. Weights are on Hugging Face and ModelScope, with day-0 SGLang and vLLM support.

Zoom

On 2026-10-13 Fish Audio launched Drama 3, a TTS model directed with plain-language bracket tags, open weights on Hugging Face, and API header model: drama-3. The backbone is a ~35B MoE (~3B active per token, initialized from Qwen3.5-35B-A3B's language tower) with a codebook-MTP audio decoder and preference-model RL. Independent Artificial Analysis Pronunciation Robustness: 93.2% vs 88.1% for S2.1 Pro; 83 languages and up to 16 speakers; Community License free for commercial use under US$500k annual revenue. Launch promo through Nov 12: about $10 per million characters on the API.

Zoom

Google shipped @google/genai v2.25.0 on 2026-09-30 (npm ~22:51Z; 11 commits vs 2.24.0), aligning with Python google-genai 2.26.0: Gemini 3.8 Flash/Lite TTS model enums; dedicated Environments module with from_environment; labels on GenerateContent and LiveClientSetup; tuning gcs_metrics_uri.

Zoom

Google shipped google-genai v2.26.0 on 2026-09-30 (PyPI ~22:53Z; 18 commits vs 2.25.0): model enums add gemini-3.8-flash-tts and gemini-3.8-flash-lite-tts (lite replaces gemini-3.1-flash-tts-preview); dedicated Environments module with from_environment; labels on GenerateContent and LiveClientSetup; tuning jobs expose gcs_metrics_uri.

Zoom

Open-source distributed model serving engine Xinference (xorbitsai/inference) shipped v3.5.0, substantially upgrading its multimodal inference and edge acceleration capabilities. The release adds out-of-the-box support for YuE2 music generation, alongside AuK/AuK-Flash and Irodori TTS v4.1. On Apple Silicon, Xinference introduces native Apple MLX hardware acceleration for FishAudio-S2-Pro, Irodori TTS Small, and Breeze TTS 2. On the visual and document AI front, it integrates MinerU2.5 for complex document parsing and LingBot-World-V2 for embodied world simulation, while introducing distributed correlation metadata propagation across actor calls for enterprise observability.

Zoom

Pipecat v1.12.0 (2026-09-26) adds TTSService.pronunciation_transform_ipa() for reusable word→IPA maps across Cartesia/ElevenLabs/Inworld/Deepgram, client-mode MOQTransport reconnect with session-ending markers, Pipecat Classifiers + LLMClassifier, frame-level interruptible, and response_schema on LLM run_inference. PyPI pipecat-ai 1.12.0 is live.

Zoom