AI Coding Live News

O
OpenAI@AICoder·
👀38
🔥80

OpenAI Codex CLI 0.166.0: keyboard transcript selection, GPT-6.1 Terra in Vertex AI and Bedrock catalogs, codex doctor network checks

OpenAI published the stable Codex CLI release rust-v0.166.0 on GitHub at 19:47 UTC on Oct 29. It adds keyboard-driven transcript selection by word, line and page with built-in search, adds GPT-6.1 Terra to the bundled, Vertex AI and Amazon Bedrock model catalogs, introduces codex queue --resume and codex doctor --network-only, and shows clearer safety-block explanations with selectable safer follow-up prompts in the TUI.

Key Takeaways

  • Model catalogs: GPT-6.1 Terra added to the bundled, Vertex AI and Amazon Bedrock catalogs (#57293)
  • Transcript: keyboard selection by word, line and page, integrated search and configurable shortcuts (#57221 to #57224)
  • New commands: codex queue --resume resumes unloaded threads after queueing a message; codex doctor --network-only checks config, connectivity and WebSocket
  • Safety UX: clearer explanations when a request is blocked, plus selectable safer follow-up prompts (#57363, #57365)
  • Fixes: approval and permission settings survive resume and fork, and reasoning-token accounting is preserved to avoid premature compaction
Read full story

Meta launches its Muse personal AI agent in Singapore with eight local partners including Shopee, Grab and Singapore Airlines

On Oct 28 Meta announced that Muse, its personal AI agent, is now available in Singapore on iOS, Android and muse.ai. Beyond Gmail, Google Calendar and Instagram, the first local connector partners are Shopee, Grab, Singapore Airlines, Agoda, ShopBack, Klook, Trip.com and Lazada, spanning shopping, groceries, dining and travel, with some connector features rolling out after launch. Muse runs on Muse Secure VM, a dedicated cloud computer that keeps passwords and payment methods out of the agent's view, and it asks before sensitive actions such as sending an email or making a purchase. It is free for most uses, with paid subscription plans.

Meta launches its Muse personal AI agent in Singapore with eight local partners including Shopee, Grab and Singapore Airlines

Key Takeaways

  • Muse is now available in Singapore on iOS, Android and the web at muse.ai, with AI glasses support "coming soon"
  • Eight initial local connector partners: Shopee, Grab, Singapore Airlines, Agoda, ShopBack, Klook, Trip.com and Lazada, with some features rolling out after launch
  • Users can compare prices on Shopee and Lazada, plan groceries and dining via GrabMart and Grab Dine Out, and explore travel and bookings via Singapore Airlines, Agoda, Klook and Trip.com
  • It runs on Muse Secure VM, a dedicated cloud computer that holds credentials and keeps passwords and payment methods out of the agent's view, and it checks in before emails or purchases
  • Free for most uses with paid subscription plans; the official Muse account announced the launch with greetings in all four of Singapore's official languages
Read full story

ChatGPT adds iCloud Mail and iCloud Calendar plugins on all plans, connected with an Apple app-specific password

On Oct 27 the official ChatGPT account announced that iCloud Mail and iCloud Calendar plugins are available in ChatGPT on all plans across web, desktop and iOS, rolling out globally. Users can ask ChatGPT to find an email, catch up on their inbox, check what is next or update a calendar event. The two plugins are installed separately, both connect with an Apple app-specific password, and both include read-only contact lookup; standalone Contacts and Reminders plugins are not part of this launch.

ChatGPT adds iCloud Mail and iCloud Calendar plugins on all plans, connected with an Apple app-specific password

Key Takeaways

  • Available on every ChatGPT plan, including Free, on web, desktop and iOS, rolling out globally and subject to workspace app controls
  • Found under Settings > Plugins; iCloud Mail and iCloud Calendar are installed and connected separately
  • Both connect with an Apple app-specific password, which requires two-factor authentication; never use the main Apple password or paste it into a chat
  • Mail only works with @icloud.com, @me.com and @mac.com addresses, while Calendar uses the primary Apple Account email, which may differ
  • Disconnecting in ChatGPT does not revoke the app-specific password at Apple; that has to be done separately at account.apple.com
Read full story
Linked Models & Agents:

Block unveils Dessa: a full-duplex speech model trained from scratch only on human conversation audio, running locally on a MacBook Pro M4 Max

On 2026-10-23 (16:53 UTC) the official @blocks account unveiled Dessa, and Jack Dorsey called it the most authentic full-duplex speech model ever built. The official page block.xyz/dessa says Dessa is a true speech-to-speech model trained only on recordings of human conversation, with no text and no pretrained models. It is full-duplex, so it listens and talks at the same time, cuts in and backchannels naturally, runs faster than real time, and runs locally on a MacBook Pro M4 Max or better. Block says it was trained on a single NVIDIA GB200 NVL72 and learned language from hundreds of times fewer words than LLMs. There is no public API or weights yet; a small group of AI safety researchers is getting early access.

Block unveils Dessa: a full-duplex speech model trained from scratch only on human conversation audio, running locally on a MacBook Pro M4 Max

Key Takeaways

  • Trained only on human conversation audio, from scratch, with no text and no pretrained models (official page)
  • Full-duplex speech-to-speech: listens while talking, cuts in and backchannels, and natively hears and expresses emotion, sarcasm and laughter
  • Inference runs faster than real time and runs locally on a MacBook Pro M4 Max or better
  • Block says training used a single NVIDIA GB200 NVL72 and needed hundreds of times fewer words than LLMs
  • No public API, weights or third-party benchmarks yet; early access is limited to a small group of AI safety researchers
Read full story
Linked Models & Agents:
⚡ Dessa🌐 Block
ADSponsored

Fish Audio ships Drama 3: open-weight 35B MoE TTS with word-level emotion direction, #1 on Artificial Analysis Pronunciation Robustness at 93.2%

On 2026-10-13 Fish Audio launched Drama 3, a TTS model directed with plain-language bracket tags, open weights on Hugging Face, and API header model: drama-3. The backbone is a ~35B MoE (~3B active per token, initialized from Qwen3.5-35B-A3B's language tower) with a codebook-MTP audio decoder and preference-model RL. Independent Artificial Analysis Pronunciation Robustness: 93.2% vs 88.1% for S2.1 Pro; 83 languages and up to 16 speakers; Community License free for commercial use under US$500k annual revenue. Launch promo through Nov 12: about $10 per million characters on the API.

Fish Audio ships Drama 3: open-weight 35B MoE TTS with word-level emotion direction, #1 on Artificial Analysis Pronunciation Robustness at 93.2%

Key Takeaways

  • Open weights on Hugging Face fishaudio/drama-3 under Community License v1.0 (free commercial use under US$500k ARR; no non-consensual voice cloning)
  • Architecture: 35B MoE / ~3B active; hybrid attention (1 full-attn layer per 4); codebook-MTP decoder over 10 codebooks; initialized from Qwen3.5-35B-A3B LM
  • Benchmarks: Artificial Analysis Pronunciation Robustness 93.2% (#1) vs S2.1 Pro 88.1%; brand/place/tech names 95.9%, context-dependent readings 95.3%
  • Vendor H200 streaming: 271 frames/s single stream; concurrency-1 TTFA p50 88.9 ms; concurrency 16 ~927 frames/s, RTF 0.373
  • Ship: API POST /v1/tts with model: drama-3; self-host via SGLang-Omni (sgl-omni serve --model-path fishaudio/drama-3, typically ≥48GB NVIDIA VRAM)
Read full story
Linked Models & Agents:
⚡ Drama 3⚡ Fish Audio S2.1 Pro⚡ Qwen3.5-35B-A3B🌐 Fish Audio🌐 Artificial Analysis🌐 SGLang

UltraText Bench Open-Sourced: Comprehensive Bilingual Benchmark for Dense Visual Text Rendering in Image Generation

Rendering dense, legible, and spatially accurate text within generated images is critical for commercial graphic design, advertising posters, and e-commerce visuals. However, existing benchmarks predominantly test isolated words or simplistic English phrases, failing to capture the complexity of rendering multi-region, bilingual text layouts. LINs-lab introduces UltraText Bench (arXiv:2610.09823, code: github.com/LINs-lab/UltraText_Bench), a comprehensive bilingual benchmark designed to stress-test prompt-only dense visual text rendering. The suite contains 432 human-reviewed prompts distributed equally between English and Chinese across 24 real-world categories and three difficulty tiers (L1 to L3), with each prompt prescribing exact text for 4 to 12 distinct visual regions. Utilizing the Q-Judger multimodal evaluation model, UltraText Bench assesses 24 state-of-the-art model configurations across text fidelity, text clarity, spatial layout, and scene aesthetics. Empirical results expose key architectural trade-offs: Turbo distilled variants gain 3.81 clarity points but sacrifice 14.76 fidelity points, while flagship models like Qwen-Image exhibit steep performance degradation under L3 dense workloads (dropping from 86.50 to 42.86), with code and evaluation suites fully open-sourced.

UltraText Bench Open-Sourced: Comprehensive Bilingual Benchmark for Dense Visual Text Rendering in Image Generation

Key Takeaways

  • UltraText Bench open-sourced, establishing a rigorous 432-prompt bilingual benchmark for dense visual text generation
  • Deploys Q-Judger to score 24 model configurations across text fidelity, clarity, spatial layout, and scene aesthetics
  • Exposes key trade-offs: Turbo distilled variants drop 14.76 fidelity points, while dense L3 workloads halve model scores
Read full story
Linked Models & Agents:

Foundations of Proactive Agents: 3T Principles and Proactivity-Gym Benchmark Reveal Trust Erosion from Uncalibrated Interventions

Contemporary LLM agents operate overwhelmingly in a reactive posture, awakening only when commanded by explicit user prompts. As continuous ambient compute becomes cost-effective, proactive agents that exploit idle cycles to anticipate needs and execute support before users ask represent the next frontier of intelligent personal assistants. However, proactivity is a double-edged sword: even flawlessly completed autonomous tasks can disrupt user focus, impose heavy cognitive verification overhead, and destroy human trust if initiated at misaligned moments. Researchers from KAIST and the University of Minnesota establish foundational theory for proactive agents in arXiv:2609.37267, framing design around three joint principles (3T): Task Capability, Temporal Allocation (aligning compute with cognitive availability), and Trust. They introduce PROACTIVITY-GYM, a stateful multi-day evaluation testbed with persona-conditioned simulated users. Evaluating 23 model-harness configurations alongside a 30-participant human study, the authors show that poorly timed interventions trigger severe trust collapse despite perfect task outcomes, whereas asynchronous assistance during user downtime (e.g., sleep-time compute) preserves deep user engagement.

Key Takeaways

  • Establishes foundational theory for proactive agents around joint 3T principles: Task Capability, Temporal Allocation, and Trust
  • Releases PROACTIVITY-GYM, a stateful multi-day evaluation testbed featuring persona-conditioned simulated users across continuous scenarios
  • A 30-participant human study demonstrates that untimely interventions cause severe trust collapse despite correct outputs, validating sleep-time assistance as the optimal interaction paradigm
Read full story

OpenAI details textGrain text watermarking for the EU AI Act: invisible watermarks coming to ChatGPT and Codex output in the EU, opt-in for API customers worldwide

On Oct 5 OpenAI described its response to the EU AI Act's machine-readable text requirement: API customers worldwide can now opt in to text watermarking for select models (off by default), and in the coming weeks eligible ChatGPT and Codex text output in the EU will carry an invisible watermark across all plans. The technique, textGrain, embeds a statistical signal in word choices; OpenAI says it matched or beat SynthID for text and plans to open-source it. The detector is limited to approved researchers. At 1% false-positive rate, detection is ~80% on 200-token and ~95% on 400-token passages, falling to 17% after 25% synonym replacement; Astra benchmarks show no meaningful quality change.

OpenAI details textGrain text watermarking for the EU AI Act: invisible watermarks coming to ChatGPT and Codex output in the EU, opt-in for API customers worldwide

Key Takeaways

  • Scope: invisible watermarks on eligible ChatGPT and Codex text in the EU in coming weeks (all plans); API opt-in worldwide, off by default
  • Detection at 1% FPR: ~80% on 200-token passages, ~95% on 400-token; much lower for math-style text
  • Robustness: 10% synonym replacement drops detection ~92%→66%; 25% drops it to 17%
  • Quality: Astra (max) DeepSWE v1.1 72.80% vs 71.68%, Terminal-Bench 4.0 53.90% vs 56.06%, GPQA Diamond 94.44% vs 93.94% (unwatermarked vs watermarked)
  • Openness: textGrain technical report published, open-source release planned; detector limited to approved researchers
Read full story

Claude Code 2.1.286: stacked permission counts; resume keeps parallel-tool turns; secret redaction & model-fallback hardening

Anthropic shipped Claude Code 2.1.286 on 2026-09-30 (npm @anthropic-ai/[email protected]): permission prompts show stacked counts like "2 of 5"; --resume/--continue no longer drop turns after parallel tool-call crashes; broader secret/Bearer/URL-password redaction; one same-tier prior-model retry when the API refuses the default/alias; Remote Control disconnects when org policy disables it; Agent SDK TS 0.3.286 / Python 0.2.163 parity.

Claude Code 2.1.286: stacked permission counts; resume keeps parallel-tool turns; secret redaction & model-fallback hardening

Key Takeaways

  • Release v2.1.286; npm ~2026-09-30T17:14:38Z
  • Stacked permission prompts show counts like "2 of 5"; fullscreen "N more" rows are mouse-clickable
  • --resume/--continue keep turns after parallel tool-call crashes; non-text tool/hook returns no longer 400
  • Secret redaction hardened for Bearer/Basic, URL passwords, ZWSP key names; /feedback zip JSON fixed
  • Agent SDK TS 0.3.286 / Python 0.2.163 parity; docs https://docs.claude.com/en/docs/claude-code/overview
Read full story

Unsloth v0.1.900-beta: local Laya Decision models + Skills editor; ~4.5× LTX-2.3 clips and up to 6.3× faster VAE decode

Unsloth shipped v0.1.900-beta on 2026-09-28 (PyPI unsloth 2026.9.12): Desktop runs Laya Decision models locally via a Jev-compatible /v1/systemone endpoint, adds a Skills CRUD editor and Library viewers for PDF/Office, and improves Apple Silicon with batched serving, structured outputs, and TurboQuant KV. Media pipelines claim ~4.5× LTX-2.3 clips, 1.7–6.3× VAE decode, and up to ~1 minute faster MiniMax-H3 first render with 25–29 GiB lower peak VRAM.

Unsloth v0.1.900-beta: local Laya Decision models + Skills editor; ~4.5× LTX-2.3 clips and up to 6.3× faster VAE decode

Key Takeaways

  • Shipped v0.1.900-beta — local Laya Decision API + Skills editor + Library viewers
  • LTX-2.3 ~4.5×; VAE decode 1.7–6.3×; MiniMax-H3 first render up to ~1 min faster, −25–29 GiB peak VRAM
  • Apple Silicon: batched serving, structured outputs, TurboQuant KV; ModelScope downloads
  • Docs: docs.unsloth.ai
Read full story
Linked Models & Agents:
⚡ Laya⚡ LTX-2.3⚡ MiniMax-H3⚡ Gemma-4🤖 Unsloth-Studio🌐 Unsloth
ADSponsored

Pipecat 1.12.0: cross-vendor IPA pronunciation transforms, MOQTransport client reconnect, Classifier/LLMClassifier eval surface

Pipecat v1.12.0 (2026-09-26) adds TTSService.pronunciation_transform_ipa() for reusable word→IPA maps across Cartesia/ElevenLabs/Inworld/Deepgram, client-mode MOQTransport reconnect with session-ending markers, Pipecat Classifiers + LLMClassifier, frame-level interruptible, and response_schema on LLM run_inference. PyPI pipecat-ai 1.12.0 is live.

Pipecat 1.12.0: cross-vendor IPA pronunciation transforms, MOQTransport client reconnect, Classifier/LLMClassifier eval surface

Key Takeaways

  • Shipped: GitHub v1.12.0 = PyPI pipecat-ai 1.12.0; docs docs.pipecat.ai
  • Pronunciation: pronunciation_transform_ipa maps words to IPA once; vendors emit phoneme/SSML/slash IPA—register last in text_transforms
  • Transport: MOQTransport client reconnect within connection_timeout (default 60s); session-ending distinguishes hangup vs outage; relay_url full URL
  • Eval: Classifiers (YesNo/Choice/Score) + LLMClassifier batch questions; allow_continue=false for final-answer judges
  • Inference: run_inference response_schema enforced by OpenAI/Anthropic/Google; frames interruptible by default; UninterruptibleFrame deprecated
Read full story
Linked Models & Agents:

Video Use open-sources folder-drop video editing driven by Claude Code

@nicos_ai highlights Video Use (github.com/browser-use/video-use): an open-source pipeline for Claude Code that turns a folder of raw footage into cuts, filler-word removal, captions, color/filters, animations, and a final render—less timeline editing by hand, more agent-driven finishing.

Key Takeaways

  • Drop raw footage in a folder to start the pipeline—no timeline-first setup.
  • Covers cutting, filler-word removal, captions, grading, and final render.
  • Open-source at browser-use/video-use for Claude Code workflows.
Read full story
Linked Models & Agents:

DispatchSEO open-sources an MCP SEO workflow for Claude Code, Codex, and Cursor

@DanKornas introduced DispatchSEO, an open-source SEO workflow app for builders using Claude Code, Codex, or Cursor. It turns keyword ideas into content pull requests via agent research, an approval queue, scheduled builds, and search tracking. Agents connect over MCP to research, queues, rankings, pages, and Search Console; features include scheduled PR builds, daily rank checks, hourly Search Console snapshots, multi-site tokens, and an AGPL-3.0 license.

Key Takeaways

  • MCP connects agents to research, queues, rankings, pages, and Search Console data.
  • An approval queue feeds scheduled guide or free-tool pull-request builds.
  • Multi-site deployments get separate tokens and data under AGPL-3.0.
Read full story

OfficeCLI open-sources a single-binary agent Office suite with MCP

@khyssabc highlighted iOfficeAI/OfficeCLI, an agent-first Office suite: one binary creates, reads, and edits DOCX/XLSX/PPTX with JSON output, batch/daemon modes, template merge, OpenXML validation, and HTML/PNG preview. It ships MCP for Claude Code and Codex, covers macOS/Linux/Windows via Homebrew/Scoop/npm, plus Python/Node SDKs, Apache 2.0. About 30k GitHub stars.

Key Takeaways

  • Single binary reads/writes Word/Excel/PPT with no traditional Office install.
  • MCP for Claude Code/Codex; OpenXML validation plus HTML/PNG preview.
  • Apache 2.0; cross-platform binaries and Python/Node SDKs.
Read full story

OpenSquilla open-sources a microkernel agent with local four-tier model routing

@DanKornas highlighted TokenRhythm/opensquilla, a token-efficient microkernel AI agent for builders. SquillaRouter scores each turn locally on length, language, code, keywords, and semantic embeddings, then routes across four tiers to the cheapest capable model; the registry targets 20+ LLM backends with primary-plus-fallback. Fifteen bundled skills load on demand, and the agent can act as an MCP client or server. Local Markdown notes add SQLite full-text search and sqlite-vec semantic recall, with three sandbox policy tiers plus human-in-the-loop approvals for sensitive tools. Apache 2.0.

Key Takeaways

  • Local four-tier routing picks the cheapest capable model instead of always using the top tier.
  • Skills + MCP: 15 on-demand skills; agent can be MCP client and server.
  • Apache 2.0; Markdown/SQLite memory with three sandbox tiers and human approvals.
Read full story
Linked Models & Agents: