On October 31, Chris Tate of Vercel Labs, creator of agent-browser, announced agent-desktop on X as "agent-browser, for your whole computer". It is an Apache-2.0 Rust CLI and C library that reads a desktop app's OS accessibility tree and returns every actionable element as a JSON ref; the agent clicks or types on a ref and snapshots again to verify, with no pixel matching, headless by default. Version 1.0.0 shipped on October 27 and added Linux support; the current npm release is 1.0.2.
Zoom
Key Takeaways
Install: npm install -g agent-desktop, one package with native x64/ARM64 binaries; 1.0.0 (Oct 27) added Linux (glibc 2.35+, via AT-SPI), and the latest npm release is 1.0.2 (Oct 30)
Loop: snapshot prints a JSON tree with refs, click @<snapshot_id>:eN acts, then snapshot again to verify; a changed UI returns STALE_REF, and errors say whether a retry is safe
Scope: the README lists 60 command names, 56 of them operational, spanning windows, keyboard and mouse, notifications, clipboard, waits and session traces
Headless by default: ref actions go through accessibility APIs without moving the pointer or stealing focus, with --headed for physical input; Chris Tate says multiple agents can use the computer in parallel, each with its own cursor
Benchmarks: no official success-rate or speed numbers; it is a tool with no model inside, and web pages stay with agent-browser
On Oct 29 Amp shipped macOS Satellites: threads keep running on a Linux orb, and when work needs macOS Amp boots a fresh cloud Mac with Xcode and simulators, uses it only to build, run and test, and returns screenshots, logs and screen recordings to the thread. mac.medium costs $2/hour and mac.large $4/hour; the beta is waitlisted. CEO Quinn Slack says agents need a Mac only about 35% of the time even for macOS-heavy work.
Zoom
Key Takeaways
Amp says the cloud Mac is ready in about 30 seconds with Xcode, iOS simulators and Homebrew preinstalled
Two sizes: mac.medium (6 CPUs, 14 GB) at $2/hour and mac.large (12 CPUs, 28 GB) at $4/hour, drawn first from plan orb usage, then Amp credits
A Mac stays up 20 minutes after use so follow-ups reuse its build cache, then it is deleted and nothing is saved
CEO Quinn Slack posted on X that even macOS-heavy agent work needs a Mac only ~35% of the time (company figure)
Beta only: join the waitlist under Settings > Experimental Features
On Oct 26 Apple released iOS, iPadOS, macOS, watchOS and visionOS 27.2, and Siri AI (beta), the assistant rebuilt on Apple Intelligence, now supports French, Japanese, Korean, Portuguese and Spanish in addition to English. Apple says Traditional Chinese, Norwegian, Turkish and Vietnamese will follow by the end of the year. Per the iOS 27.2 release notes, Siri AI can now recall past conversations and draw on more sources such as photos in Messages, Calendar attendees and voicemails. Siri AI is still unavailable in the EU on iOS, iPadOS and watchOS and in mainland China, and server-side features have daily usage limits; Apple says expanded access will be offered for a fee in the future.
Zoom
Key Takeaways
Languages: Siri AI grows from English-only to 6 languages, adding French, Japanese, Korean, Portuguese and Spanish; Apple says Traditional Chinese, Norwegian, Turkish and Vietnamese arrive by year end
5 platforms: iOS, iPadOS, macOS, watchOS and visionOS 27.2 shipped the same day, with Siri AI still labeled beta
New abilities (per iOS 27.2 release notes): recall of past conversations, more sources including photos in Messages, Calendar attendees and voicemails, plus one Excluded Apps setting
Limits: unavailable on iOS/iPadOS/watchOS in the EU, for mainland China accounts and for users under 13; server-side features have daily caps, and Apple says paid expanded access is coming
Devices: Apple Intelligence hardware such as iPhone 15 Pro and later and M1-or-later iPad and Mac, with device and Siri language set to the same supported language
The Google AI Studio team released an experimental preview of the Gemini API CLI (command name gemini-api). It is a stateless, zero-dependency Go binary for macOS, Linux and Windows, open source under Apache 2.0. Any coding agent with shell access and a GEMINI_API_KEY can call text reasoning, image, video, music and speech generation, file and YouTube analysis, audio and video transcription, and managed agents such as Deep Research with one command. Media is written straight to disk and only the file path goes to stdout, so base64 payloads never land in the context window. Google labels it experimental and not a supported Google product.
Zoom
Key Takeaways
Default models (official README): gemini-3.8-flash for generate, analyze and transcribe; gemini-nano-banana-2.1 for image; gemini-omni-1.1-flash for video; lyria-3.5 for music; gemini-3.8-flash-tts for speech
Install with a one-line curl script on macOS/Linux, a PowerShell script on Windows, or go install; the latest GitHub release is v0.4.3 (published 2026-10-19)
Built for agents: --usage prints the command tree as KDL, --schema prints JSON Schema, --dry-run validates offline with credentials redacted, plus --output-format json/toon and inline --jq
It also manages sandbox environments, server-side credentials, webhooks and cron triggers for managed agents; files uploaded via the Files API are kept for 48 hours
Alibaba Tongyi Labs (Tongyi-MAI) has published and open-sourced OpenGCUA (arXiv:2610.22200), establishing a fully open software stack for Generalist Computer Use Agents. Moving beyond brittle single-click GUI paradigms, OpenGCUA introduces a 'Code-Execution-as-Action' framework combining visual screen perception, accessibility trees, bash scripts, and Playwright APIs into unified programmatic execution blocks. Evaluated across eight frontier models on OSWorld-v2, OpenGCUA boosted mean scores by +19.6 points while cutting task steps by 53.0%, releasing an Apache-2.0 macOS menu-bar harness and Cross-Device SDK.
Zoom
Key Takeaways
OpenGCUA published in arXiv:2610.22200 and released under Apache 2.0 as an open generalist computer-use agent stack
Pioneers 'Code-Execution-as-Action', synthesizing loops, conditionals, and programmatic APIs into unified Python/Bash blocks
On OSWorld-v2, boosts mean score by +19.6 points across eight frontier models while reducing steps per task by 53.0%
Releases a native macOS menu-bar harness for physical execution alongside a Cross-Device SDK spanning PC, web, and mobile
Perplexity officially unveiled that Perplexity Computer now operates 100% locally on macOS through the native desktop application. Breaking away from cloud-dependent computer-use paradigms that ship continuous video feeds across the internet, Perplexity Computer executes both the underlying inference model and the agent orchestration runtime directly on local Mac silicon. By interfacing natively with macOS Accessibility APIs, the system eliminates network latency, guarantees complete screen privacy, and empowers autonomous desktop copilots to orchestrate multi-application workflows entirely offline.
Zoom
Key Takeaways
Perplexity launched Perplexity Computer inside the native macOS app, hosting both model inference and agent loops locally
Eliminates privacy vulnerabilities of cloud-based GUI agents by keeping all screen frames and keystrokes strictly on-device
Achieves near-instantaneous interaction latency leveraging Apple Silicon unified memory and the Neural Engine
Seamlessly interfaces with native macOS Accessibility APIs and app sandboxes for cross-application workflow automation
On Oct 16 Tencent Hunyuan open-sourced Hy Memory 2.0 in three layers: the Apache-2.0 memory-writer model Hy-Memory-30B-A3B (~3B active, HF weights plus arXiv report), a Python SDK covering Chat, Working and Coding scenes (PyPI hy-memory 2.0.x), and local-first MemHub (CLI + macOS, preview). Per Tencent, swapping it in as the writer across Mem0, MemOS, Hy-Memory and held-out EverMemOS yields a 55.49 average vs 54.62 for Claude Opus 5, measured on fixed 20% subsamples; it still trails Opus 5 on several individual metrics.
Zoom
Key Takeaways
Vendor-reported: 55.49 four-harness average vs 54.62 for Claude Opus 5 and 53.64 for DeepSeek V4.1 Flash
Held-out EverMemOS: 56.89 vs Opus 5 at 54.04; still trails on Mem0 LoCoMo (59.54 vs 69.47)
~3B active, Apache-2.0, tested on vLLM v0.31.0 with an OpenAI-compatible API
SDK installs via pip install hy-memory with automatic Chat/Working/Coding routing
MemHub runs on Linux and macOS (preview); Windows unsupported
Google Antigravity CLI shipped 1.3.5 on 2026-10-14 (UTC). Release notes add Auto mode: it auto-approves file edits and safe commands, still prompts before irreversible actions, and sends commands that would leave the terminal sandbox to a separate agent for review first. Enable with --mode auto, Agent Mode in /config, or Shift+Tab; Linux and macOS now, Windows later. The same cut adds on-demand /compact and upgrades /diff with syntax highlighting, folding, and viewport rendering for large files. Official modes docs still listed only default / accept-edits / plan at fetch time—treat the GitHub release as source of truth.
Zoom
Key Takeaways
Release: Antigravity CLI 1.3.5 (89081f7, 2026-10-14T03:16:53Z) leads with Auto mode
Auto: auto-approves file edits and safe commands; still prompts before irreversible actions; sandbox-leaving commands are reviewed by a separate agent first (per GitHub release)
Enable via --mode auto, Agent Mode in /config, or Shift+Tab; Linux/macOS now, Windows later
/compact on demand: alone summarizes and ends the turn; with a follow-up it summarizes then answers; Esc cancels; finish shows steps summarized and context shrinkage
/diff: syntax highlighting, hunk folding (Ctrl+O / f), viewport rendering; expand-all disabled over 100k lines or 10 MB
On Oct 7 AWS released Strands Box v0.1.0, an open-source (Rust, Apache 2.0) sandbox for AI agents. It pairs OS-level isolation with the Dogwood policy language: shell, Python, outbound HTTP and MCP calls all pass through one default-deny policy engine with a shared event history, so rules can depend on earlier actions and elapsed time. A gateway injects credentials so the agent never sees the secrets. Preview supports macOS on Apple silicon only; Linux is in development.
Zoom
Key Takeaways
Release: v0.1.0 shipped 2026-10-07 17:24 UTC, written in Rust, Apache 2.0 (GitHub)
Default deny: engine-checked operations need a matching permit, and forbid overrides it (Dogwood)
Temporal rule example: an agent may post Slack status updates at most 3 times per 10 minutes; git push timing and API spend caps work the same way (The Register)
Platforms: macOS 15+ on Apple silicon only for now; Linux in development, Windows on the radar, AgentCore / ECS / Kubernetes planned
Benchmarks: AWS has not published performance or security benchmark numbers
GitHub dsh-v0.2.1-alpha.1 (2026-10-03T06:42:19Z) adds an experimental Claude Code Mods compatibility layer to MIT DeepSeek Harness (~243k stars)—explicitly to test that Mods APIs are broadly a subset of dsh plugins, not full compatibility—continuing v0.2 desktop apps. Get it at deepseek.com/harness or npx @deepseek-ai/dsh web.
On 2 Oct 2026 Apple posted on Developer News that macOS Full Disk Access will get additional controls so grants require very explicit user action. The post names AI agents as the reason risk will grow substantially. No OS version or ship date was announced.
Open-source Louis-CFM/coucou (MIT, ★3146) parks Claude Code/Codex/Cursor/Gemini CLI/Antigravity sessions in the Mac notch (top-edge island on Windows/Linux), with in-island Allow/Deny/Always approvals, live diffs, file drop, and service pills. macOS v0.1.3 shipped 2026-10-03; Linux 0.1.1 beta is out; Windows installer is paused for a Defender false positive.
On 2026-10-01 GitHub announced Computer Use in public preview for Copilot CLI and the Copilot app on macOS and Windows: agents can drive local desktop apps via accessibility tree/screenshots, clicks, typing, scroll/drag, and cross-app workflows—targeting GUI-only legacy software. Off by default; enable with /computer on or Settings; enterprise policy can block it.
anomalyco shipped OpenCode v1.18.34 on 2026-09-30 (npm ~22:38Z; 30 commits vs 1.18.33): send namespaced session and parent-session identity headers with model requests; sign macOS CLI/release binaries with Developer ID for macOS 27+; tree also refreshes Go Plus plan UI and daily model rankings.
OpenAI Codex shipped rust-v0.159.0 on 2026-09-29 (npm @openai/[email protected]): opt-in instant_interrupt steers mid-response or long code-mode calls; compact welcome/headers; warnings viewer dismisses reviewed items on close (k to keep); scroll transcript while reviewing a plan; richer native Mermaid; app-server can paginate thread history from an item anchor. ~89 commits / 300 files vs v0.158.0. Windows suppresses stray consoles for MCP/code-mode; .aws protected under writable roots; macOS sandbox TLS/proxy fixes.
