AI Coding Live News

OpenBMB open-sources the MiniCPM-OCR suite: a 1.3B parser scoring 93.68 on Real5-OmniDocBench, plus a 2B judge model that flags OCR errors

On Oct 27 OpenBMB (ModelBest) open-sourced the MiniCPM-OCR suite with two models: MiniCPM-OCR 1.0, a 1.3B-parameter document parser that scores 93.68 on Real5-OmniDocBench and 54.7 on OCRBench v2 (vendor-reported), and MiniCPM-OCR Jev, a 2B OCR quality judge that scores any parser's output region by region from 0 to 1 and flags content that needs human review. Code and weights are Apache 2.0, with day-one support for vLLM, SGLang, llama.cpp, Ollama and multiple chip platforms.

OpenBMB open-sources the MiniCPM-OCR suite: a 1.3B parser scoring 93.68 on Real5-OmniDocBench, plus a 2B judge model that flags OCR errors

Key Takeaways

  • MiniCPM-OCR 1.0 has just 1.3B parameters and scores 93.68 on Real5-OmniDocBench and 54.7 on OCRBench v2 (vendor-reported, both claimed SOTA)
  • The 2B MiniCPM-OCR Jev judge reaches 93.6 AUROC on JevOCRBench, above JEV-35B-A3B at 90.1 and close to Qwen3.5-397B-A17B at 93.8 (vendor-reported)
  • Jev is parser-agnostic: AUROC stays between 91.9 and 93.4 on outputs from MiniCPM-OCR, GLM-OCR, PaddleOCR-VL-1.6 and Xiaomi-OCR-0
  • Throughput is about 1.49x PaddleOCR-VL-1.6 and 3.62x MinerU2.5 Pro, reaching up to about 128 pages per minute with SDK concurrency (vendor-reported)
  • Code and weights on GitHub are all Apache 2.0, with GGUF/AWQ/GPTQ quantized builds and a SKILL.md for coding agents
Read full story
Linked Models & Agents:
⚡ MiniCPM-OCR 1.0⚡ MiniCPM-OCR Jev⚡ PaddleOCR-VL-1.6⚡ MinerU2.5 Pro⚡ Qwen3.5-397B-A17B🌐 OpenBMB🌐 ModelBest🌐 Intel🌐 NVIDIA🌐 Arm

Ollama Natively Supports Recursive Flint 40B: 2.5B Active MoE Coding Agent Delivering 125+ tok/s on MacBook Pro

Recursive, founded by Richard Socher, has officially open-sourced Flint (RecursiveSI/flint), a 39.8B Mixture-of-Experts (MoE) coding agent model under Apache 2.0 with day-zero Ollama support (ollama run flint). Activating just 2.5B parameters per token across 47 MoE layers with a 262K context window, Flint hits 125+ tokens/sec on an M4 Pro MacBook Pro. It sets new benchmarks for sub-50B local models, scoring 74.2% on SWE-bench Verified and 89.7% on SWE-bench Pro v2.

Ollama Natively Supports Recursive Flint 40B: 2.5B Active MoE Coding Agent Delivering 125+ tok/s on MacBook Pro

Key Takeaways

  • Flint employs a 49-layer architecture (2 dense + 47 MoE layers) with 39.8B total and 2.5B active parameters per token
  • Native 262,144-token (256K) context window supports end-to-end repository indexing and cross-file debugging
  • Blazing local inference speed: 125+ tokens/sec on M4 Pro MacBook Pro and 150+ tokens/sec on RTX Spark
  • Scores 74.2% on SWE-bench Verified, 89.7% on SWE-bench Pro v2, and 80.3% on LiveCodeBench v6 with instant 'ollama run flint' execution
Read full story
Linked Models & Agents:

Ornith-1.5-122B Released Under MIT: A Single-Node 122B MoE Reasoning Model Scoring 76.9 on SWE-bench Pro

The Ornith AI team officially released Ornith-1.5-122B under the permissive MIT license, a 122-billion parameter mixture-of-experts (MoE) reasoning model optimized to execute on a single GPU node (such as a single DGX). The model is immediately available across vLLM (0.19.1+), SGLang (0.5.9+), Hugging Face, and Ollama (ornith-1.5:122b) with native FP8, GGUF, and MLX quantization. Across independent agentic evaluations in the OpenHands harness, Ornith-1.5-122B registered 84.5 on SWE-bench Verified, 76.9 on SWE-bench Pro (surpassing Qwen3.8-Flash-Next's 43.9 by 33 points), 81.2 on TerminalBench 2.1, and 74.6 on MCP-Atlas.

Ornith-1.5-122B Released Under MIT: A Single-Node 122B MoE Reasoning Model Scoring 76.9 on SWE-bench Pro

Key Takeaways

  • Ornith-1.5-122B released under the permissive MIT license, offering a fully open, frontier-grade 122B MoE coding reasoning model
  • Engineered to fit inside a single GPU node (single DGX), with immediate runtime support on vLLM, SGLang, and Ollama (ornith-1.5:122b)
  • Achieves 76.9 on SWE-bench Pro, drastically outperforming the comparable open-weight baseline Qwen3.8-Flash-Next (43.9)
  • Delivers balanced agentic performance with 81.2 on TerminalBench 2.1, 80.0 on CyberGym, and 74.6 on MCP-Atlas
Read full story
Linked Models & Agents:
⚡ Ornith-1.5-122B⚡ Qwen3.8-Flash-Next🤖 OpenHands🌐 Ornith

Ollama Cloud Launches US/EU Zero-Data-Retention Hosting for DeepSeek-V4.1-Flash-1017 with Claude Code CLI, While SemiAnalysis Reveals GLM-5.3 Was Built 100% via Post-Training

Ollama launched US- and EU-hosted Ollama Cloud with strict zero data retention and zero training, adding immediate support for DeepSeek-V4.1-Flash-1017 via one-line launch commands for Claude Code and OpenCode alongside Ollama v0.40.6. Meanwhile, SemiAnalysis revealed that GLM-5.3 was built entirely by post-training the previous GLM-5.2 base model without pretraining from scratch, achieving a 'night and day difference' in cybersecurity and agentic capabilities.

Ollama Cloud Launches US/EU Zero-Data-Retention Hosting for DeepSeek-V4.1-Flash-1017 with Claude Code CLI, While SemiAnalysis Reveals GLM-5.3 Was Built 100% via Post-Training

Key Takeaways

  • Ollama Cloud launches US- and EU-hosted zero-data-retention serving for DeepSeek-V4.1-Flash-1017 with one-line ollama launch integrations for Claude Code and OpenCode
  • Ollama v0.40.6 adds GGUF q2_0 tensor support, clef cloud integration, and fixes orphaned runner processes on Windows
  • SemiAnalysis reveals GLM-5.3 was built entirely by post-training the previous model without pretraining from scratch, delivering a 'night and day difference' in cyber capabilities over GLM-5.2
Read full story
Linked Models & Agents:
ADSponsored

OpenBMB open-sources MiniCPM-V 4.7: a 35B-A3B MoE multimodal model that runs on-device at 13+ tokens/s on iPhone 17 Pro Max

On 2026-10-12 OpenBMB released MiniCPM-V 4.7, an Apache-2.0 open multimodal family with a 35B-A3B variant (the series' first MoE) and a 1B variant. Its Lookahead Expert Scheduling (LES) prefetches experts across layers and, combined with layer-wise mixed-precision quantization and DSpark speculative sampling, lifts SSD-offloaded decoding on an iPad Pro M4 (16GB) from 2.97 to 17.39 tokens/s (5.86x), per OpenBMB. Weights are on Hugging Face, ModelScope and Ollama, with vLLM, SGLang, llama.cpp and iOS/Android/HarmonyOS support.

OpenBMB open-sources MiniCPM-V 4.7: a 35B-A3B MoE multimodal model that runs on-device at 13+ tokens/s on iPhone 17 Pro Max

Key Takeaways

  • Two Apache-2.0 open-weight models: 35B-A3B (first MoE in the series, Qwen3.6 language backbone) and 1B, plus FP8 / AWQ / GPTQ / int4 / GGUF builds and DSpark draft models (Hugging Face)
  • LES on-device decode (OpenBMB, iPad Pro M4 16GB): baseline 2.97 → LES 9.81 → +layer-wise quant 14.92 → +DSpark 17.39 tokens/s, 5.86x overall (LES doc)
  • 35B-A3B reaches 13+ tokens/s on iPhone 17 Pro Max; mixed 4x/16x visual-token compression trades detail for cost per task
  • Vendor-reported (Instruct, 4x): MMBench 91.72, OCRBench 91.20, OmniDocBench v1.6 94.24, MMMU 80.22 vs Qwen3.6-35B-A3B at 86.76 / 86.00 / 80.17 / 77.44; still behind on SimpleVQA and ScreenSpot
  • Day-0 chip support for Rockchip, Houmo, Intel, AMD and Arm; runs on vLLM, SGLang, llama.cpp and Ollama; fine-tune via SWIFT / LLaMA-Factory
Read full story
Linked Models & Agents:
⚡ MiniCPM-V 4.7 35B-A3B⚡ MiniCPM-V 4.7 1B⚡ Qwen3.6-35B-A3B🌐 OpenBMB🌐 面壁智能

yetone open-sources Magpie: one menu-bar picker for Claude Code/Codex/Gemini CLI; local gateway translates OpenAI/Anthropic/Gemini APIs (~4282★)

yetone/magpie (MIT, since ~2026-09-23) collapses per-agent model config into a menu bar + local gateway at 127.0.0.1:3425/v1 that speaks OpenAI Chat/Responses, Anthropic Messages, and Gemini—streaming, tools, and reasoning translated both ways. Add DeepSeek/Kimi/GLM/OpenRouter/Ollama or Claude/ChatGPT/Copilot logins once; pick models in Codex, Claude Code, Gemini CLI, OpenCode, etc. At ingest: 4282★ / 275 forks; site usemagpie.ai.

Key Takeaways

  • Repo yetone/magpie MIT; site usemagpie.ai; intent docs usemagpie.ai/docs/intent
  • At ingest: 4282★ / 275 forks; created 2026-09-23T16:22:35Z; latest binary tag v0.1.697 (2026-10-03T02:04:55Z)
  • Local gateway translates OpenAI/Anthropic/Gemini; routing groups smart/order/rotate/usage; optional intent classifier per turn
  • Claude/ChatGPT/Copilot sign-ins become providers; keys stay in Magpie
  • Install: curl usemagpie.ai/install.sh | sh or go install; then magpie provider add / magpie claude|codex|gemini
Read full story

Ollama Python 0.6.3: native systemone() for Decision Models; think accepts model-defined levels

Official Ollama Python client v0.6.3 shipped 2026-09-29: adds ollama.systemone() matching server v0.35.0 /v1/systemone Decision Models (choice/noul/score); relaxes think to string levels; fixes multi-tool examples and case-insensitive image extensions. Requires Ollama ≥0.35.0 plus local decision models such as nimble/tev1.

Ollama Python 0.6.3: native systemone() for Decision Models; think accepts model-defined levels

Key Takeaways

  • Release v0.6.3 on 2026-09-29; ~6 commits vs v0.6.2 including examples/systemone.py
  • New ollama.systemone(model, state, questions) batches choice/noul/score Decision Model queries
  • Needs Ollama server v0.35.0+ and a local decision model (nimble/tev1)
  • think accepts string levels for model-defined thinking (#697/#744)
  • Install: pip install -U ollama==0.6.3
Read full story
Linked Models & Agents:
⚡ nimble⚡ tev1🤖 ollama🌐 Ollama

Ollama 0.35.0: Decision Models via /v1/systemone (Jev); Nimble & Tev1 return choices, probabilities, confidence

Ollama shipped v0.35.0 on 2026-09-28 (GitHub prerelease): Decision Models via TypeSafe’s Jev API at /v1/systemone. Instead of free text, models answer choice/noul/score questions with options, probabilities, and confidence—for ticket triage, model routing, and classification. First models: Nimble (Bespoke Labs) and Tev1 (Together AI). ~7 commits / 66 files vs v0.34.4; Settings no longer blocks on discovery; macOS update menu and stalled MLX downloads fixed.

Ollama 0.35.0: Decision Models via /v1/systemone (Jev); Nimble & Tev1 return choices, probabilities, confidence

Key Takeaways

  • v0.35.0 (prerelease) adds Decision Models at POST /v1/systemone (TypeSafe Jev)
  • Question types: choice (with probabilities), noul, score — not free-text generation
  • First models: Nimble (Bespoke Labs) and Tev1 (Together AI) on ollama.com/library
  • ~7 commits / 66 files vs v0.34.4; Settings/macOS update/MLX download fixes
Read full story

Ollama v0.40 Released: Defaults to Apple Native MLX Runner on Apple Silicon for Doubled Local Throughput

Local LLM inference runtime Ollama (@ollama) officially rolled out v0.40.0. The standout architectural milestone is the default adoption of Apple's native MLX framework on all Apple Silicon Mac devices (M1 through M5), replacing the legacy CPU/Metal compute paths. Supporting major architectures like Qwen 3.8 and Llama 3 natively, the update harnesses Apple's unified memory bandwidth, slashing time-to-first-token by 42% and nearly doubling continuous generation throughput without manual configuration.

Ollama v0.40 Released: Defaults to Apple Native MLX Runner on Apple Silicon for Doubled Local Throughput

Key Takeaways

  • Automatically routes model executions to Apple's native MLX framework by default on all Apple Silicon Mac hardware.
  • Fully unlocks unified memory bandwidth, boosting Qwen 3.8 and Llama 3 throughput by 85% while cutting TTFT by 42%.
  • Requires zero manual compiler flags or configuration switches; seamless upgrade via standard ollama run commands.
  • Cross-platform binary distributions and complete Git release changelog available directly on GitHub.
Read full story
Linked Models & Agents:
⚡ Qwen 3.8⚡ Llama 3.1 8b🤖 local-agent🌐 ollama🌐 apple

Cline v4.1.21: ai& Japan OpenAI-compatible provider, 6,386 models / 209 providers, local long-reply compact retry

Cline VS Code extension shipped v4.1.21 on 2026-09-24 with a new Japan OpenAI-compatible provider (ai&), a refreshed catalog of 6,386 models across 209 providers (19 unpinned defaults change—11 to Claude Opus 5.5 including GitHub Copilot and Vertex), and compact-and-retry once when local servers (llama.cpp/Ollama/LM Studio) hit output-token limits. Minimum js-yaml raised to 4.3.2 for frontmatter parsing security.

Cline v4.1.21: ai& Japan OpenAI-compatible provider, 6,386 models / 209 providers, local long-reply compact retry

Key Takeaways

  • New provider ai& (Japan OpenAI-compatible open-weight endpoint)
  • Catalog: 6,386 models / 209 providers; 19 unpinned defaults shift (11 → Opus 5.5 incl. Copilot & Vertex)
  • Local models compact-and-retry once on output-token caps
  • js-yaml floor 4.3.2 for rule/skill frontmatter
  • Install via Marketplace or cline-4.1.21.vsix
Read full story
ADSponsored

OpenHands v1.23.0 Released: Upgraded Multi-Agent Orchestration & Autonomous Regression Validation

OpenHands (@OpenHandsAI, formerly OpenDevin) has released v1.23.0. This release significantly upgrades the multi-agent execution pipeline and sandboxed runtime, introduces automated regression evaluation suites for complex repositories, and enhances compatibility with local inference backends like vLLM and Ollama.

OpenHands v1.23.0 Released: Upgraded Multi-Agent Orchestration & Autonomous Regression Validation

Key Takeaways

  • Introduces tri-agent architecture (Planner, Coder, Verifier) for robust end-to-end PR resolution.
  • Local Docker sandbox runtime execution latency reduced by 35% with real-time file event watchers.
  • Built-in SWE-bench Verified regression runner for local evaluation of custom agent policies.
  • Full source code and container images released on GitHub with native local backend support.
Read full story

Hazzel open-sources a minimal terminal coding agent with pre-edit diffs and BYOK/Ollama

@mukundzha6 ships Hazzel (github.com/mukundzha/hazzel): a ~10k-line Python minimal terminal coding agent that shows diffs before edits, supports undo and project-scoped commands, BYOK plus local Ollama, and no subscription—aimed at transparent, reversible local coding rather than a black-box repo rewriter.

Key Takeaways

  • Terminal coding agent with pre-edit diffs, undo, and project-scoped commands.
  • BYOK and Ollama support with no subscription.
  • ~10k lines of Python in an open GitHub repo.
Read full story
Linked Models & Agents:

Mira open-sources a self-hosted AI code reviewer with full-repo indexing

@DanKornas highlighted miracodeai/mira, a self-hosted AI code reviewer for teams that keep diffs, indexes, review history, and CVE data in their own SQLite or Postgres. It supports OpenRouter and OpenAI-compatible endpoints including vLLM/Ollama, applies per-repo rules via .mira.yaml, and auto-reviews PRs on GitHub, GitLab, and Forgejo/Codeberg. Apache-2.0.

Key Takeaways

  • Self-hosted by default: code and review data stay on your infrastructure.
  • Full-repo indexing plus custom rules go beyond a single diff.
  • Supports GitHub, GitLab, and Forgejo; models via OpenRouter or local OpenAI-compatible endpoints.
Read full story

Inco open-sources Splash: ~144 tok/s for Qwen3.8-27B on M5 Max

Inco AI open-sourced Splash, a local inference engine built for Apple silicon and models like Qwen3.8-27B. On an M5 Max MacBook Pro it reports about 144 tok/s—up to 3× Ollama, 2× oMLX, and nearly 4× when an agent fans out sub-agents. LM Studio shipped day-0 support under Settings > Runtime > Experimental backends.

Key Takeaways

  • Open-source Splash: local inference tuned for Apple silicon and Qwen3.8-27B.
  • Demo: ~144 tok/s on M5 Max; up to ~3× Ollama / 2× oMLX, nearly 4× with agent fan-out.
  • LM Studio day-0 support; repo github.com/incoai/splash; blog lmstudio.ai/blog/splash-engine.
Read full story

AWS open-sources Pizza Bot: email-style inbox for background AI agents, Apache-2.0 self-hosted

AWS open-sourced Pizza Bot (Apache-2.0), rebuilt from an internal Amazon tool used by 2,000+ people. The self-hosted app presents background agent results and pending decisions in an email-style inbox, supports Bedrock/Anthropic/Gemini/OpenAI/OpenRouter/Ollama, plus MCP servers, SKILL.md workers, and interrupt/approval policies across desktop/browser/terminal.

Key Takeaways

  • Born as an internal Amazon tool; now Apache-2.0 and self-hostable.
  • Email-style inbox for completed agent work and pending approvals.
  • Multi-provider models plus MCP, SKILL.md workers, and interrupt/approval policies.
Read full story
Linked Models & Agents: