Omarchy Local Model Engine omarchy-local-ai 0.5.0 Ships: Nemotron 3.5 Bolt Becomes the 64 GB Default, and DHH Says Omarchy 4.6 Will Recommend the Best Local Model for Each Machine
At 08:30 UTC on November 9, Omarchy creator DHH released v0.5.0 of omarchy-local-ai, the local model engine behind Omarchy. It extends local model support to 64 GB NVIDIA GB10 / N1x-class machines and makes Nemotron 3.5 Bolt the default for that tier (project measurements: full 262K context, 91 tok/s on short prompts and 82 tok/s at 32K, peaking under 40 GiB). About 20 minutes later he posted on X that Omarchy 4.6 will recommend the best model each machine can run, showing the agents panel on the Ryzen AI Max+ 495 machine AMD gave him, with a Claude Code subscription next to a local Qwen3.8 Flash Next using 94 GiB. The feature comes from PR #17267, merged November 1: one omarchy agent local use best command picks a model by GPU family and RAM class and runs it in a rootless Podman container with no network access, for coding agents such as OpenCode and pi. No release date for 4.6 has been announced.
Key Takeaways
- Release: DHH published omarchy-local-ai v0.5.0 at 08:30 UTC on November 9; the 64 GB GB10 / N1x default is Nemotron 3.5 Bolt, with Qwen3.8 27B (131K window) as fallback
- Measured (project figures): on 64 GB, Bolt runs the full 262K context at 91 tok/s on short prompts and 82 tok/s at 32K, peaking under 40 GiB
- The best.toml recommendation table covers 3 classes today: Strix Halo 128 GB (Flash Next, then 27B), GB10/N1x 128 GB (Flash Next, Bolt, 27B) and GB10/N1x 64 GB (Bolt, 27B)
- On a Ryzen AI Max+ 395 / 128 GB, Flash Next reached 47.5 tok/s at 32K and 105 tok/s on code edits in v0.3.0; the 27B moved to 4-bit at 20.7 tok/s and 40 GiB
- Security boundary: models run in rootless Podman containers with no network egress, a read-only root and all capabilities dropped, with the API key as a Podman secret; DHH's post had 163 likes and 21 replies after about 20 minutes