GitHub Next open-sourced LocalJev (github.com/githubnext/localjev): a morning build of a “poor man’s Jev” for teammates without TypeSafe Jev access. It exposes a Jev-compatible POST /v1/systemone API in Bun/TypeScript, defaults to oMLX-backed local models such as DiffusionGemma, and reports evals across DiffusionGemma, Qwen MoE, Gemma 4 MoE, and Gemma 4 e4b/e2b (benchmark report in-repo). The LocalJev server works with normal Jev client wrappers, but probabilities are model-reported rather than logit reads—calibrate before consequential use.
Key Takeaways
- ✓Open-sources LocalJev: a local Jev-compatible POST /v1/systemone decision API (Bun/TypeScript).
- ✓Defaults to oMLX-backed local models such as DiffusionGemma, with multi-model evals in-repo.
- ✓Works with normal Jev client wrappers; probabilities are model-reported, not logit reads—calibrate first.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.