Tooling5d ago
LM Studio Bionic 1.1.10 adds the oMLX engine, bringing RAM-plus-SSD KV caching and MLX speculative decoding to local models on Macs
LM Studio posted on X at 15:32 UTC on Oct 29 that users can now download a new oMLX engine inside LM Studio and run it with MLX models they already have. The official changelog lists it in Bionic 1.1.10, alongside speculative decoding for MLX models and an in-app terminal. oMLX is an open-source Apple Silicon inference server maintained by developer jundot (Apache 2.0, about 23,000 GitHub stars) built around continuous batching and a two-tier RAM and SSD KV cache. LM Studio has not published speed comparisons for the engine.
Pricing4d ago
X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back
On the Cheeky Pint podcast with Stripe co-founder John Collison, published October 29, Sam Altman discussed the memory shortage. He said many people assume open-source models and local inference solve the compute crunch, but from a global allocation perspective it is "quite terrible" for everyone to have scarce DRAM sitting in their own computer and being used about 5% of the time, and that a supply-constrained world wants maximum utilization in the cloud. A pubity post quoting him drew more than 26,000 likes and over 8 million views, and many users pushed back that PC memory is not only for AI and that local models matter for privacy and offline use. This is a summary of an X discussion, not a verified conclusion.
Release46d ago
PrismML releases Ternary Bonsai 2 27B: 5.9 GB with 98.2% benchmark retention for agentic coding
PrismML released Ternary Bonsai 2 27B, a ternary-weight model based on Qwen3.8 27B. It is about 5.9 GB—roughly 9x smaller than the full-precision counterpart—while retaining 98.2% of aggregate benchmark performance. PrismML says the release improves agentic coding, multimodal reasoning, and long-horizon tool use, and ships under Apache 2.0.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.