Liquid AI releases LFM3, six open-weight ~2B models spanning text, vision, audio, omni and decision tasks
On Oct 27 Liquid AI released LFM3, a new generation of foundation models built on a tri-hybrid architecture of gated short convolutions, sliding-window attention and global attention, pre-trained on 22T tokens. The first six models all branch from LFM3-1.7B-Base at around 2B parameters, with weights on Hugging Face under the LFM Open License v1.0. Liquid says the text model LFM3-1.7B needs about 1 GB at 4-bit, supports 256K context and beats models several times its size on several agent benchmarks.
Key Takeaways
- Six models: LFM3-1.7B (text), VL-2B (vision/video), Audio-2B, Omni-2B, plus decision models d1-2B and d1-Omni-2B
- Architecture: of 24 layers, 13 gated short convolutions, 5 sliding-window attention (256-token window) and 6 global attention; 22T pre-training tokens
- Vendor-reported: LFM3-1.7B scores 43.40 on SWE-bench Verified (OpenCode) vs 41.20 for Qwen3.5-4B and 51.20 for Qwen3.5-9B
- Vendor-reported: 38.42 on WebArena-Verified and 41.29 on AutomationBench, both above Qwen3.5-9B (28.94 / 15.10)
- A full 128K context needs about 1.6 GB of KV cache; one B300 with SGLang can produce about 3.6B tokens per day (vendor figure)

-oOdUn61bDRSykk4H951SoDOHzqoOe1.png)