vLLM-Omni Integrates PhysisServe: Accelerating Video Diffusion & Physical-World AI with 4.1ms Chunk Output
The vLLM Project officially announced that PhysisServe's core physical-world serving techniques are being integrated into vLLM-Omni. Addressing the severe memory bottlenecks and latency spikes of multi-step video diffusion and physical AI generation, PhysisServe introduces cross-denoising-step pipeline parallelism across Transformer blocks, time-shared batching, and virtual-rank joint scheduling. Benchmarked on MiniMax H3 33B across 200 GPUs, it generates a chunk every 4.1 ms (~1,000 FPS without VAE decoding), while cutting single-GPU latency for Wan2.2 5B from 173 ms down to 98 ms.
Key Takeaways
- The vLLM project announced the upstream integration of PhysisServe's serving architecture into vLLM-Omni for physical AI and video models
- Introduces cross-timestep block pipelining and time-shared batching to eliminate GPU communication bubbles in multi-step diffusion
- Generates a video chunk every 4.1 ms on MiniMax H3 33B across 200 GPUs (~1,000 FPS), cutting Wan2.2 5B single-card latency to 98 ms
- Expands 24-GPU serving concurrency by 1.7x to 3.3x, with full open-source code merging into the vLLM-Omni mainline
Linked Models & Agents: