📰 SGLang v0.5.22 Released: DeepSeek-V4.1 Throughput Jumps 2.3x on H200 and 1.9x on MI355X, InstantTensor Loads Models 10x Faster
The SGLang team released v0.5.22 featuring 950 PRs from 245 contributors: DeepSeek-V4.1 delivers up to 2.3x more throughput per GPU on NVIDIA H200 and 1.9x on AMD MI350X/MI355X via DSpark. The new InstantTensor loader cuts model loading time by 10x.
💬 What's your take? Join the discussion in the comments.
Read the original Chinese version
📰 SGLang v0.5.22 重磅发布:DeepSeek-V4.1 在 H200 吞吐提升 2.3 倍、MI355X 提速 1.9 倍,InstantTensor 载入提速 10 倍
SGLang 团队正式发布 v0.5.22 大版本更新(凝聚 245 位贡献者提交的 950 个 PR):深度优化 DeepSeek-V4.1 推理性能,在 H200 单卡吞吐狂飙 2.3 倍,并通过 DSpark 首次在 AMD MI350X/MI355X 实现 1.9 倍吞吐提升;首创 InstantTensor…
💬 你怎么看?欢迎在评论区讨论。
#SGLang #DeepSeek-V4.1 #AMD MI355X
0 Comments
