SemiAnalysis@SemiAnalysis_ · X最新基准测试显示，在GLM5架构下，AMD MI355单节点FP8推理成本较NVIDIA B200降低了约40%。这一成果建立在SGLang v0.12针对CUDA与ROCm平台进行的非MTP、MTP及投机解码等多维度优化之上，团队认为性能速度是构建核心壁垒的关键。后续重点将是推动MI355X在生产级推理优化（如FP4）及分布式推理领域追赶CUDA的生态与性能，通过多卡协同提升单卡算力效率，从而进一步降低百万Token的推理成本。
AMD ALERT 🚀 MI355 is now 40% cheaper than B200 on GLM5 architecture for Single Node serving FP8 14 weeks after the initial launch of GLM5 on both non-MTP & MTP with spec decode for SGLang v0.12 for both CUDA & ROCm. SPEED IS THE MOAT！！ Great work to @AnushElangovan， @roaner， HaiShaw & his team！
Next step is for MI355X to catch up to CUDA when composing production inference optimizations like FP4 & on distributed inferencing where you can gang up MI355 boxes such that per GPU performance goes up thus the cost per million tokens goes down.