ALERT🚨 TILERT from @TileRT_AI TO BOOST DECODE INTERACTIVITY BY 1.9X AT THE SAME PER-TOKEN COST ON THE SAME NVIDIA BLACKWELL GPUs. What does this mean for Groq/Cerebras/SambaNova? 👇️ 1/5🧵
AI 导读
警报🚨 来自 @TileRT_AI 的 TILERT，可在相同的 NVIDIA Blackwell GPU 上、以相同的每 token 成本，将解码交互性提升 1.9 倍。这对 Groq/Cerebras/SambaNova 意味着什么？👇️ 1/5🧵
ALERT🚨 TILERT from @TileRT_AI TO BOOST DECODE INTERACTIVITY BY 1.9X AT THE SAME PER-TOKEN COST ON THE SAME NVIDIA BLACKWELL GPUs. What does this mean for Groq/Cerebras/SambaNova? 👇️ 1/5🧵
来源：SemiAnalysis· x.com