# TTFT被高估？关键在交互性 vs 吞吐量

- 来源：SemiAnalysis (@SemiAnalysis_)
- 发布时间：2026-07-06 22:02
- AIHOT 分数：54
- AIHOT 链接：https://aihot.virxact.com/items/cmr9an8o302gkslsm0zq1qwwn
- 原文链接：https://x.com/SemiAnalysis_/status/2074131872053956686

## AI 摘要

TTFT（首 Token 时间）是推理中引用最多的延迟指标之一。

但 TTFT 真的重要吗，还是它是技术栈中最被高估的指标？

真正的轴不是“快”。而是交互性（tok/s/user）与吞吐量（tok/s/GPU）。(1/3)🧵

## 正文

TTFT (time-to-first-token) is one of the most-quoted latency numbers in inference.

But does TTFT actually matter, or is it the most overrated metric in the stack?

The real axis isn't "fast." It's interactivity (tok/s/user) vs throughput (tok/s/GPU). (1/3)🧵