Rohan Paul@rohanpaul_ai
40AI 编辑部评分,满分 100

AlphaSense:Kimi 每 token 更便宜但单题成本更高

2026-08-15 09:00· 30分钟前
AI 导读

AlphaSense 新研究显示,Anthropic 模型使用成本可能低于部分大型开源中文模型。Kimi 每 token 价格远低于 GPT-5.6 Sol,但因组装上下文消耗更多 token,单题成本反而更高。真正成本单位是“完成 token 数 × token 价格”,token 效率是系统属性而非 API 定价属性;AlphaSense 通过改变检索方式,在相同模型上实现约 3 倍成本降低。

Anthropic models may be cheaper to use than some large open-source Chinese models, per a new study by AlphaSense.

It says Kimi is substantially cheaper per token than GPT-5.6 Sol, yet more expensive per completed question because it consumes many more tokens while assembling context.

The real unit of cost is not $/token, but tokens-to-completion × token price. A more expensive model that searches efficiently, stops at the right time, and reasons over a smaller, cleaner context can have a lower total inference bill.

"Token efficiency" is really a systems property, not an API-pricing property. Kimi K3 can have cheaper tokens yet cost more per question because poor stopping behavior and repeated retrieval inflate context before useful reasoning even begins; in multi-step agents, that waste propagates into later steps, so a small retrieval inefficiency can become a much larger workflow-level tax.

AlphaSense gets roughly a 3× cost reduction from changing retrieval around the same model, while task-level routing improves preference even further.

So that means model vendors can keep leapfrogging each other without fully commoditizing the application layer, because whoever owns retrieval, routing, and evaluation decides which model is economically viable for each task.

来源:Rohan Paul · x.com

AlphaSense:Kimi 每 token 更便宜但单题成本更高

Rohan Paul · @rohanpaul_ai · X·2026-08-15 09:00·30分钟前
AI 导读

AlphaSense 新研究显示,Anthropic 模型使用成本可能低于部分大型开源中文模型。Kimi 每 token 价格远低于 GPT-5.6 Sol,但因组装上下文消耗更多 token,单题成本反而更高。真正成本单位是“完成 token 数 × token 价格”,token 效率是系统属性而非 API 定价属性;AlphaSense 通过改变检索方式,在相同模型上实现约 3 倍成本降低。

Anthropic models may be cheaper to use than some large open-source Chinese models, per a new study by AlphaSense.

It says Kimi is substantially cheaper per token than GPT-5.6 Sol, yet more expensive per completed question because it consumes many more tokens while assembling context.

The real unit of cost is not $/token, but tokens-to-completion × token price. A more expensive model that searches efficiently, stops at the right time, and reasons over a smaller, cleaner context can have a lower total inference bill.

"Token efficiency" is really a systems property, not an API-pricing property. Kimi K3 can have cheaper tokens yet cost more per question because poor stopping behavior and repeated retrieval inflate context before useful reasoning even begins; in multi-step agents, that waste propagates into later steps, so a small retrieval inefficiency can become a much larger workflow-level tax.

AlphaSense gets roughly a 3× cost reduction from changing retrieval around the same model, while task-level routing improves preference even further.

So that means model vendors can keep leapfrogging each other without fully commoditizing the application layer, because whoever owns retrieval, routing, and evaluation decides which model is economically viable for each task.

来源:Rohan Paul· x.com