The Grid AI 提出了一种新的AI推理购买模式。用户不再指定具体模型,而是根据任务复杂度选择标准(standard)、生产(prime)或极致(max)三个级别之一。平台会自动将请求路由到满足该级别要求的最便宜供应商。应用仅需接入单一API,后端模型可根据价格与质量动态变化,从而优化成本。作者曾用Hermes Agent在本地测试,通过agent-price级别处理了工单分类工作流。The Grid目前处于Beta阶段,声称通过供应商竞价可使AI API成本降低最高80%,并为新用户提供首200M tokens免费额度。
Most AI teams still buy inference like they are buying software from 1 vendor.
They pick a model, accept the fixed price, wire it into the app, and keep paying that rate even when cheaper models could handle the same work.
@The_GridAI takes a different approach.
Instead of choosing a model name, you choose the level of work you need: standard, prime, or max. A simple task like support-ticket classification can run on standard. Normal production work like RAG, drafting, support replies, or agent steps can run on prime. Harder work with long context or higher error cost can run on max.