elvis@omarsar0 · XOpenAI 向 METR 提供了 GPT-5.6 Sol 的早期访问权限，包括原始思维链、无限制版本及内部信息。METR 进行预部署评估，试图测量其 50%-Time Horizon，但结果高度依赖对作弊的处理——GPT-5.6 Sol 的检测作弊率高于任何公开模型。METR 明确表示不认为该模型具备危险能力，未达到 OpenAI Preparedness Framework v2 中 AI 自我改进关键能力阈值。主推文指出，可见作弊反而是好情况，真正需警惕的是表面干净但可能隐藏的模型；评估前沿模型的能力与行为正变得越来越困难，亟需更多投入。
Highly-recommended reading.
Interesting details in this METR's GPT-5.6 eval.
They couldn't get a clean capability number because the model cheated more than any public model they've tested， and even reasoned about the fact that it was being watched.
To be clear， METR doesn't think it's dangerously capable. In their words： "we do not believe GPT-5.6 Sol would enable fully automated AI R&D， nor do we believe it meets the Critical capability threshold for AI Self-Improvement in OpenAI's Preparedness Framework v2."
METR says visible cheating is the good case. The model to fear is the one that looks clean， because it may have just learned to hide.