是时候寻找新的架构了
2026年3月16日
时代变迁的又一显著迹象:萨姆·奥尔特曼(Sam Altman)曾嘲笑我在2022年对LLM的批评——当时我认为规模扩展不会带来AGI,我们需要新的架构——而他现在却主张:
……从研究角度来看,我打赌一定能找到另一种新架构,其收益将像Transformer架构之于LSTM一样巨大……所以我会去寻找(在AI的帮助下)能在哪里取得重大突破……
你可以在这里观看。
请注意,奥尔特曼在这次演讲中并未声称已经找到了这样的架构。这与他十四个月前声称“我们现在知道如何构建通常意义上的AGI”相比,是一次显著的立场后退。
结合马斯克最近承认xAI“构建方式不对”,以及扎克伯格推迟Meta最新模型的消息,三位知名科技CEO在短时间内发生的转变,是一个强烈信号,表明业内人士正在对纯粹的规模扩展失去信心。
哈萨比斯也不再支持这一路线,苏茨克弗和勒昆同样如此。纳德拉和皮查伊也暗示了对规模扩展的怀疑。
本专栏自创立以来的观点一直是:规模扩展不会通向AGI——而事实也确实如此。
然而令人费解的是,当权者仍在考虑花费数万亿美元建设数据中心,这些设施对环境代价高昂,且最终可能需要政府救助。
随着规模扩展作为通往AGI之路的论据逐渐瓦解,是时候重新思考了。AI数据中心这笔糟糕的交易毫无意义。
图片由迪·里法伊(Di Rifai)创作。
关于本文的讨论
如果这没那么悲剧,倒还挺好笑的
是啊,但现在工作环境被毁了,互联网被毁了,经济被毁了,连世界前景本身都显得不祥
准备好阅读更多内容了吗?
It’s past time to look for new architectures
Mar 16, 2026
Another dramatic sign of changing times: Sam Altman, who ridiculed my 2022 critique of LLMs that argued that scaling would not bring us to AGI and that we would need architectures has just argued that
… on the research perspective, I bet there is another new architecture to find that is going to be as big of a gain as transformers [were] to LSTMs … So I would go look for where I can find a mega breakthrough [with AI’s help] …
You can watch here.
Note that in this talk Altman didn’t claim to have found such an architecture. That represents a significant retrenchment from his claim fourteen months ago that “We now know how to build AGI as it’s usually understood.”
Taken together with Musk’s recent admission that xAI was “not built right” and Zuckerberg’s delay of Meta’s latest model, the shift from three prominent tech CEOs in a short period of time is a strong sign that insiders are losing faith in pure scaling.
Hassabis is no longer on board either, and nor are Sutskever and LeCun. Nadella and Pichai have also hinted at skepticism around scaling.
The view of this substack since its inception has been that scaling would not lead to AGI — and it hasn’t.
Yet bafflingly, the powers that be are still contemplating spending trillions on data centers that are costly to our environment and that might ultimately require government bailouts.
With the case for scaling as a road to AGI steadily crumbling, it is time to reconsider. The bad bargain of AI data centers makes no sense.
Image created by Di Rifai.
Discussion about this post
It would be funny if it wasn’t so tragic
Yeah, but now the work environment is ruined, the internet is ruined, the economy is ruined and the world prospect itself looks ominous