Sam Altman回顾2014年OpenAI成立之初,业界普遍认为AGI遥不可及,团队因此被指为“疯子”和“骗子”。其核心押注在于持续扩展深度学习的规模,尽管当时团队并未完全理解扩展定律的精确预测性,但已观察到投入更多计算通常能提升效果,并决心坚持这一路径探索。
Sam Altman talks about how in 2014, the so-called "elderly" in the field thought the idea of OpenAI is baseless.
"In 2014, we started saying, "You know, we should really do something about this." It was incredibly unpopular at the time. We had said we want to make an AGI lab, and all the elders of the field were like, "You're insane. You're a scammer."
This is because, at the time, people thought AGI was 100 years away and none of these approaches were going to work. We really said, "Let's just push on this one idea that scaling deep learning seems to matter."
We didn't know at the time how beautifully predictable the scaling laws were, but it was at least clear back in those days that if you threw more compute at something, you got better results most of the time.
We kind of just decided we were going to push on it as far as we could."