"1亿词的上下文窗口已经成为可能，这大约相当于人类一生中所听到的词汇量。推理支持是实现这一目标的唯一瓶颈。 而AI模型实际上在上下文窗口期间确实在学习，而无需改变权重。" ~ Anthropic CEO Dario Amodei 这是11个月前的说法。 --- 来自Alex Kantrowitz的YouTube频道（完整视频链接在评论区）
Rohan Paul@rohanpaul_ai"1亿词的上下文窗口已经成为可能，这大约相当于人类一生中所听到的词汇量。推理支持是实现这一目标的唯一瓶颈。 而AI模型实际上在上下文窗口期间确实在学习，而无需改变权重。" ~ Anthropic CEO Dario Amodei 这是11个月前的说法。 --- 来自Alex Kantrowitz的YouTube频道（完整视频链接在评论区）
"100 million words context window is already possible, which is roughly what a human hears in a lifetime. Inference support is the only bottleneck to achieve it.
And AI Models actually do learn during the context window, without changing the weights."
~ Anthropic CEO Dario Amodei
This is from 11 months back. --- From 'Alex Kantrowitz' YT Channel (Full Video link in comment)
来源：Rohan Paul· x.com