# Jim Fan 回顾 OpenAI 2016 年 World of Bits 项目，称 GPT-6 终于可靠订出机票

- 来源：Jim Fan (@DrJimFan)
- 发布时间：2026-09-04 10:14
- AIHOT 分数：55
- AIHOT 链接：https://aihot.virxact.com/items/cmtmc89u101idroxkxi4cnaia
- 原文链接：https://x.com/DrJimFan/status/2095696882844463382

## AI 摘要

Jim Fan 回忆 2016 年在 OpenAI 参与 World of Bits（OpenAI Universe）项目，让智能体看屏幕像素、移动鼠标在 United 网站订机票，但当时用从零开始的 RL 配合手工奖励函数注定失败。

## 正文

Good old days at OpenAI in 2016: an agent stares at screen pixels, moves a mouse, and books a flight on United. We called it World of Bits, inside OpenAI Universe. 10 yrs later, Astra is reincarnated in the same universe. Even the naming is astronomically correct 😆

Universe was perhaps the most ambitious AI infra project at the time, but we couldn't quite figure out how to solve it. A policy with zero prior knowledge of what a "submit" button does has to rediscover the entire internet visual lingua by trial and error. In retrospect, RL from scratch against hand-drawn, per-task "artisan" reward functions on a bunch of Pascal Titan X GPUs was completely doomed.

To solve computer use agent, the right way turns out to be boiling the ocean first (hillclimb on every general task you can find), and then specialize back down to the screen pixels and keystrokes. Or simply, a "Specialized Generalist".

Lessons learned: one step ahead of everyone, you're a pioneer. Three steps ahead, you're a prophet. Five steps ahead, you're a martyr.

Congrats, GPT-6! That United flight finally gets booked, reliably this time. The 2016 intern in me has a big smile.
