机器人不仅需要VLA与世界模型
阅读原文· arxiv.org本文认为通用机器人智能常被简化为策略缩放问题,但核心瓶颈并非策略学习,而是缺乏将人类运动、互联网视频等非结构化行为数据转化为具身监督信号的机制。研究者识别出四个缺失接口:自动标注非结构化行为的数据接口、重定向人类运动至机器人动作的具身接口、基于物理的3D推理世界模型接口,以及从视频和语言推断任务进度与成功的奖励接口。文章梳理了机器人基础模型、视频学习等进展,并提出构建能从更广泛物理世界学习的机器人系统研究议程。
Generalist robot intelligence is often framed as a policy-scaling problem: collect more robot demonstrations, train larger Vision-Language-Action (VLA) models, and expect broader generalisation. In this position paper, we argue that this framing is incomplete. The central bottleneck is not only policy learning, but the absence of mechanisms that convert the world's abundant unstructured behavioural data into grounded robot supervision. Human motion, internet video, simulation rollouts, and interactive demonstrations contain rich information about tasks, goals, contacts, failures, and physical constraints, yet most of this information is not directly usable by robot policies because it lacks embodiment-specific action labels, task semantics, and reward structure. We identify four missing components for the next generation of robotics: data interfaces for autolabelling unstructured behaviour, embodiment interfaces for retargeting human motion to robot actions, world-model interfaces for physics-grounded 3D reasoning, and reward interfaces for inferring task progress and success from video and language. We survey recent progress in robot foundation models, cross-embodiment datasets, learning from video, world models, and reward modelling, and propose a research agenda for building robotics systems that can learn not only from robot demonstrations, but from the broader physical world.