Code-as-World:用可执行世界表征实现智能体物理推理发现

HuggingFace Daily Papers(社区热门论文)·2026-08-27 08:00·4天前
AI 导读

Code-as-World 提出一种新范式,将物理世界的组成、动态演化与视觉外观表示为可执行代码,形成紧凑、可量化且可控的世界表征。研究构建了基于溯因推理的智能体发现循环,通过提出、执行、渲染、验证和迭代精炼可执行世界假设,从多模态观测中构建此类表征。实验显示,Code-as-World-VL 在 QuantiPhy 基准上达到最先进性能,并超越领先的专有模型。

HuggingFace Daily Papers(社区热门论文)
40AI 编辑部评分,满分 100

Code-as-World:用可执行世界表征实现智能体物理推理发现

2026-08-27 08:00· 4天前
AI 导读

Code-as-World 提出一种新范式,将物理世界的组成、动态演化与视觉外观表示为可执行代码,形成紧凑、可量化且可控的世界表征。研究构建了基于溯因推理的智能体发现循环,通过提出、执行、渲染、验证和迭代精炼可执行世界假设,从多模态观测中构建此类表征。实验显示,Code-as-World-VL 在 QuantiPhy 基准上达到最先进性能,并超越领先的专有模型。

Physical understanding and reasoning depend on forming compact and generalizable representations of the world. While modern vision-language models can recognize and explain diverse physical events, they often lack explicit representations of the underlying mechanisms-such as object states, physical parameters, and governing dynamics-needed for reliably reasoning how the world evolves and responds to interventions. In this work, we introduce Code-as-World, a paradigm that represents physical worlds through executable world representations. By expressing physical composition, dynamic evolution, and visual appearance as executable code, Code-as-World provides a compact, quantitatively grounded, and controllable abstraction of the physical world. To construct such representations from multimodal observations, such as natural-language descriptions or real-world videos, we develop an agentic discovery loop inspired by abductive reasoning, where an agent proposes, executes, renders, verifies, and iteratively refines executable world hypotheses. As a concrete application, we use verified executable worlds to provide scalable physical supervision for training vision-language models on quantitative physical reasoning. Experiments show that Code-as-World-VL achieves state-of-the-art performance on QuantiPhy and surpasses leading proprietary models, highlighting the potential of executable world representations as a scalable foundation for physical intelligence.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org