HuggingFace Daily Papers(社区热门论文)
53AI 编辑部评分,满分 100

OmniScientist:一个全模态、全学科的 AI 科学家

2026-08-13 08:00· 1天前
AI 导读

OmniScientist 是一个端到端全模态 AI 科学家,可直接从异构原始证据(图像、信号、音频、视频、3D 结构、轨迹、表格、公式和图)开展多学科研究。系统在 36 个真实数据案例(覆盖 5 个学科族)中全部完成从原始数据到成稿论文的完整流程,平均论文总分为 6.3。与仅接收预计算标量特征的盲变体相比,直接感知在全部 7 个评估维度上均更优,并在 85% 的成对比较中胜出。

Recent advances in foundation models have enabled AI scientists to automate increasingly complete research workflows, from hypothesis generation and code execution to manuscript preparation. Yet workflow coverage alone does not provide access to the full evidence on which scientific discovery depends. Existing systems typically reason over text, code, labels, or precomputed summaries, leaving scientifically decisive spatial, temporal, cross-channel, and procedural relations unavailable to the agent. We introduce OmniScientist, an end-to-end, omni-modal AI scientist that conducts multidisciplinary research directly from heterogeneous raw evidence. A perception layer and 3 autonomous agents for ideation, experiment, and writeup operate within a deterministic pipeline, allowing observations to shape research questions, experimental decisions, and final claims throughout the research lifecycle. By running idea, rigour, and claim checks in code, the system enforces novelty screening, statistical validity, execution provenance, and numerical traceability. We evaluate OmniScientist on 36 real-data cases spanning 5 discipline families, 4 families of scientific evidence, and modalities including images, signals, audio, video, 3-D structures, trajectories, tables, formulae, and graphs. The system completes the full path from raw data to a compiled manuscript in all 36 cases and achieves a mean overall paper score of 6.3 with the reference reasoning backbone. In paired comparisons against a blind variant that receives only precomputed scalar features, direct perception improves all 7 evaluation dimensions and wins 85% of head-to-head judgments. These results show that lifecycle-wide perception is essential for evidence-grounded scientific discovery and provides a practical path toward broadly capable AI scientists.

来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org

OmniScientist:一个全模态、全学科的 AI 科学家

HuggingFace Daily Papers(社区热门论文)·2026-08-13 08:00·1天前
AI 导读

OmniScientist 是一个端到端全模态 AI 科学家,可直接从异构原始证据(图像、信号、音频、视频、3D 结构、轨迹、表格、公式和图)开展多学科研究。系统在 36 个真实数据案例(覆盖 5 个学科族)中全部完成从原始数据到成稿论文的完整流程,平均论文总分为 6.3。与仅接收预计算标量特征的盲变体相比,直接感知在全部 7 个评估维度上均更优,并在 85% 的成对比较中胜出。

原文 · 保持原样,未翻译

Recent advances in foundation models have enabled AI scientists to automate increasingly complete research workflows, from hypothesis generation and code execution to manuscript preparation. Yet workflow coverage alone does not provide access to the full evidence on which scientific discovery depends. Existing systems typically reason over text, code, labels, or precomputed summaries, leaving scientifically decisive spatial, temporal, cross-channel, and procedural relations unavailable to the agent. We introduce OmniScientist, an end-to-end, omni-modal AI scientist that conducts multidisciplinary research directly from heterogeneous raw evidence. A perception layer and 3 autonomous agents for ideation, experiment, and writeup operate within a deterministic pipeline, allowing observations to shape research questions, experimental decisions, and final claims throughout the research lifecycle. By running idea, rigour, and claim checks in code, the system enforces novelty screening, statistical validity, execution provenance, and numerical traceability. We evaluate OmniScientist on 36 real-data cases spanning 5 discipline families, 4 families of scientific evidence, and modalities including images, signals, audio, video, 3-D structures, trajectories, tables, formulae, and graphs. The system completes the full path from raw data to a compiled manuscript in all 36 cases and achieves a mean overall paper score of 6.3 with the reference reasoning backbone. In paired comparisons against a blind variant that receives only precomputed scalar features, direct perception improves all 7 evaluation dimensions and wins 85% of head-to-head judgments. These results show that lifecycle-wide perception is essential for evidence-grounded scientific discovery and provides a practical path toward broadly capable AI scientists.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org