Google AI 发布 Project Genie 研究原型,利用 Google Maps 街景数据作为基础,用户仅需文本提示或真实地点即可生成并探索交互式 360 度虚拟环境。该工具解决“空白空间”问题,通过街景数据真实生成所选位置的 360 度视图。Genie 生成的世界基于世界描述和用户操作逐帧创建,更动态丰富,通过预测后续帧模拟跨海或登顶等体验,标志着交互媒体和模拟管线的重大转变。
Step into the map with the Street View grounding feature in Project Genie from @GoogleDeepmind and @GoogleLabs.
Announced at I/O, this research prototype uses locations from @GoogleMaps Street View as a foundation, letting you generate and explore interactive, 360-degree virtual environments from just a text prompt or real-world starting place.
Cool, right? But… How does it actually work? 🤔
As an experimental tool, Project Genie tackles the "blank space" problem (showing both what's in front of the camera and behind it) by utilizing Street View data to realistically generate a 360-degree view of the location you selected as the starting point for your world to generate from.