# 字节跳动 Seed 团队发布 SeedRealtime：原生音视频全双工大模型，一个模型同时看、听、说

- 来源：MarkTechPost（RSS）
- 作者：Michal Sutter
- 发布时间：2026-08-10 13:48
- AIHOT 分数：56
- AIHOT 链接：https://aihot.virxact.com/items/cmsmu6xzg0ikvrohffnvbovc1
- 原文链接：https://www.marktechpost.com/2026/08/09/bytedance-seed-introduces-seedrealtime-a-native-audio-visual-full-duplex-llm-that-watches-listens-and-speaks-in-one-model

## AI 摘要

字节跳动 Seed 团队推出 SeedRealtime，一款原生音视频全双工大模型，将音频、视频和文本统一在一个端到端架构中，并行处理感知、理解、决策与表达，并将轮次切换内化到模型内部，取代外部语音活动检测器。该模型已在豆包 App 中上线，但未发布技术报告、参数规模、开源权重或 API。字节内部人工评估显示，其节奏问题相比级联架构减半，但未提供基准分数或延迟数据。

## 正文

ByteDance’s Seed team has introduced SeedRealtime, a native audio-visual full-duplex LLM. The model fuses audio, video and text in a single unified architecture. It interacts in real time over continuous multimodal streams, rather than one turn at a time. Seed positions it as a step toward omni-modal interaction, and claims three breakthroughs: joint audio-visual understanding, proactive interaction, and natural conversational timing. The architectural target is the cascade: chained ASR, VLM and TTS modules that add latency and lose information between stages. SeedRealtime instead runs perception, understanding, decision-making and expression in parallel inside one end-to-end model. Turn-taking moves inside the model as well, replacing the external voice-activity detector most real-time stacks still depend on.

Is it deployable?

It is partly deployable.

SeedRealtime is live inside the Doubao app, ByteDance’s consumer assistant. For this specific model, ByteDance has published no technical report, no parameter count, no open weights, and no Volcano Engine or BytePlus endpoint. As a third-party team, you cannot integrate it as of now. What is deployable right now is the idea: a validated reference architecture, and a moved goalpost for anyone shipping real-time voice-plus-camera products.

Interactive explainer

What is actually new in the demos

Seed published seven scenarios. Four are load-bearing.

Identity binding across modalities: At a noisy group dinner, the model matches names to faces as people are introduced, then keeps each voice tied to its identity — attributing conflicting travel preferences to the right speaker before proposing a plan.

Proactive speech from a held instruction: At the Hebei Museum, a user asks to be reminded when a specific bronze screen stand appears. The camera keeps panning; the model watches and speaks up unprompted when the piece enters frame. The same behavior shows up on a ResNet paper — the model tracks fast page flips, spots the “3.4 Implementation” section, pauses on its own, and reads out learning rate, momentum and weight decay.

Correction from visual state, not from a question: Watching an espresso workflow, the model interrupts when whole beans go into the portafilter, then reads crema color and volume and suggests shortening extraction by 2 to 3 seconds.

Interference suppression pand off-screen memory: At Beijing Daxing Airport, unrelated chatter about a flight does not trigger a reply. When the user actually asks, the model answers from departure-board information that has already scrolled off screen, and goes online for the baggage-carousel location.

Key Takeaways

SeedRealtime is a native audio-visual full-duplex LLM — audio, video and text in one end-to-end architecture.

Turn-taking moves inside the model; no external VAD decides when to speak.

ByteDance’s own human eval reports pacing issues halved versus cascaded stacks — no benchmark, no latency numbers.

It is live in the Doubao app, but there is no technical report, no weights and no announced API.

Check out the ByteDance Seed launch post and Seed models page.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.