Rohan Paul@rohanpaul_ai
46AI 编辑部评分,满分 100
2026-08-04 11:53· 36分钟前
跳到正文
AI 摘要

OpenAI 详解 GPT-Live 实时语音架构,支持边听边说,无需独立轮次检测。深度推理与工具调用并行运行,对话不中断;音频传输与应用逻辑分离,慢工具调用不冻结对话。媒体前端与推理逻辑改用 Go 重写,p95 帧交付达旧系统 p50 水平;会话启动用 WARP 将 WebRTC 设置从六次网络往返降至一次。

OpenAI explained how it built GPT-Live for real-time voice conversations.

It's built around continuous audio, i.e. GPT-Live listens and speaks continuously instead of waiting for a separate turn detector to decide whose turn it is.

Deeper reasoning and tool calls run in parallel, so the conversation keeps flowing while a stronger model works in the background.

OpenAI separated audio transport from application logic, so a slow tool call can delay its result without freezing the conversation.

They also rewrote the media frontend and inference logic in Go, reporting that the new system's p95 frame delivery matches the previous system's p50.

Long calls remain active through parallel handoffs, with a replacement model prefilled from the current conversation before traffic switches over.

The same mechanism compacts growing context without pausing speech, because the old model keeps talking until its replacement is ready.

Session startup uses WebRTC Abridged Roundtrip Protocol (WARP) to cut WebRTC setup from six network round trips to one, while Instant Connect can begin from a single UDP packet.

OpenAIGPT-Live can listen while it speaks. To make that feel natural at ChatGPT scale, we rebuilt the voice stack from client to model. This new architecture keeps au...
Rohan Paul · @rohanpaul_ai · X·2026-08-04 11:53·36分钟前
在 X 看原推· x.com(在新标签页打开)
AI 摘要

OpenAI 详解 GPT-Live 实时语音架构,支持边听边说,无需独立轮次检测。深度推理与工具调用并行运行,对话不中断;音频传输与应用逻辑分离,慢工具调用不冻结对话。媒体前端与推理逻辑改用 Go 重写,p95 帧交付达旧系统 p50 水平;会话启动用 WARP 将 WebRTC 设置从六次网络往返降至一次。

OpenAI explained how it built GPT-Live for real-time voice conversations.

It's built around continuous audio, i.e. GPT-Live listens and speaks continuously instead of waiting for a separate turn detector to decide whose turn it is.

Deeper reasoning and tool calls run in parallel, so the conversation keeps flowing while a stronger model works in the background.

OpenAI separated audio transport from application logic, so a slow tool call can delay its result without freezing the conversation.

They also rewrote the media frontend and inference logic in Go, reporting that the new system's p95 frame delivery matches the previous system's p50.

Long calls remain active through parallel handoffs, with a replacement model prefilled from the current conversation before traffic switches over.

The same mechanism compacts growing context without pausing speech, because the old model keeps talking until its replacement is ready.

Session startup uses WebRTC Abridged Roundtrip Protocol (WARP) to cut WebRTC setup from six network round trips to one, while Instant Connect can begin from a single UDP packet.

OpenAIGPT-Live can listen while it speaks. To make that feel natural at ChatGPT scale, we rebuilt the voice stack from client to model. This new architecture keeps au...
在 X 查看原推x.com(在新标签页打开)