STREAM:一种从流媒体中挖掘高价值任务导向对话的数据中心框架
阅读原文· arxiv.org为解决垂直领域大语言模型缺乏复杂任务导向对话数据的瓶颈,STREAM框架提出一种从公开流媒体(直播与短视频)中规模化合成高质量服务对话的新方法。该框架从嘈杂的流媒体中挖掘真实交互信号,结合角色人物构建与对话蓝图设计,并利用检索增强生成(RAG)技术支持知识响应。基于此发布的StreamDial数据集覆盖汽车、餐饮与酒店三大领域,包含87,498个对话会话与1,497,320轮对话。评估表明,该数据集提升了对话内在质量,并在多个骨干模型上改善了对话状态跟踪性能;在Qwen3-8B上的多语言迁移实验也取得了积极结果。
Large language models for vertical domains are bottlenecked by the scarcity of complex, domain-specific task-oriented dialogues. Existing data acquisition pipelines face a persistent trilemma: expert annotation is expensive, real-world service conversations are constrained by privacy and commercial restrictions, and static corpora quickly become temporally stale. We propose Stream, a data-centric framework that leverages publicly available streaming media (live streams and short videos) to synthesize high-value service dialogues at scale. Stream mines authentic interaction signals from noisy streams and synthesizes conversations by integrating role-grounded persona construction with Conversational Blueprint construction; it further adopts retrieval-augmented generation (RAG) to support knowledge-aware responses. Based on Stream, we release StreamDial, a large-scale multi-domain dataset covering Automotive, Restaurant, and Hotel. StreamDial contains 87,498 dialogue sessions and 1,497,320 turns in total, with an average of 17.11 turns per session and a comparable scale across domains. Each session is organized as a structured quadruplet langle P_u, P_a, B, H rangle that pairs dialogue history with explicit user/agent personas and a Conversational Blueprint, capturing realistic service behaviors such as requirement mining, constraint conflicts, negotiation, and recovery. Evaluations with automatic judges and downstream tasks show that StreamDial improves intrinsic dialogue quality over strong baselines, and models trained with StreamDial improve Dialogue State Tracking across backbones; we further report a completed human-evaluation set and encouraging multilingual transfer on Qwen3-8B under a controlled training budget. The data is released in https://github.com/hitxueliang/DialogDataSetBySTREAM.