对话式图像编辑的后续建议:Qwen App 数据驱动的三阶段框架

HuggingFace Daily Papers(社区热门论文)·2026-08-03 08:00·21天前
AI 导读

针对图像创作对话中后续编辑建议缺失的问题,研究者从 Qwen App 收集 10 万条真实多轮对话样本,发现其中 80.1% 依赖图像,需多模态推荐。

HuggingFace Daily Papers(社区热门论文)
52AI 编辑部评分,满分 100

对话式图像编辑的后续建议:Qwen App 数据驱动的三阶段框架

2026-08-03 08:00· 21天前
AI 导读

针对图像创作对话中后续编辑建议缺失的问题,研究者从 Qwen App 收集 10 万条真实多轮对话样本,发现其中 80.1% 依赖图像,需多模态推荐。

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05).

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org