HuggingFace Daily Papers(社区热门论文)
46AI 编辑部评分,满分 100

Context-Matched Distillation:面向自回归视频蒸馏的因果对齐框架

2026-08-13 08:00· 1天前
AI 导读

Context-Matched Distillation(CMD)提出因果DMD框架,用因果教师替代双向全片段评分,使教师监督与学生生成时的因果信息集对齐。CMD在短、长视频基准上达到自回归方法中的最优综合性能,并显著提升对时变相机控制的遵循度。该方法可自然扩展至逐帧、分块生成及相机条件蒸馏。

Interactive autoregressive video generation demands both low-latency rollouts and precise online control. Few-step distillation accelerates generation by reducing denoising steps, while online control imposes a causal constraint: frames and blocks should depend on history and controls available during generation. Existing video distribution matching distillation (DMD) pipelines, however, often supervise causal few-step students using bidirectional teachers that score complete clips. The score for a target can therefore depend on future frames and controls that were unavailable when the student generated it, misaligning teacher supervision with the student's causal information set. We introduce Context-Matched Distillation (CMD), a causal DMD framework that aligns teacher supervision with the information available when each target is generated. CMD replaces bidirectional full-clip scoring with a causal teacher that evaluates each target without access to future frames or controls. The same causal teacher initializes the few-step student, establishing a consistent causal formulation across teacher training, student distillation, and inference. Beyond aligning the temporal information boundary, Prefix Scoring matches supervision to the student's realized rollout context by evaluating each target under the cached student-generated prefix that produced it. Prefix Corruption further stabilizes training by perturbing unreliable prefixes produced early in training while preserving this target-context alignment. With a simple causal formulation, CMD naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation. Experiments demonstrate state-of-the-art aggregate performance among autoregressive methods on both short- and long-video benchmarks, together with substantially improved adherence to time-varying camera controls.

来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org

Context-Matched Distillation:面向自回归视频蒸馏的因果对齐框架

HuggingFace Daily Papers(社区热门论文)·2026-08-13 08:00·1天前
AI 导读

Context-Matched Distillation(CMD)提出因果DMD框架,用因果教师替代双向全片段评分,使教师监督与学生生成时的因果信息集对齐。CMD在短、长视频基准上达到自回归方法中的最优综合性能,并显著提升对时变相机控制的遵循度。该方法可自然扩展至逐帧、分块生成及相机条件蒸馏。

原文 · 保持原样,未翻译

Interactive autoregressive video generation demands both low-latency rollouts and precise online control. Few-step distillation accelerates generation by reducing denoising steps, while online control imposes a causal constraint: frames and blocks should depend on history and controls available during generation. Existing video distribution matching distillation (DMD) pipelines, however, often supervise causal few-step students using bidirectional teachers that score complete clips. The score for a target can therefore depend on future frames and controls that were unavailable when the student generated it, misaligning teacher supervision with the student's causal information set. We introduce Context-Matched Distillation (CMD), a causal DMD framework that aligns teacher supervision with the information available when each target is generated. CMD replaces bidirectional full-clip scoring with a causal teacher that evaluates each target without access to future frames or controls. The same causal teacher initializes the few-step student, establishing a consistent causal formulation across teacher training, student distillation, and inference. Beyond aligning the temporal information boundary, Prefix Scoring matches supervision to the student's realized rollout context by evaluating each target under the cached student-generated prefix that produced it. Prefix Corruption further stabilizes training by perturbing unreliable prefixes produced early in training while preserving this target-context alignment. With a simple causal formulation, CMD naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation. Experiments demonstrate state-of-the-art aggregate performance among autoregressive methods on both short- and long-video benchmarks, together with substantially improved adherence to time-varying camera controls.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org