SparsePR:免训练稀疏注意力如何加速视频生成与世界模型

HuggingFace Daily Papers(社区热门论文)·2026-08-19 08:00·7天前
AI 导读

SparsePR 提出免训练块稀疏注意力方法,结合响应耦合分区与探针拟合残差重建,在四个视频生成与世界模型上持续降低注意力重建误差。该方法在 22.0%-26.0% 实际执行对密度下保持生成质量,实现 1.48x-2.61x 端到端加速。消融实验显示探针拟合贡献主要误差降低,响应耦合分区在有限探针预算下改善重建效果。

HuggingFace Daily Papers(社区热门论文)
52AI 编辑部评分,满分 100

SparsePR:免训练稀疏注意力如何加速视频生成与世界模型

2026-08-19 08:00· 7天前
AI 导读

SparsePR 提出免训练块稀疏注意力方法,结合响应耦合分区与探针拟合残差重建,在四个视频生成与世界模型上持续降低注意力重建误差。该方法在 22.0%-26.0% 实际执行对密度下保持生成质量,实现 1.48x-2.61x 端到端加速。消融实验显示探针拟合贡献主要误差降低,响应耦合分区在有限探针预算下改善重建效果。

Training-free block-sparse attention can accelerate video transformers, but row-wise attention concentration does not by itself specify an executable sparse operator. Queries sharing a block route may have poorly overlapping supports, while retained attention mass alone does not determine the post-softmax error from skipped interactions. We show that partition geometry affects both pooled support and the predictability of the remaining residual from the sparse output. We introduce SparsePR, which combines Response-Coupled Partitioning with Probe-Fitted Residual Reconstruction. Sampled-query key responses form paired K/V groups, whose centroids induce query-response coordinates for shared routing. A small set of exact query rows then calibrates a call-specific affine correction from the sparse output within the output subspace observed in the probe residuals. Across four heterogeneous video generation and world models, SparsePR consistently reduces attention-reconstruction error. Ablations show that probe fitting accounts for most of this reduction, while response-coupled partitioning lowers hard-drop error and improves reconstruction under a finite probe budget. SparsePR preserves generation quality at 22.0-26.0% realized executed-pair density while achieving 1.48x-2.61x end-to-end speedups. Project page: https://pardistaghavi.github.io/SparsePR-website/

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org