MeshFlow:等变流匹配网格生成
阅读原文· arxiv.orgMeshFlow提出直接生成三角网格的方法,将网格视为三角形汤,避免了序列化为长自回归序列。该方法采用等变最优传输流匹配模型,保持了三角形汤的关键对称性(面的任意排列及每个面内顶点的排列)。通过对Diffusion Transformer架构进行简单有效的修改,构建了可扩展网络来建模速度场,同时维持所需的等变性。引入基于最优传输的训练目标,消除了违反对称性的监督信号,改善了收敛性。MeshFlow的生成质量媲美最先进自回归网格生成器,推理速度提升约18倍。
Meshes are among the most common 3D scene representations, but directly generating meshes is challenging because the representation contains important symmetries, including permutation invariance of faces and vertices. MeshFlow learns to generate triangle meshes directly as triangle soups, avoiding the need to serialize meshes into long autoregressive sequences. We adopt equivariant optimal-transport flow matching models that respect the key symmetries of triangle soups: arbitrary permutations of faces and permutations of the vertices within each face. Toward this goal, we propose a simple yet effective modification to the Diffusion Transformer architecture, resulting in a scalable network capable of modeling a velocity field while maintaining the desired equivariance. We further introduce an optimal-transport-based training objective that improves convergence by eliminating supervision signals that violate these symmetries. MeshFlow achieves mesh quality comparable to state-of-the-art autoregressive mesh generators while providing about an 18times speedup during inference. Project page is at https://qiisun.github.io/MeshFlow/.