Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly. In this paper, we introduce Energy-Guided Flow Matching(EG-FM) that explicitly models a coarse-to-fine generative trajectory by moving endpoint. Specifically, EG-FM replaces the fixed endpoint with a heat-kernel-filtered endpoint that evolves smoothly from low-frequency image to clean image. The fraction of high-frequency signal in moving endpoint is released by an image-specific energy-guided scheduling, leading to the re-targeting of velocity in flow matching. Our framework requires no adaptation of the backbone and training data, bringing negligible cost on the training and inference stages. In our experiment, EG-FM consistently achieves lower FID on the ImageNet class-conditional image generation task at 256 times 256 with fewer epochs, reaching an FID of 1.55 at 200 epochs and 1.45 at 600 epochs. We continue training the generation task on the setting of 512 times 512 resolution, yielding a FID of 1.58 after only 40 high-resolution adaptation epochs. Furthermore, we transfer EG-FM on text-to-image generation and achieve 0.85 on GenEval score and 83.9 on DPG-Bench. Code is available at https://github.com/ysng123/EG-FM.
能量引导流匹配(EG-FM)
AI 导读
EG-FM 将流匹配的固定端点替换为热核滤波端点,并依据图像特定能量调度逐步释放高频信号,显式建模由粗到细的生成轨迹,无需改动骨干网络或训练数据。在 ImageNet 256×256 类别条件生成任务上,EG-FM 以更少训练轮次取得更低 FID,200 轮达 1.55、600 轮达 1.45;512×512 分辨率下仅经 40 轮高分辨率适配即获 1.58。
HuggingFace Daily Papers(社区热门论文)
54
AI 编辑部评分,满分 100能量引导流匹配(EG-FM)
EG-FM 将流匹配的固定端点替换为热核滤波端点,并依据图像特定能量调度逐步释放高频信号,显式建模由粗到细的生成轨迹,无需改动骨干网络或训练数据。在 ImageNet 256×256 类别条件生成任务上,EG-FM 以更少训练轮次取得更低 FID,200 轮达 1.55、600 轮达 1.45;512×512 分辨率下仅经 40 轮高分辨率适配即获 1.58。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org