VoxCPM2 开源视频翻译配音工具发布

OpenBMB · @OpenBMB · X·2026-08-31 21:01·9分钟前
AI 导读

开发者基于 VoxCPM2 构建开源视频配音翻译工具,可将视频翻译为多语言并保留原说话人音色与对话自然度。项目整合 VoxCPM2 参考音色克隆、Whisper 转录与词级对齐、自动翻译及可选 LatentSync 唇形同步,支持本地优先处理,提供从人声分离到视频重建的端到端流程。

OpenBMB@OpenBMB
56AI 编辑部评分,满分 100

VoxCPM2 开源视频翻译配音工具发布

2026-08-31 21:01· 9分钟前
AI 导读

开发者基于 VoxCPM2 构建开源视频配音翻译工具,可将视频翻译为多语言并保留原说话人音色与对话自然度。项目整合 VoxCPM2 参考音色克隆、Whisper 转录与词级对齐、自动翻译及可选 LatentSync 唇形同步,支持本地优先处理,提供从人声分离到视频重建的端到端流程。

🎙️ Can AI preserve your voice across languages? See how VoxCPM2 transforms a video into a natural AI dub.

A developer built an open-source Video Dubbing Translator, enabling users to translate videos into different languages while preserving the original speaker’s voice and the natural flow of the conversation.

Powered by VoxCPM2, this project combines voice cloning, speech recognition, translation, and video reconstruction into a complete AI dubbing workflow:

✨ Reference-voice cloning with VoxCPM2 to preserve speaker identity ✨ Whisper for accurate transcription and word-level alignment ✨ Automatic translation for multilingual content creation ✨ Optional lip-sync support with LatentSync ✨ Local-first processing for more flexible and private workflows

From separating vocals and background audio to generating translated speech and rebuilding the final video, the project provides an end-to-end pipeline for creating AI-dubbed content.

🔗 Explore it: http://github.com/kadirb4rut/video-dubbing-translator

🤗 Model: http://huggingface.co/openbmb/VoxCPM2

🎬 Turn on sound to compare the original clip and the VoxCPM2 dubbing result.👇