OpenDub dubs a video into another language while keeping the speaker's own voice. Upload a video, choose the language it is spoken in and the one you want, and OpenDub does the rest in your browser tab.

It separates the speech from the music and effects, so the soundtrack survives the dub. It transcribes the speech, translates each sentence so that it fits the time the speaker took to say it, and speaks it back in a clone of the original voice, in the tone each line was said in. Subtitles in the new language can be burned in. You can replace the voice or keep the original faintly underneath as a voice-over.

Afterwards you can change any translation, tone or timing and re-dub only those lines. Voices are available in 17 languages.

OpenDub is local-first: separation, speech detection, timing, mixing and rendering run on your device, and the video file is never uploaded. Only speech clips and text go to the voice model you choose, using your own API key. The browser version handles videos up to five minutes. OpenDub is open source under AGPL-3.0.

Key features

• Dub a video into another language in a clone of the speaker's own voice
• Each line is timed to start and stop with the original speaker
• Tone matched line by line, with controls for expressiveness, pitch and delivery
• Keeps the music and effects: replace the voice, or add a voice-over
• Burns in subtitles in the new language
• Edit any translation, tone or timing and re-dub just those lines
• Voices in 17 languages
• Works with Higgs Audio or ElevenLabs, using your own API key
• Local-first: the video file never leaves your device
• Open source under AGPL-3.0

Pricing

OpenDub is free and open source. Voice models run with your own API key (Higgs Audio or ElevenLabs), which you pay to the provider directly.

Links

• Website: https://opendub.app/
• Source code: https://gitlab.com/open-dubapp/OpenDub
• Privacy: https://opendub.app/privacy
• License: AGPL-3.0