What is a multi-language video dubbing API?

A multi-language video dubbing API is a programmable interface that automatically translates and re-voices video content into multiple languages. It combines speech-to-text transcription, machine translation, and text-to-speech synthesis to produce dubbed audio tracks that match the timing and tone of the original speakers. V100 supports 40+ languages with both real-time live stream dubbing and asynchronous VOD post-processing.

Can V100 dub live streams in real time?

Yes. V100's real-time dubbing pipeline processes audio segments as they arrive during a live stream, producing translated audio with under 2 seconds of latency. The system uses streaming transcription, incremental translation, and low-latency TTS synthesis to deliver dubbed audio to viewers in their selected language without waiting for the stream to end.

Does V100 support speaker voice matching for dubbing?

Yes. V100's voice matching engine analyzes the original speaker's pitch, cadence, and tonal characteristics, then generates TTS output that preserves those qualities in the target language. This ensures dubbed content sounds natural and maintains speaker identity across languages.

40+ LANGUAGES

Multi-Language Video
Dubbing API for Global Content

A multi-language video dubbing API is a programmable interface that translates and re-voices video content into 40+ languages using AI-powered text-to-speech synthesis with speaker voice matching. V100 supports both real-time dubbing during live streams and asynchronous post-processing for VOD content, with ONNX runtime integration for custom TTS models -- enabling global content distribution, accessibility compliance, and multilingual worship or mission broadcasting from a single API call.

Get API Key View Integration Guide

40+ languages supported

Real-time live stream dubbing

Speaker voice matching

Why Video Dubbing Matters

Over 75% of internet users prefer consuming content in their native language. Subtitles help, but dubbed audio dramatically increases engagement, watch time, and comprehension -- especially for educational, religious, and accessibility-focused content.

3x Engagement Increase

Dubbed content consistently outperforms subtitled content in watch time and completion rates. Viewers in non-English markets are far more likely to engage with audio in their native language than to read subtitles, particularly for long-form video, live events, and educational material.

Manual Dubbing is Slow

Traditional dubbing studios charge $50-200 per finished minute and require 2-4 weeks per language. For a 60-minute video in 10 languages, you are looking at $30,000-120,000 and months of production time. API-driven dubbing reduces this to minutes and pennies per minute.

Live Events Need Real-Time

Live streams, webinars, and worship services cannot wait for post-production. V100's real-time dubbing pipeline translates and synthesizes audio during the live stream, delivering dubbed output to viewers in their chosen language with under 2 seconds of added latency.

How V100 Multi-Language Dubbing Works

V100's dubbing pipeline combines four stages -- transcription, translation, voice synthesis, and audio mixing -- into a single API call. Each stage runs as an independent Rust microservice, enabling both real-time streaming and high-throughput batch processing.

Stage 1: Speech Recognition

Audio is extracted from the video stream and processed through V100's transcription engine (Deepgram or Whisper). Speaker diarization identifies individual speakers, and word-level timestamps are generated for precise alignment.

40+ source language recognition

Multi-speaker diarization

Word-level timestamps for lip-sync

Stage 2: Machine Translation

Transcribed text is translated into the target languages while preserving sentence boundaries, speaker attribution, and timing constraints. Context-aware translation maintains meaning across sentence breaks that occur at different points in different languages.

Context-aware neural translation

Glossary and terminology support

Timing-constrained output length

Stage 3: Voice Synthesis (TTS)

Translated text is synthesized into speech using V100's TTS engine. Speaker voice matching analyzes the original speaker's pitch, cadence, and tonal characteristics, then generates output that preserves those qualities in the target language. Custom ONNX models can be loaded for specialized voices.

Speaker voice matching and cloning

ONNX runtime for custom TTS models

Prosody and emotion preservation

Stage 4: Audio Mixing

The synthesized speech is mixed with the original audio track. Background music and ambient sounds are preserved while the original speech is ducked or replaced. The final mix is aligned to the video timeline and delivered as a separate audio track or muxed into the output video.

Background audio preservation

Lip-sync timing alignment

Multi-track output (per language)

40+ Supported Languages

V100's dubbing API supports over 40 languages across every major language family. Each language includes multiple voice options with regional accent variants where applicable.

English

Spanish

French

German

Portuguese

Mandarin

Japanese

Korean

Arabic

Hindi

Russian

Italian

Dutch

Turkish

Polish

Swedish

Thai

Vietnamese

Indonesian

Hebrew

Swahili

Filipino

Romanian

+ 17 more

Integration Guide

Dub a video into multiple languages with a single API call. V100 handles transcription, translation, voice synthesis, and audio mixing automatically.

Upload or Stream

Provide a video URL, upload a file, or connect a live stream. V100 accepts MP4, WebM, MKV, HLS, and RTMP sources.

Select Languages

Specify target languages and voice preferences. Enable speaker voice matching for natural-sounding output that preserves original speaker identity.

Receive Dubbed Output

Get dubbed video files via webhook or poll the status endpoint. Each language is delivered as a separate file or audio track.

dub-video.js

// npm install v100-sdk
import { V100 } from 'v100-sdk';

const v100 = new V100('YOUR_API_KEY');

// Dub a video into multiple languages
const job = await v100.dubbing.create({
  source: 'https://cdn.example.com/sermon-2026-03-28.mp4',
  sourceLanguage: 'en',
  targetLanguages: ['es', 'fr', 'pt', 'zh', 'ar'],
  voiceMatching: true,           // Preserve speaker voice characteristics
  preserveBackground: true,      // Keep music and ambient audio
  lipSync: true,                 // Align timing to original speech
  outputFormat: 'mp4',           // mp4, webm, or audio-only (m4a)
  webhook: 'https://api.example.com/webhooks/dubbing'
});

// job.id       → "dub_abc123"
// job.status   → "processing"
// job.languages → ["es", "fr", "pt", "zh", "ar"]

// For real-time live stream dubbing:
const liveDub = await v100.dubbing.startLive({
  meetingId: 'mtg_xyz789',
  targetLanguages: ['es', 'fr'],
  voiceMatching: true,
  ttsEngine: 'default'          // or 'onnx://your-model-id'
});

// Subscribers select language via:
// v100.meeting.selectAudioLanguage('es')

Or use the REST API directly:

terminal

curl -X POST https://api.v100.ai/v1/dubbing \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "source": "https://cdn.example.com/video.mp4",
    "sourceLanguage": "en",
    "targetLanguages": ["es", "fr", "pt", "zh", "ar"],
    "voiceMatching": true,
    "preserveBackground": true,
    "lipSync": true
  }'

Use Cases

V100's multi-language dubbing API serves content creators, enterprises, nonprofits, and religious organizations that need to reach audiences across language barriers.

Global Content Distribution

Media companies and content creators can localize video libraries into 40+ languages without maintaining dubbing studios in each region. Course platforms, streaming services, and corporate training departments dub once through the API and distribute globally.

Accessibility Compliance

Organizations subject to ADA, Section 508, or WCAG requirements can provide audio descriptions and multilingual audio tracks for video content. Dubbed audio helps users who cannot read subtitles due to visual impairments or literacy barriers.

Missions and Worship

Churches and mission organizations broadcast sermons, worship services, and training content to multilingual congregations worldwide. Real-time dubbing during live services allows every viewer to hear the message in their native language without human interpreters.

E-Learning Platforms

Online education platforms expand their addressable market by dubbing courses into languages where demand exists but instructor supply does not. A single course recorded in English can be offered in 40+ languages, each with voice-matched delivery that maintains the instructor's teaching style.

Enterprise Communications

Multinational corporations dub all-hands meetings, executive updates, and training videos for distributed teams. Real-time dubbing during live company events ensures every employee receives the same message regardless of their office location or primary language.

Broadcast and OTT

Broadcasters and OTT platforms prepare multi-language audio tracks for international distribution. V100's batch API processes entire content libraries, producing broadcast-quality dubbed tracks with consistent voice casting across episodes and seasons.

ONNX TTS Engine Integration

V100's dubbing pipeline supports custom TTS models via the ONNX runtime. Upload your own voice models trained on specific speakers, accents, or brand voices, and V100 will use them for synthesis instead of the default engine.

Default TTS Engine

V100's built-in TTS engine provides high-quality synthesis in all 40+ supported languages. Speaker voice matching is automatic -- the engine analyzes the original speaker and generates output that preserves their vocal characteristics without requiring any training data.

"ttsEngine": "default"

Custom ONNX Models

Upload ONNX-format TTS models for fine-grained control over voice output. Ideal for brand voices, celebrity voice licensing, or specialized use cases like audiobook narration where the voice must match a specific performer exactly.

"ttsEngine": "onnx://model_abc123"

Pricing

Multi-language dubbing is billed per minute of output audio, per language. Real-time live dubbing uses the same per-minute rate. Volume discounts available on Enterprise plans.

Free Tier

$0/mo

Test dubbing in development.

10 minutes dubbing/month

3 target languages

Default TTS engine

No ONNX custom models

RECOMMENDED

Pro

Usage-based

Production dubbing at scale.

$0.015/min per language

40+ target languages

Voice matching + ONNX

Real-time live dubbing

Enterprise

Custom

Volume pricing, dedicated infrastructure.

Volume discounts

Dedicated GPU clusters

Custom voice training

Priority support

Start Dubbing Video in 40+ Languages Today

Free tier available for development and testing. Real-time live dubbing and VOD post-processing from a single API. Speaker voice matching included on all plans.

Get API Key — Free Tier Contact Sales

Related Resources

Feature

Multi-Language Video
Dubbing API for Global Content

Why Video Dubbing Matters

3x Engagement Increase

Manual Dubbing is Slow

Live Events Need Real-Time

How V100 Multi-Language Dubbing Works

Stage 1: Speech Recognition

Stage 2: Machine Translation

Stage 3: Voice Synthesis (TTS)

Stage 4: Audio Mixing

40+ Supported Languages

Integration Guide

Upload or Stream

Select Languages

Receive Dubbed Output

Use Cases

Global Content Distribution

Accessibility Compliance

Missions and Worship

E-Learning Platforms

Enterprise Communications

Broadcast and OTT

ONNX TTS Engine Integration

Default TTS Engine

Custom ONNX Models

Pricing

Start Dubbing Video in 40+ Languages Today

Related Resources

Auto Captions

Video Transcription API

Speaker Diarization API

Multi-Language VideoDubbing API for Global Content

Why Video Dubbing Matters

3x Engagement Increase

Manual Dubbing is Slow

Live Events Need Real-Time

How V100 Multi-Language Dubbing Works

Stage 1: Speech Recognition

Stage 2: Machine Translation

Stage 3: Voice Synthesis (TTS)

Stage 4: Audio Mixing

40+ Supported Languages

Integration Guide

Upload or Stream

Select Languages

Receive Dubbed Output

Use Cases

Global Content Distribution

Accessibility Compliance

Missions and Worship

E-Learning Platforms

Enterprise Communications

Broadcast and OTT

ONNX TTS Engine Integration

Default TTS Engine

Custom ONNX Models

Pricing

Start Dubbing Video in 40+ Languages Today

Related Resources

Auto Captions

Video Transcription API

Speaker Diarization API

Multi-Language Video
Dubbing API for Global Content