YouTube has widened access to its AI-driven auto-dubbing tool, allowing more creators to translate their videos into multiple languages. Initially introduced at VidCon 2023 in a limited trial, the feature is now available to hundreds of thousands of knowledge-focused channels, such as tutorials and how-to videos, but YouTube plans to expand the tool’s availability to other types of channels soon.
Which languages are supported in YouTube AI automatic dubbing?
The tool, designed to break language barriers, creates alternative audio tracks in nine languages: English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish. Creators don’t need to modify their upload process. If the video is in any of those other languages, it will be dubbed into English. The system detects the original language and automatically generates dubbed tracks, which can be reviewed or removed via YouTube Studio’s Languages section.
Viewers, meanwhile, can access these tracks by adjusting the “audio track” option in the video settings.
The auto-dubbing tool is powered by Google’s Gemini AI, designed to simulate natural speech. While functional, the technology isn’t flawless. YouTube acknowledged in a blog post that translations might occasionally miss the mark or fail to fully replicate the original speaker’s tone.
“It's important to remember that this technology is still pretty new, and it won't always be perfect. We're working hard to make it as accurate as possible, but there might be times when the translation isn't quite right or the dubbed voice doesn’t accurately represent the original speaker,” the company noted. “Your feedback will be invaluable as we refine the experience.”
Future updates include an “Expressive Speech” feature, which aims to better capture the nuances of the speaker’s emotions, tone, and even environmental ambiance.
For now, access to auto-dubbing is limited to creators in the YouTube Partner Program producing knowledge-centric content.
How YouTube AI auto-dubbing works
- Creators can upload their videos as usual. YouTube automatically detects the original language and generates dubbed versions in supported languages.
- The dubbed tracks appear in the “Languages” section of YouTube Studio, where creators can listen to and manage them. Unwanted dubs can be unpublished or deleted.
- Channels with access to the tool will find it under “Advanced Settings” in YouTube Studio.
Dubbed videos are marked with an “auto-dubbed” label, and viewers can select their preferred audio track via the settings menu. The platform also remembers a viewer’s language choice for future videos. For creators, this development means a broader audience. For viewers, it offers access to diverse content from around the globe, making YouTube a more accessible platform than ever before.
