Jump to content

YouTube's controversial auto-dubbing feature will use AI for lip syncing


Karlston

Recommended Posts

One of the most annoying features that Google rolled out in recent time on YouTube is auto-dubbing and auto-translations of content. A video that is uploaded in English by its producer may be translated automatically by YouTube so that its title and its audio are provided in a different language.

 

Google says that this is extending the reach of the video, which means more clicks and eyes on ads. Critics argue that they want to view the original video, not an AI generated version that offers subpar quality more often than not. Especially multi-lingua users are annoyed by the feature, as YouTube does not provide options to block the feature for languages. Extensions like YouTube Anti-Translate deal with that.

 

Google announced an addition to the feature today on its Made on YouTube event. Called auto-dubbing with lip sync, it aims to make auto translated videos more believable by matching the translation to the lip movement of the speaker.

 

Currently, YouTube's auto-translate and auto-dub feature does not take this into account. Means, the movement of the lips of a speaker do not match the spoken works and sounds that come out of the mouth.

 

The feature is rolling out in the coming months. It supports 20 different languages, including English, German, French, and Spanish initially, with more languages coming in the future.

 

Google writes: "We're making auto dubbing more realistic than ever. With upcoming lip sync technology, translated videos will now visually match the speaker's lips with the newly dubbed language, making your content more accessible and engaging for global audiences. We support dubbing across 20 different languages, and we’ll begin testing this new lip sync feature in the coming months."

 

A short video demonstrates the new functionality on YouTube:

 

Closing Words

Automatically dubbed videos will look more realistically once the feature becomes available. It seems that creators may need to enable the feature for now for their videos. Google could use it automatically in the future to make its auto-translated videos more attractive and less disliked.

 

Now You: What is your take on auto-translated and auto-dubbed videos? Good move to expand the reach of videos, or annoying?

 

 

Source


Hope you enjoyed this news post. Feedback welcome.

Posted Thursday 18 September 2025 at 5:11 pm AEST (my time).

News posts... 2023: 5,800+ | 2024: 5,700+ | 2025 (till end of August): 4,048

RIP Matrix

Link to comment
Share on other sites


Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...