In a bid to facilitate the dubbing of videos into multiple languages, YouTube has unveiled a cutting-edge tool that leverages artificial intelligence (AI). The platform announced its collaboration with Aloud, an AI-powered dubbing service developed within Google’s Area 120 incubator, at the highly anticipated VidCon event held on Thursday.

Aloud’s website offers a comprehensive overview of the tool’s functionalities. The first step involves transcribing the original video, providing creators with a transcription that can be reviewed and edited. Next, the tool seamlessly translates and produces the dubbed video, streamlining the process of localizing content for a global audience.

According to YouTube’s Amjad Hanif, the platform is already conducting extensive tests with “hundreds” of creators to ensure the tool’s effectiveness. At present, Aloud supports several languages, including English, Spanish, and Portuguese, with plans for further language expansions in the pipeline.

With an increasing number of content creators embracing the concept of multilingual video production, Aloud’s capabilities hold tremendous potential. Even though the tool currently has a limited language selection, it is already proving to be invaluable in helping creators cater to a wider audience. To provide users with a real-world example of Aloud’s capabilities, YouTube encourages viewers to experience the Spanish dub track in a video from the Amoeba Sisters channel. By simply clicking on the gear icon and selecting “Audio track,” users can witness the remarkable results firsthand.

YouTube has ambitious plans for the continued development of this dubbing tool. Hanif revealed that the platform is actively working to make translated audio tracks sound more natural, closely resembling the voice of the original creator. This includes incorporating enhanced expressions and lip sync features, which are slated for release in 2024, as confirmed by YouTube spokesperson Jessica Gibby.