Meta just announced a new AI translation tool that will allow you to see Facebook and Instagram reels recorded in different languages, translated into yours.
On stage at Meta Connect 2024, Mark Zuckerberg unveiled a whole host of new Meta AI features, and one of the most interesting is ongoing work that could change the way we all consume portrait videos on social media.
Meta claims that the AI translation tool will automatically translate Reels audio, so you can enjoy content recorded in another language. The tool uses automatic dubbing and lip-syncing to “simulate the speaker’s voice in another language and sync their lips to match.”
The company is currently running small tests on its social media platforms, translating Reels from English and Spanish for creators in Latin America and the US. Meta plans to expand the service to more languages and creators in the future.
The language barrier? What barrier?
Meta focused a lot on AI at Meta Connect 2024, introducing a ton of new AI features on its social media platforms, but the new AI translation tool is one of the most exciting, and could completely change the way you We consume Instagram and Facebook Reels. By automatically translating content and making it look natural with voice-overs and lip-syncing, there could be a future where you have access to content from other countries in your Instagram algorithm that can be easily viewed without subtitles.
As Meta tries to emphasize Instagram’s prowess as a portrait video platform over rivals like TikTok, this new AI translation tool could prompt creators to opt for Meta’s platform due to its greater reach across multiple regions. and languages.
Meta also announced a new voice mode for Meta AI, which will roll out in the US, Canada, Australia and New Zealand over the next month, and later in the rest of the world.
