Meta will use AI to create lip-synced translations of creators’ Reels


Meta just announced an interesting tool that uses artificial intelligence to automatically dub Reels into other languages, complete with lip sync. This feature was revealed at the annual event and introduced by CEO Mark Zuckerberg.

Zuckerberg demonstrated the feature during the keynote, and everything worked flawlessly. According to Meta, the technology will not only translate the content, but will also “simulate the worshiper’s voice in another language and lip-sync to match.” However, it should be noted that this did not appear to be a live demo. Still pretty impressive.

As for the rollout, the company says the feature will first reach “videos from select creators” in English and Spanish in the US and Latin America. Meta did not provide a schedule here. It just said the US and Latin America will get it first, which means it will be limited to English and Spanish at launch. The company mentioned that more languages ​​are coming soon.

That was not all An AI tool that stands out during Meta Connect. The company’s AI platform will now enable voice chats and allow you to choose from celebrity voices. Meta AI also gets new imaging capabilities, as it will be able to modify and edit photos directly from text conversations within Instagram. Messenger and WhatsApp.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *