Indian-Origin Researcher&#8217;s AI Breakthrough Simplifies Video Translation Across Languages
Indian-origin researcher Prady Modukuru has made a remarkable tool that effortlessly translates any video into the language of your choice. All you need is a YouTube link! Modukuru posted a video on Twitter translating a conversation between Meta CEO Zuckerberg and Lex Fridman into Hindi. Here is a glimpse of the sorcery that’s unfolding. I built the simplest way to convert your video to other languages.all you need is a youtube link. no install required.curious? check out @lexfridman + zuck talking about @elonmusk in hindi. pic.twitter.com/nZBi4ZtRde— Prady (@therealprady) July 16, 2023 A serial entrepreneur, Modukuru is currently working on a stealth startup. Some of his previous ventures include marketing startup SŪNYA and mental wellness startup Oneself (inactive). He has previously worked with companies like Microsoft, Cisco, and Qknow among others. How it works? Modukuru leveraged the power of GPT-4 and prompt engineering techniques for seamless translation. To ensure accurate voice representation in different languages while preserving the original speaker’s voice, he collaborated with ElevenLabs for voice training and text-to-speech capabilities. In order to achieve precise lip syncing, Modukuru utilised wav2lip-2, which harnesses AI for generating lifelike lip movements. This breakthrough in the AI industry opens up new possibilities, allowing users to easily comprehend informative content in their preferred language. In the near future, this technology can revolutionise dubbing, and can be used by major OTT platforms to translate content including series and movies to any other language.
Modukuru posted a video on Twitter translating a conversation between Meta CEO Zuckerberg and Lex Fridman to Hindi
Indian origin researcher Prady Modukuru has made a remarkable tool that effortlessly translates any video into the language of your choice
[]
["programming_languages:R", "AI", "ML", "RAG", "GPT", "prompt engineering", "llm_models:GPT", "R", "startup"]
["AI", "ML", "RAG", "prompt engineering", "R", "GPT", "startup", "llm_models:GPT", "programming_languages:R"]
Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.