Microsoft Unveils VASA-1, Creating DeepFake Videos with a Single Image
Just around the time of elections, Microsoft researchers have developed a powerful new AI system called VASA-1 that can generate stunningly realistic videos of talking faces from just a single image and an audio clip. The VASA-1 system goes far beyond simple lip-syncing by capturing a wide range of facial expressions, emotions, head movements and even allowing control over aspects like gaze direction and perceived distance. Microsoft just dropped VASA-1.This AI can make single image sing and talk from audio reference expressively. Similar to EMO from Alibaba10 wild examples:1. Mona Lisa rapping Paparazzi pic.twitter.com/LSGF3mMVnD— Min Choi (@minchoi) April 18, 2024 As the video not only captures exquisitely synchronised lip movements with the audio but also encompasses a wide spectrum of facial nuances and natural head motions, contributing to the perception of authenticity and liveliness. VASA-1 achieves its realism by using AI to disentangle different facial components like expressions, 3D head position, and lip movements. This allows independent control and editing of each aspect. The blog explains how the approach not only ensures superior video quality featuring authentic facial and head movements, but also enables the seamless online creation of 512×512 videos at speeds of up to 40 FPS, all with minimal initial latency. This breakthrough sets the stage for interactive experiences with lifelike avatars, mimicking natural human conversational nuances in real-time engagements. Min Choi, says VASA-1 has the remarkable ability to animate a single image with expressive speech, akin to Alibaba’s EMO technology. EMO boasts an AI framework capable of crafting remarkably lifelike ‘talking head’ videos using just one image and an audio input. On the other hand, people are concerned with the possible misuse of this deepfake technology as it is launched just at the time of elections. https://twitter.com/rowancheung/status/1780776053474033673 Acknowledging the potential for misuse, the researchers underscore the positive applications of VASA-1, which encompass enhancing educational experiences, aiding individuals with communication difficulties, and offering companionship or therapeutic support.
Microsoft’s revelation of VASA-1 sparks a frenzy just as the election fever reaches its peak.
Microsoft's revelation of VASA-1 sparks a frenzy just as the election fever reaches its peak.
["AI Video Generation Models", "Microsoft"]
["Go", "programming_languages:R", "AI", "ML", "programming_languages:Go", "AI Video Generation Models", "CLIP", "R", "Microsoft"]
["AI", "ML", "R", "Go", "CLIP", "programming_languages:R", "programming_languages:Go"]
With a Master's degree in Journalism &amp; Mass Communication, Gopika Raj infuses her technical writing with a distinctive flair. Intrigued by advancements in AI technology and its future prospects, her writing offers a fresh perspective in the tech domain, captivating readers along the way.