Artist Becomes Creative With Omniverse, Uses AI To Make Videos With Singing Digital Humans
Brazil-based 3D generalist and freelance video editor, Anderson Rohr, has created a lip-synced cover of ‘Bad Moon Rising,’ the 1960s anthem from Creedence Clearwater Revival. He created this using NVIDIA Omniverse and its AI-powered Audio2Face application. To make the video, Rohr used the NVIDIA Studio system with GeForce RTX 3090 GPU. For this project, Rohr recorded himself singing and then opened the file in Audio2Face. The application on Omniverse uses instantly generated expressive facial animations for the digital human with only an audio source or a voice-over track. He then manually animated the brows, eyes, and neck of the character and changed the lighting for the scene. For Rohr, the NVIDIA Omniverse speeds up the workflow and helps achieve more natural digital humans. With the work done fast and so many new horizons, artists can spend more time on the creative process. Without the Omniverse, animations can take as long as 300 hours to render. Rohr also faced software incompatibilities that slowed his work. With Omniverse and its connectors for software applications, renderings are achieved in real-time. Artists can supercharge their creations with Omniverse, NVIDIA Studio – its optimized RTX-accelerated hardware and software drivers, and AI and simulation features.
Brazilian artist creates ‘Bad Moon Rising’ using NVIDIA Omniverse and its AI-powered Audio2Face application
Brazilian artist creates ‘Bad Moon Rising’ using NVIDIA Omniverse and its AI-powered Audio2Face application
["Omniverse"]
["programming_languages:R", "AI", "Git", "Omniverse", "R"]
["AI", "R", "Git", "programming_languages:R"]
Meeta’s interest lies in finding out real practical applications of technology. At AIM, she writes stories that question the new inventions and the need to develop them. She believes that technology has and will continue to change the world very fast and that it is no more ‘cool’ to be ‘old-school’. If people don’t update themselves with the technology, they will surely be left behind.