Omniverse Audio2Face
Omniverse™ Audio2Face beta is a reference application that simplifies animation of a 3D character to match any voice-over track, whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out, it’s up to you. Audio2Face lets you retarget to any 3D human or human-esque face, whether realistic or stylized. This makes swapping characters on the fly—whether human or animal—take just a few clicks. The latest update to Omniverse Audio2Face now enables blendshape conversion and also blendweight export options. Plus, the app now supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to generate motion for characters using their respective Omniverse Connectors.
Learn more
NVIDIA Omniverse ACE
NVIDIA Omniverse™ Avatar Cloud Engine (ACE) is a suite of real-time AI solutions for end-to-end development and deployment of interactive avatars and digital human applications at-scale.
Enjoy realistic, advanced avatar development without the need for specialized expertise, equipment, or manually intensive workflows. With cloud-native AI microservices and AI workflows like Tokkio, Omniverse ACE enables you to build realistic avatars quickly.
Bring your avatars to life using rich software tools and APIs, including Omniverse Audio2Face for simplified 3D character animation, Live Portrait for 2D image animation, Conversational AI solutions like NVIDIA Riva for natural speech- and translation-AI-based interaction, and NVIDIA NeMo for natural language processing.
Build, configure, and deploy your avatar application across any engine in any public or private cloud. Whether you have real-time or offline requirements, Omniverse ACE enables you to develop and deploy your avatar.
Learn more
Character Creator
Character Creator (CC) is a full character creation solution for designers to easily generate, import and customize stylized or realistic character assets for use with iClone, Maya, Blender, Unreal Engine, Unity, or any other 3D tools. CC connects industry-leading pipelines with one system for 3D character generation, animation rigging, asset management, look-dev rendering, and interactive design.
Whether humans, creatures or props, creativity is no longer limited by the existing CC character base. Any rigged biped models can be imported, characterized, and facial rigged in Character Creator. New features now make any character compatible with thousands of motion assets, ready for natural lip-sync, motion capture, and animation controls in iClone. CC characters can also be optimized for low-poly, high-performance crowd simulation, AR, VR, and Metaverse.
Learn more
Blender
Blender is the free and open source 3D creation suite. It supports the entirety of the 3D pipeline—modeling, rigging, animation, simulation, rendering, compositing and motion tracking, video editing and 2D animation pipeline. Cycles is Blender’s built-in powerful unbiased path-tracer engine that offers stunning ultra-realistic rendering. Blender’s comprehensive array of modeling tools make creating, transforming and editing your models a breeze. VFX professionals say: “Probably the best tracker in the market”. Blender includes production ready camera and object tracking. Allowing you to import raw footage, track the footage, mask areas and see the camera movements live in your 3D scene. Eliminating the need to switch between programs. Thanks to the high quality rigging and animation tools, Blender is being used for numerous short films, advertisements, TV series and feature films now.
Learn more