LiveAvatar

SentiMask is a software development kit for creating applications that use real-time 3D face tracking and facial expression analysis. It enables motion capture and digital character control for augmented reality, gaming and interactive environments. Using only a regular webcam or smartphone camera, SentiMask captures facial pose, landmarks, shape and expressions with high accuracy, generating a 3D facial mesh for animation or customization. The technology also estimates gender and age, detects features such as glasses, facial hair, or hats and performs 23 expression estimations including eye and mouth movement. Compatible with Windows, macOS, Linux, Android and iOS, SentiMask integrates easily with 3D modelling software and game engines, supporting virtual makeup, live avatars and character animation. It offers flexible licensing, free support, and delivers high-performance tracking without the need for advanced hardware.

SenseMARS software platform serves as the key enabling technology platform for the Metaverse to create new life experiences. SenseMARS is equipped with core functionalities, including perception intelligence, decision intelligence, AI-enabled content generation including AR and MR and software agents, and other infrastructure including cloud engine, providing support for Metaverse applications. SenseMARS Reconstruction enables users to efficiently reconstruct high-precision 3D models of the physical world using consumer devices such as mobile phones, sport cameras and drones. It also enables spatial mapping and localization with accuracy to the centimeter-level, allowing visual content to be superimposed into the physical world through AR glasses, mobile phones and smart TVs. An Avatar represents the digital identity of an individual in the Metaverse. Facilitated by SenseMARS Avatar, lively personalized avatar figures with different styles can be automatically generated from photos.