Search Results for "gesture recognition accelerometer"

Seamless Communication is a research project focused on building more integrated, low-latency multimodal communication between humans and AI agents. The motivation is to move beyond “text in, text out” and enable direct, live, multi-turn exchange involving language, gesture, gaze, vision, and modality switching without user friction. The system architecture includes a real-time multimodal signal pipeline for audio, video, and sensor data, a dialog manager that can decide when to act (speak, gesture, point) or query, and a cross-modal reasoning layer that fuses perception with semantic context. The research prototype includes components for visual grounding (understanding when a user references something in view), gesture recognition and synthesis, and turn-taking mechanisms that mirror human conversational timing. ...

OpenCV (Open Source Computer Vision Library) is a comprehensive open-source library for computer vision, machine learning, and image processing. It enables developers to build real-time vision applications ranging from facial recognition to object tracking. OpenCV supports a wide range of programming languages including C++, Python, and Java, and is optimized for both CPU and GPU operations.

...The project combines Jupyter or Colab notebooks with browser-based visual demos that allow users to see trained models operating in real time. Many experiments involve tasks such as image classification, object detection, gesture recognition, and simple generative models. The models are typically trained in Python using TensorFlow and then exported for interactive demonstrations in a web environment using JavaScript and TensorFlow.js. Because the project focuses on experimentation rather than production systems, it acts as a sandbox where developers can explore machine learning concepts and observe model behavior. ...

...These pipelines can run on a wide variety of platforms including mobile devices, desktop systems, web browsers, and embedded edge devices. MediaPipe is widely used in computer vision and multimedia applications such as hand tracking, face detection, pose estimation, object recognition, and gesture analysis. The framework includes prebuilt solutions that developers can quickly integrate into applications as well as lower-level APIs that allow custom pipeline construction.

LSTM-Human-Activity-Recognition is a machine learning project that demonstrates how recurrent neural networks can be used to recognize human activities from sensor data. The repository implements a deep learning model based on Long Short-Term Memory (LSTM) networks to classify physical activities using time-series data collected from wearable sensors. The project uses the well-known Human Activity Recognition dataset derived from smartphone accelerometer and gyroscope signals. ...

Yoha is a browser-based hand tracking engine designed to enable real-time gesture recognition and interaction using standard webcams, making it accessible for web applications without specialized hardware. Built using JavaScript and TensorFlow.js, it runs directly in the browser and performs inference on-device, eliminating the need for server-side processing. The engine is capable of detecting 21 two-dimensional hand landmarks, allowing developers to build applications that respond to gestures such as pinching or forming a fist. ...

...This implementation is a prototype developed for scientific purposes. More technical details on PolyRec can be found in the following scientific paper: V Fuccella, G. Costagliola; Unistroke Gesture Recognition Through Polyline Approximation and Alignment; in Proceedings of CHI 2015; pp. 3351-3354 http://dl.acm.org/citation.cfm?id=2702

Inspired by interfaces from sci-fi movies like Iron Man, Gesture Analytical Sonic Interface (GASI) is a proof of concept of a Webcam gesture (Kinect like) and Voice recognition based computer interface, constraining itself to only components included in average laptops (A simple webcam and microphone, no Kinect)

This project provides a gesture based movement of part objects in the CAD-system CATIA. It is possible to rotate, move or zoom in or out. Further there is a rudimentary speech recognition to change the rotating axes or to do some other helpful things. KinectCAD has been written in Visual C# 2010. The package includes the source code and binaries files. To start KinectCAD it is necessary to have a correct installed Microsoft Kinect.

A photo gallery management system based on hand gesture recognition. You must make three color markers by yourself, which the red one on index of the right hand, the green one on thumb of the right hand and the blue one on index of the left hand.

Real-time Head Pose Estimation and Tracking, Eye Gaze Estimation and Gesture Recognition from USB or stereo camera

This project is to share my work in visual recognition of gestures. It shows how I have implemented person detection, color adaptation and tracking of the user's right-hand, gesture feature extraction, etc. using a single videocamera.

A compact gesture recognition program (currently for Windows), used with mouse or pen (on graphic tablets). Longer term aim is to create a gesture recognition library that can be easily used in other programs.Please read the forum for more information