Open Source C++ Realtime Processing Software

The Open Source Computer Vision Library has >2500 algorithms, extensive documentation and sample code for real-time computer vision. It works on Windows, Linux, Mac OS X, Android, iOS in your browser through JavaScript. Languages: C++, Python, Julia, Javascript Homepage: https://opencv.org Q&A forum: https://forum.opencv.org/ Documentation: https://docs.opencv.org Source code: https://github.com/opencv Please pay special attention to our tutorials! https://docs.opencv.org/master Books about the OpenCV are described here: https://opencv.org/books.html

A comprehensive software suite for reading barcodes. Supports EAN/UPC, Code 128, Code 39, Interleaved 2 of 5 and QR Code. Includes libraries and applications for decoding captured barcode images and using a video device (eg, webcam) as a barcode scanner.

Serial Studio is a simple, multi-platform, and multi-purpose serial data visualization program that allows embedded developers to visualize, analyze, and present data generated from their projects and devices while avoiding the need to write project-specific visualization software. Over my many CanSat-based competitions, I found myself writing and maintaining several Ground Station software for each program. However, I decided that it would be easier and more sustainable to define one flexible Ground Station Software that lets developers define how each CanSat presents data using an extensible communication protocol for easy data visualization. Developers can also use Serial Studio for almost any data acquisition and visualization project outside of CanSat, now supporting data retrieval from hardware serial ports, software serial ports, MQTT, and network sockets (TCP/UDP). You can download and install Serial Studio for your preferred platform.

GLMixer performs real time graphical blending of several movie clips and of computer generated graphics. Drop video files in the mixing workspace and place them in a circular area to change their opacity ; if you selects two videos, moving them together performs a fading transition. This principle generalizes to a large number of videos. Direct interaction with the video allows to be fast and reactive, and to move and deform them on screen. The output of your operations is shown in the output window, typically displayed in full-screen on an external monitor or a projector. But the output can also be saved as a video file. Control GLMixer through network using OpenSoundControl, and generate graphics with ShaderToy GLSL code. Download : https://sourceforge.net/projects/glmixer/files/ Please note GLMixer is discontinued and superseded by vimix https://brunoherbelin.github.io/vimix/

reacTIVision is a computer vision framework for the fast and robust tracking of markers attached on physical objects, and the creation of multi-touch surfaces. It was designed for the rapid development of table-based tangible user interfaces.

MeshLab is an open-source, portable, and extensible system for the processing and editing of unstructured large 3D triangular meshes. It is aimed to help the processing of the typical not-so-small unstructured models arising in 3D scanning, providing a set of tools for editing, cleaning, healing, inspecting, rendering and converting this kind of meshes. MeshLab is mostly based on the open source C++ mesh processing library VCGlib developed at the Visual Computing Lab of ISTI - CNR. VCG can be used as a stand-alone large-scale automated mesh processing pipeline, while MeshLab makes it easy to experiment with its algorithms interactively. The open source system for processing and editing 3D triangular meshes. It provides a set of tools for editing, cleaning, healing, inspecting, rendering, texturing and converting meshes. It offers features for processing raw data produced by 3D digitization tools/devices and for preparing models for 3D printing.

New version 0.5.1.1 Released July 2020. Snowmix is a Swiss army knife tool for mixing live and recorded video and audio feeds. It supports 2D and 3D clipping, scaling and transparent overlay of video, png graphics and text. It supports animation of video, images and texts through native commands changing scale, placement, transparency and rotation. Animation and actions can also be controlled through native scripting and an embedded Tcl interpreter. Snowmix is designed for control over low bandwidth links and can work as a standalone CLI based program. Control over both CLI and a TCP connections. Input and outputs can be done through GStreamer pipelines or the GStreamer shmsrc/shmsink API. Supported for Ubuntu, Mint, Debian, CentOS, Fedora, Chakra, Mageia, Manjaro,, OpenSUSE and macOS/OS X is supported. Free support in the discussion forum. See Snowmix in action on Youtube http://www.youtube.com/user/Snowmix4video

Mouse replacement software that moves the pointer as you move your head. It works on standard PCs equipped with a web camera. No additional hardware is required. Based on the award winning Facial Mouse software. For Linux and Windows systems.

The Simd Library is a free open source image processing library, designed for C and C++ programmers. It provides many useful high performance algorithms for image processing such as: pixel format conversion, image scaling and filtration, extraction of statistic information from images, motion detection, object detection (HAAR and LBP classifier cascades) and classification, neural network. The algorithms are optimized with using of different SIMD CPU extensions. In particular the library supports following CPU extensions: SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2 and AVX-512 for x86/x64, VMX(Altivec) and VSX(Power7) for PowerPC, NEON for ARM. The Simd Library has C API and also contains useful C++ classes and functions to facilitate access to C API. The library supports dynamic and static linking, 32-bit and 64-bit Windows, Android and Linux, MSVS, G++ and Clang compilers, MSVS project and CMake build systems.

PyMesh is a codebase developed by Qingnan Zhou for his PhD research at New York University. It is a rapid prototyping platform focused on geometry processing. PyMesh is written with both C++ and Python, where computational intensive functionalities are realized in C++, and Python is used for creating minimalistic and easy-to-use interfaces. PyMesh is a rapid prototyping platform focused on geometry processing. It provides a set of common mesh processing functionalities and interfaces with a number of state-of-the-art open-source packages to combine their power seamlessly under a single developing environment. Mesh process should be simple in python. PyMesh promotes human-readable, minimalistic interface and works with native python data structures such as numpy.ndarray.

The Integrating Vision Toolkit (IVT) is a powerful and fast C++ computer vision library with an easy-to-use object-oriented architecture. It offers its own multi-platform GUI toolkit. OpenCV is integrated optionally. Website: http://ivt.sourceforge.net

Video processing source code for algorithms and tools used in software media pipelines. The currently available source code is written in C++ with their associated libraries and DirectShow Filters. Filters include an H.264 encoder, H.264 decoder, H.264 source filter, RTSP sink and source filters, YUV source, RGB to YUV color conversion, croppers, scalers, video mixing/picture in picture filters, rotate filter, virtual mic, and many more. Code is released under BSD license with exception of H.264 codec related classes which are released under LGPL.

Scene is a computer vision framework that performs background subtraction and object tracking, using two traditional algorithms and three more recent algorithms based on neural networks and fuzzy classification rules. For each detected object, Scene sends TUIO messages to one or several client applications. The present release features GPU accelerated versions of all the background subtraction methods and morphological post processing of the object blobs with dilation and erosion filters, implemented in OpenCL. The framework was mainly designed as a toolkit for the rapid development of interactive art projects that explore dynamics of complex environments. The Scene GUI runs and compiles under Windows, Linux, and MacOS X, and is available in both 32 bit and 64 bit versions.

Video surveillance for Windows platform (for now) with nice GUI. It supports multiple camera and video file inputs. Detects motion in input video using fast algorithms. Alarm notification is provided by e-mail, alarm sound and video recording.

Soul Fresh FreeFrame Plugins for FreeFrame compatible hosts. For more information about Soul Fresh, see http://www.soul-fresh.com.

KinectA is an application for motion tracking via Kinect Sensor – including hand, skeleton and object tracking. This software has been developed for the needs of media artists and designers. It provides a clearly arranged interface with multiple functionalities. The tracked information can be send via OSC to other hard- and software. KinectA is available for Mac and Windows.

Veejay is a visual instrument and real-time video sampler. It allows you to "play" the video like you would play a piano. While playing, you can record the resulting video directly to disk (video sampling).

Track, in realtime, horizontal and vertical displacement of object in webcam. Log timestamp, x and y to comma-separated value (.csv) file importable to spreadsheet. Uses Lukas-Kanade algorithm and based on lkdemo.cpp in OpenCV, stripped down to track single point in high contrast against a uniform background. Based on the BSD licensed OpenCV, TrackXY also has BSD-style license. I am a bit embarrassed to be posting this here, because it's such a rudimentary program, but I couldn't find any other ready-made program that would track an object in real-time from webcam, other than an $80 special-purpose program used in the original (torsion balance) experiment we were replicating. I released TrackXY to reduce barriers to entry to science. Planned features include versions for each platform, a GUI, comprehensive data management, and data analysis tools. To analyze motion in /recorded/ video (not real-time), you may prefer something like PhysMo, also a SourceForge project.

This is an open-source real-time object detection and tracking software for H.264/AVC videos. It applies probabilistic spatiotemporal macroblock filtering (PSMF) and partial decoding processes to effectively detect and track multiple objects with fast computation in H.264|AVC bitstreams with stationary background. The codes were written in Visual C++. For more details, please visit https://www.wonsangyou.com/research/aivision. If you need technical help, please send an email to wyou(at)kaist.ac.kr. When you use this software for your publications, please cite as follows. 1. Wonsang You, M.S. Houari Sabirin, and Munchurl Kim, "Moving object tracking in H.264/AVC bitstream," Lecture Notes in Computer Science, vol. 4577, 2007, pp. 483-492. 2. Wonsang You, M.S. Houari Sabirin, and Munchurl Kim, "Real-time detection and tracking of multiple objects with partial decoding in H.264/AVC bitstream domain," Proceedings of SPIE, vol. 7244, 72440D (February 2009).

An open file format specification for 3D lookup tables

ANNGD is a artificial neural network gender detection application. The detection is made in real time images captured by webcam by opencv library. The package include applications to image pre-processing and artificial neural network back-propagation training.

Video player who display anagplyph video from side by side stereoscopic video.

Fully automated segmentation of moving objects from a stationary scene using pre-stored scene images. Needs no external parameters or settings; all parameters are derived internally from the pre-stored images. Implemented using OpenCV framework.

Bogart is a high-level library/optimizing compiler for graphics. It aims to provide high-level abstractions/optimizations, with support for graphics hardware (procedural shaders). LLVM/CUDA/OpenGL are on the roadmap.

Face-following and facial expression detection based on OpenCV.