Search Results for "video frames" - Page 2
Sort By:
Showing 141 open source projects for "video frames"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
Sa2VA
Official Repo For "Sa2VA: Marrying SAM2 with LLaVA
Sa2VA is a cutting-edge open-source multi-modal large language model (MLLM) developed by ByteDance that unifies dense segmentation, visual understanding, and language-based reasoning across both images and videos. It merges the segmentation power of a state-of-the-art video segmentation model (based on SAM‑2) with the vision-language reasoning capabilities of a strong LLM backbone (derived from models like InternVL2.5 / Qwen-VL series), yielding a system that can answer questions about visual content, perform referring segmentation, and maintain temporal consistency across frames in video. With minimal instruction tuning (often one-shot), Sa2VA can handle tasks such as “segment the main subject,” “what are the objects in this scene?”... -
2
Computer Vision Annotation Tool (CVAT)
Interactive video and image annotation tool for computer vision
Computer Vision Annotation Tool (CVAT) is a free and open source, interactive online tool for annotating videos and images for Computer Vision algorithms. It offers many powerful features, including automatic annotation using deep learning models, interpolation of bounding boxes between key frames, LDAP and more. It is being used by its own professional data annotation team to annotate millions of objects with different properties. The UX and UI were also specially developed by the team for... -
3
h3-metal
MiniMax H3 inference engine for Mac computers
h3-metal is a native MiniMax-H3 inference engine for Apple Silicon focused on generating video and audio locally with Metal. It supports prompt-to-video and prompt-to-audio workflows as well as first-frame, last-frame, image, video, and audio references. An interactive terminal session keeps prompt conditioning, the diffusion transformer, and the video decoder in memory for faster repeated generations. Users can trade speed, quality, and memory through denoising steps, layer counts, reuse modes, token reduction, internal render size, and SSD streaming. ... -
4
SeedVR
Repo for SeedVR2 & SeedVR
SeedVR (from the ByteDance-Seed organization) is an open-source research and implementation repository focused on cutting-edge video restoration using diffusion transformer architectures. The project includes both the original SeedVR and its successor SeedVR2 models, which are designed to restore degraded or low-quality video content by learning to reconstruct high-fidelity frames with temporal coherence. These models leverage advanced techniques such as adaptive attention mechanisms and adversarial training to produce visually appealing results in a single inference step, pushing the boundaries of video restoration research. ... -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
5
HunyuanCustom
Multimodal-Driven Architecture for Customized Video Generation
HunyuanCustom is a multimodal video customization framework by Tencent Hunyuan, aimed at generating customized videos featuring particular subjects (people, characters) under flexible conditions, while maintaining subject/identity consistency. It supports conditioning via image, audio, video, and text, and can perform subject replacement in videos, generate avatars speaking given audio, or combine multiple subject images. The architecture builds on HunyuanVideo, with added modules for... -
6
Open Vision Agents by Stream
Build Vision Agents quickly with any model or video provider
Open Vision Agents by Stream is an open source framework from Stream for building real time, multimodal AI agents that watch, listen, and respond to live video streams. It focuses on combining video understanding models, such as YOLO and Roboflow based detectors, with real time large language models like OpenAI Realtime and Gemini Live to create interactive experiences. The framework uses Stream’s ultra low latency edge network so agents can join sessions quickly and maintain very low audio and video latency while processing frames and generating responses. ... -
7
VOID
Video Object and Interaction Deletion
...Built on top of transformer-based architectures and fine-tuned for video inpainting tasks, the system uses interaction-aware mask conditioning to ensure temporal consistency across frames. One of its most notable capabilities is its ability to simulate realistic scene behavior after object removal, such as causing an object to fall naturally if its support is removed, which significantly enhances realism. -
8
HunyuanWorld-Voyager
RGBD video generation model conditioned on camera input
HunyuanWorld-Voyager is a next-generation video diffusion framework developed by Tencent-Hunyuan for generating world-consistent 3D scene videos from a single input image. By leveraging user-defined camera paths, it enables immersive scene exploration and supports controllable video synthesis with high realism. The system jointly produces aligned RGB and depth video sequences, making it directly applicable to 3D reconstruction tasks. At its core, Voyager integrates a world-consistent video... -
9
Scrcpy GUI
A simple & beautiful GUI application for scrcpy
...Scrcpy works by running a server on your Android device, and the desktop application communicates using USB (or using ADB tunneling wireless). The server streams the H.264 video of the device screen. The client decodes the video frames and displays them. The client captures input (keyboard and mouse) events, sends them to the server, and the server injects them into the device. If you want to see your Android screen interact with the app or content on your desktop, record your phone screen or perform other basic tasks, then Scrcpy is a good choice. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
SwiftFFmpeg
A Swift wrapper for the FFmpeg API
SwiftFFmpeg is a Swift wrapper for FFmpeg that provides direct access to multimedia processing capabilities within Apple development environments. It exposes FFmpeg’s libraries through Swift-friendly APIs, enabling developers to perform encoding, decoding, and stream manipulation tasks. The project is designed to maintain performance while improving usability through modern language features. It supports working with media containers, codecs, and frames at a low level, offering fine control... -
11
Oasis
Inference script for Oasis 500M
Open-Oasis provides inference code and released weights for Oasis 500M, an interactive world model that generates gameplay frames conditioned on user keyboard input. Instead of rendering a pre-built game world, the system produces the next visual state via a diffusion-transformer approach, effectively “imagining” the world response to your actions in real time. The project focuses on enabling action-conditional frame generation so developers can experiment with interactive, model-generated environments rather than static video generation alone. ... -
12
Apprentice Video
it's a video player, also works for music and pictures
This player stands on the giant shoulders of FFmpeg. Audio rendering is accomplished via portaudio v19. Video rendering is via OpenGL, using fragment programs when possible. User interface is implemented with Qt 4/5/6. ASS/SSA subtitle rendering is implemented with libass. This player provides several performance options to enable adequate video playback on slow hardware: * skip loop filter * skip non-reference frames * skip color converter * reduce playback speed to accommodate slow video decoding This player supports playback of HDR video on non-HDR displays: * colorspace transform to BT.709 colorspace via an auto-generated 3D LUT * tone mapping from HDR to SDR (BT. 709) This player supports playback of MPEG-TS files containing multiple programs, timeline anomalies, and codec changes. ... -
13
scroll-world
A skill that turn any brand into a scrollable 3D world
...The workflow interviews the user about the brand, message, visual direction, and ordered sequence of scenes. It then uses Higgsfield to generate still images, scene-entry videos, and connector clips built from matching boundary frames. A portable JavaScript engine maps scrolling to video time, adds lazy loading, and blends seams between clips. Templates and batch scripts cover prompting, frame extraction, encoding, page setup, and optional background removal. The output is framework-agnostic and can be embedded in plain HTML, Next.js, Vue, or Python-served sites. -
14
Rsmpeg
A Rust crate that exposes FFmpeg's power as much as possible
Rsmpeg is a Rust-based binding for FFmpeg that provides low-level access to multimedia processing capabilities through safe and efficient abstractions. It allows developers to interact directly with FFmpeg libraries for tasks such as encoding, decoding, and stream manipulation. The library is designed to balance performance with safety by leveraging Rust’s ownership model and memory management features. It supports handling of containers, codecs, and frames, enabling fine-grained control... -
15
trackers
Multi-object tracking algorithms
trackers is a plug-and-play multi-object tracking library designed to work with virtually any object detection model, enabling developers to follow objects across video frames with minimal setup. The library provides clean, modular implementations of leading tracking algorithms and can be used either from the command line or embedded directly into Python pipelines. It supports inputs such as videos, webcams, RTSP streams, or image directories and produces annotated tracking outputs that include labels and trajectories. ... -
16
UCO3D
Uncommon Objects in 3D dataset
uCO3D is a large-scale 3D vision dataset and toolkit centered on turn-table videos of everyday objects drawn from the LVIS taxonomy. It provides about 170,000 full videos per object instance rather than still frames, along with per-video annotations including object masks, calibrated camera poses, and multiple flavors of point clouds. Each sequence also ships with a precomputed 3D Gaussian Splat reconstruction, enabling fast, differentiable rendering workflows and modern implicit/point-based modeling experiments. The repository includes automated downloaders with checksum verification, fine-grained controls to fetch only selected modalities or super-categories, and a lightweight Python API for loading frames, geometry, and splats on demand. ... -
17
Zoo Design Studio
The Zoo Design Studio app
...Users can interact with the system through a familiar point-and-click interface, but every action is translated into code in the underlying modeling language, ensuring consistency between visual and programmatic representations. The application is powered by a GPU-first geometry engine that streams rendered output as video frames, enabling high-performance modeling even when heavy computation is offloaded to remote infrastructure. It uses WebSockets for real-time communication between the client and the modeling engine, allowing immediate feedback and interactive design updates. -
18
Vidiot
Non-linear video editor targeted for home video editing.
Vidiot is a non-linear video editor targeted for home video editing. It supports compositing (scaling/rotating/positioning), cropping, changing speed, adding transitions and titles, trimming, key frames, etc. -
19
BoxMOT
Pluggable SOTA multi-object tracking modules for segmentation
BoxMOT is an open-source framework designed to provide modular implementations of state-of-the-art multi-object tracking algorithms for computer vision applications. The project focuses on the tracking-by-detection paradigm, where objects detected by vision models are continuously tracked across frames in a video sequence. It provides a pluggable architecture that allows developers to combine different object detectors with multiple tracking algorithms without modifying the core codebase. The framework supports integration with detection, segmentation, and pose estimation models that produce bounding box outputs. It also includes evaluation tools and benchmarking pipelines that allow researchers to test tracking performance on standard datasets such as MOT17 and MOT20. ... -
20
Fast3R
Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass
...It represents a next-generation feedforward 3D reconstruction model capable of producing dense point clouds and camera poses for hundreds to thousands of images or video frames in a single inference pass—eliminating the need for slow, iterative structure-from-motion pipelines. Built on PyTorch Lightning and extending concepts from DUSt3R and Spann3r, Fast3R unifies multi-view geometry, depth estimation, and camera registration within a single transformer-based architecture. It outputs high-quality 3D scene representations from unordered or sequential views, scaling to large datasets and varied camera intrinsics. ... -
21
Lyra 2
Project Lyra: Open Generative 3D World Models
The Lyra 2 project is a research-driven framework developed by NVIDIA that focuses on building open generative 3D world models using advanced diffusion-based techniques. It enables the creation of fully explorable 3D environments from minimal inputs such as a single image or video, leveraging self-distillation methods to generate consistent spatial representations. The system evolves across versions, with newer iterations introducing long-horizon generation and improved 3D consistency across frames. It combines elements of computer vision, generative modeling, and spatial intelligence to produce dynamic and navigable virtual worlds. ... -
22
gganimate
A Grammar of Animated Graphics
gganimate extends the grammar of graphics as implemented by ggplot2 to include the description of animation. It does this by providing a range of new grammar classes that can be added to the plot object in order to customize how it should change with time. Here we take a simple boxplot of fuel consumption as a function of cylinders and let it transition between the number of gears available in the cars. As this is a discrete split (gear being best described as an ordered factor) we use... -
23
HunyuanOCR
OCR expert VLM powered by Hunyuan's native multimodal architecture
HunyuanOCR is an open-source, end-to-end OCR (optical character recognition) Vision-Language Model (VLM) developed by Tencent‑Hunyuan. It’s designed to unify the entire OCR pipeline, detection, recognition, layout parsing, information extraction, translation, and even subtitle or structured output generation, into a single model inference instead of a cascade of separate tools. Despite being fairly lightweight (about 1 billion parameters), it delivers state-of-the-art performance across a... -
24
Video Object Remover – Frame-Accurate
🎥 A free & open-source Python tool to remove unwanted objects from videos frame-by-frame using brush masking and AI inpainting (OpenCV + FFmpeg). EXE included.
Video Object Remover – Frame Accurate Edition is a free and open-source desktop application that helps you remove unwanted objects, logos, or watermarks from videos using brush-based masking and AI inpainting. The tool extracts video frames using FFmpeg, lets you mask objects frame-by-frame, and removes them using OpenCV. Built with Python and Tkinter, it features a modern dark-themed GUI, adjustable brush tool, zoom control, and real-time logging. -
25
Virtualdub Batch Video DeShake v26.0204
Batch to compress [and deshake] all videos [or images] in folder
Installation: Execute "DeShakInst.BAT" VirtualDub2 44282; AviSynth+ 3.7.5 updated to C:\DVD DESHAK.BAT updated to C:\UT and added to PATH Usage: DESHAK task[s] [parameters] Tasks: tp1: deshake pass1 LOG generation for 2nd pass tp2: deshake pass2 and compress video and audio to MP3 tcomp: compress (no deshake) twav: extract WAV and/or uses external WAV audio Parameters (more in help): vEXT: video extension (ie: vmov), default: vAVI qN: h264...
