Search Results for "frame generation"
Sort By:
Showing 61 open source projects for "frame generation"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
1
MiniMax H3
MiniMax H3 is a general-purpose, omni-modal generative system
MiniMax H3 is an omni-modal generative system for creating synchronized video and native stereo audio from complex multimodal instructions. It can understand combinations of text, images, video, and audio as generation context. Outputs range from four to fifteen seconds at 24 frames per second, with multiple aspect ratios and resolutions up to 2K. H3-Base supports text-to-video, first-frame, last-frame, and first-and-last-frame generation. Ref2VA accepts multiple reference images, videos, and audio clips for more controlled results. Its architecture uses a unified multimodal sequence and a 33-billion-parameter H3-Omni-Transformer that jointly predicts video and audio latents. ... -
2
lsfg-vk
Lossless Scaling Frame Generation on Linux
The lsfg-vk project is a Vulkan layer developed primarily by PancakeTAS that hooks into Vulkan-based applications to enhance rendering by generating additional frames using the Lossless Scaling frame generation algorithm originally associated with the Lossless Scaling project. Instead of relying on driver-specific or hardware-accelerated upscaling, this layer intercepts Vulkan API calls and injects frame interpolation on the fly, effectively producing smoother motion in supported games and applications by creating synthetic intermediate frames. ... -
3
Pixelle-Video
AI Fully Automated Short Video Engine
...It focuses on enabling automated video creation workflows where visual content can be synthesized, edited, or enhanced through AI models. The project integrates different components of video processing, such as frame generation, transformation, and sequencing, into a unified pipeline. It is built to support experimentation with generative video models, making it useful for research and creative applications. The system emphasizes modularity, allowing developers to plug in different models or processing steps depending on the use case. It can be used for tasks such as content generation, video editing, or visual storytelling. ... -
4
OptiScaler
OptiScaler bridges upscaling/frame gen across GPUs
...The tool effectively acts as a compatibility layer between the game engine and multiple upscaling frameworks, enabling cross-GPU access to features that might otherwise be restricted to specific hardware ecosystems. In addition to replacing upscalers, OptiScaler can enable frame generation features in titles that do not officially support them, improving frame rates and perceived smoothness during gameplay. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Oasis
Inference script for Oasis 500M
...Instead of rendering a pre-built game world, the system produces the next visual state via a diffusion-transformer approach, effectively “imagining” the world response to your actions in real time. The project focuses on enabling action-conditional frame generation so developers can experiment with interactive, model-generated environments rather than static video generation alone. Because it’s an inference-focused repository, it’s especially useful as a practical reference for running the model, wiring inputs, and producing the autoregressive sequence of gameplay frames. It also serves as a research sandbox for people exploring how far interactive generative models can go with smaller, more accessible checkpoints compared to massive internal systems. -
6
h3-metal
MiniMax H3 inference engine for Mac computers
h3-metal is a native MiniMax-H3 inference engine for Apple Silicon focused on generating video and audio locally with Metal. It supports prompt-to-video and prompt-to-audio workflows as well as first-frame, last-frame, image, video, and audio references. An interactive terminal session keeps prompt conditioning, the diffusion transformer, and the video decoder in memory for faster repeated generations. Users can trade speed, quality, and memory through denoising steps, layer counts, reuse modes, token reduction, internal render size, and SSD streaming. ... -
7
LTX-2.3
Official Python inference and LoRA trainer package
LTX-2.3 is an open-source multimodal artificial intelligence foundation model developed by Lightricks for generating synchronized video and audio from prompts or other inputs. Unlike most earlier video generation systems that only produced silent clips, LTX-2 combines video and audio generation in a unified architecture capable of producing coherent audiovisual scenes. The model uses a diffusion-transformer-based architecture designed to generate high-fidelity visual frames while... -
8
Agent Sprite Forge
Agent Skill for generating 2D sprite sheets and map, transparent PNG
...The system supports multi-frame sprite generation, animation sequencing, and transparent background rendering for easier integration into game engines. Its architecture is designed around automation and repeatability, enabling developers to generate large batches of visual assets through structured prompt workflows. Overall, agent-sprite-forge acts as an AI-assisted creative tool for accelerating 2D game art production and experimentation. -
9
ComfyUI-WanVideoWrapper
ComfyUI wrapper nodes for WanVideo and related models
...The project supports complex node-based pipelines where users can control sampling, conditioning, and frame continuity across generated sequences. It also enables extended video generation by linking outputs between iterations, allowing for longer and more coherent animations. Additionally, the wrapper often includes optimizations for performance, such as low VRAM configurations and multi-stage sampling strategies. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
HunyuanVideo-I2V
A Customizable Image-to-Video Model based on HunyuanVideo
HunyuanVideo-I2V is a customizable image-to-video generation framework from Tencent Hunyuan, built on their HunyuanVideo foundation. It extends video generation so that given a static reference image plus an optional prompt, it generates a video sequence that preserves the reference image’s identity (especially in the first frame) and allows stylized effects via LoRA adapters. The repository includes pretrained weights, inference and sampling scripts, training code for LoRA effects, and support for parallel inference via xDiT. ... -
11
HunyuanVideo-Foley
Multimodal Diffusion with Representation Alignment
...Hybrid architecture combining multimodal transformer blocks and unimodal refinement blocks. Temporal alignment via frame-level synchronization modules (e.g. Synchformer). -
12
Kotlin Dataframe
Structured data processing in Kotlin
Data frame is an abstraction for working with structured data. Essentially it’s a 2-dimensional table with labeled columns of potentially different types. You can think of it like a spreadsheet or SQL table, or a dictionary of series objects. The handiness of this abstraction is not in the table itself but in a set of operations defined on it. The Kotlin Dataframe library is an idiomatic Kotlin DSL defining such operations. The process of working with data frame is often called data... -
13
HyperFrames
Write HTML. Render video. Built for agents
HyperFrames is a framework developed by HeyGen that focuses on generating and managing structured, dynamic content experiences powered by AI. It introduces the concept of “frames,” which represent modular units of content that can be dynamically composed and rendered based on context or user interaction. The system is designed to enable highly interactive and personalized experiences, particularly in applications such as video generation, storytelling, and user interfaces. It supports... -
14
LiveAvatar
Streaming Real-time Audio-Driven Avatar Generation
LiveAvatar is an open-source research and implementation project that provides a unified framework for real-time, streaming, interactive avatar video generation driven by audio and other control signals. It implements techniques from state-of-the-art diffusion-based avatar modeling to support infinite-length continuous video generation with low latency, enabling interactive AI avatars that maintain continuity and realism over extended sessions. The project co-designs algorithms and system optimizations, such as block-wise autoregressive processing and fast sampling strategies, to deliver real-time frame rates (e.g., ~45 FPS on appropriate GPU clusters) while handling non-stop generation without quality degradation. ... -
15
Pixel2Motion
AI logo animation skill: turn raster logos into smooth SVG animation
Pixel2Motion is an AI-assisted logo animation project that turns raster brand assets into clean, motion-ready SVG animations. It starts with a PNG, JPG, WebP, or screenshot logo and reconstructs it as a smooth vector design. The project then adds structured SVG motion, animated HTML demos, and preview outputs for review. It is built for designers and developers who need polished logo reveals without manually rebuilding every asset from scratch. Its workflow emphasizes visual quality,... -
16
Positron
Positron, a next-generation data science IDE
Positron is a next-generation integrated development environment (IDE) created by Posit PBC (formerly RStudio Inc) specifically tailored for data science workflows in Python, R, and multi-language ecosystems. It aims to unify exploratory data analysis, production code, and data-app authoring in a single environment so that data scientists move from “question → insight → application” without switching tools. -
17
scroll-world
A skill that turn any brand into a scrollable 3D world
Scroll World is an agent skill for producing immersive landing pages that feel like one continuous camera flight through a generated 3D world. It works with Claude Code, Codex, and other systems that support the SKILL.md format. The workflow interviews the user about the brand, message, visual direction, and ordered sequence of scenes. It then uses Higgsfield to generate still images, scene-entry videos, and connector clips built from matching boundary frames. A portable JavaScript engine... -
18
FFmpegAndroid
FFmpeg implements video cropping, watermarking, transcoding
FFmpegAndroid is a comprehensive Android-focused multimedia development project that demonstrates how to integrate and use FFmpeg for advanced audio and video processing tasks. It provides a wide range of implementations including video editing, transcoding, watermarking, and GIF generation, all optimized for mobile environments. The project also covers real-time streaming capabilities such as local and live RTMP pushing using H264 encoding, making it suitable for building live broadcasting... -
19
StoryGen Atelier
AI-assisted storyboard and video generation tool
StoryGen Atelier is an advanced creative tool that blends AI with visual storytelling, making it possible to generate fully structured storyboards and stitched videos from text prompts without requiring manual art or animation skills. Users begin with natural language descriptions of their story or scene, and the system uses state-of-the-art large models to generate both the script and corresponding frames. Once individual frames are created, a second AI model generates transition clips that... -
20
Cowart
Local infinite canvas plugin for Codex
Cowart is a local infinite-canvas plugin designed specifically for Codex-powered creative workflows. Built on top of tldraw, it provides a visual workspace where users can brainstorm ideas, annotate images, generate new artwork, and iterate on existing visuals through AI-assisted editing. The canvas runs as a local web service and stores project data directly inside the user's workspace rather than in the plugin repository, making it suitable for project-centric workflows. Cowart enables... -
21
Qwen-2.5-VL
Qwen2.5-VL is the multimodal large language model series
Qwen2.5 is a series of large language models developed by the Qwen team at Alibaba Cloud, designed to enhance natural language understanding and generation across multiple languages. The models are available in various sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B parameters, catering to diverse computational requirements. Trained on a comprehensive dataset of up to 18 trillion tokens, Qwen2.5 models exhibit significant improvements in instruction following, long-text generation... -
22
HunyuanOCR
OCR expert VLM powered by Hunyuan's native multimodal architecture
...It’s designed to unify the entire OCR pipeline, detection, recognition, layout parsing, information extraction, translation, and even subtitle or structured output generation, into a single model inference instead of a cascade of separate tools. Despite being fairly lightweight (about 1 billion parameters), it delivers state-of-the-art performance across a wide variety of OCR tasks, outperforming many traditional OCR systems and even other multimodal models on benchmark suites. HunyuanOCR handles complex documents: multi-column layouts, tables, mathematical formulas, mixed languages, handwritten or stylized fonts, receipts, tickets, and even video-frame subtitles. ... -
23
i-Educar
Launching the most free educational software in Brazil
Accessible from anywhere and with single student registration available for the entire education network. Time-saving for everyone. Get current quantitative, financial and statistical data on all processes, at the time and place you want. Evaluation system and reports adapted to the different realities of the country, with numerical, conceptual or descriptive evaluation notes. Management of allocations, removals, substitutions, absences and delays, offering an integrated view of all... -
24
Moshi
A speech-text foundation model for real time dialogue
...Along these two audio streams, Moshi predicts text tokens corresponding to its own speech, its inner monologue, which greatly improves the quality of its generation. A small Depth Transformer models inter codebook dependencies for a given time step, while a large, 7B parameter Temporal Transformer models the temporal dependencies. -
25
Smooth My Video
Offline AI frame interpolation, upscaling and HDR for NVIDIA GPUs
Turn any video into a buttery-smooth high-frame-rate copy, entirely offline on your NVIDIA GPU. Pick a file, choose a target frame rate (2x, 4x, 8x and up, or match your monitor) and click Smooth It! Five interpolation models: GMFSS (best for anime), RIFE (best for live action) with a DRBA option that preserves anime pacing, NVIDIA DLSS 4.5 Frame Generation, Nvidia Smooth Motion, and SVP's svpflow engine.