Search Results for "audio generation"
Sort By:
Showing 23 open source projects for "audio generation"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
1
MiniMax H3
MiniMax H3 is a general-purpose, omni-modal generative system
MiniMax H3 is an omni-modal generative system for creating synchronized video and native stereo audio from complex multimodal instructions. It can understand combinations of text, images, video, and audio as generation context. Outputs range from four to fifteen seconds at 24 frames per second, with multiple aspect ratios and resolutions up to 2K. H3-Base supports text-to-video, first-frame, last-frame, and first-and-last-frame generation. -
2
LTX-2.3
Official Python inference and LoRA trainer package
LTX-2.3 is an open-source multimodal artificial intelligence foundation model developed by Lightricks for generating synchronized video and audio from prompts or other inputs. Unlike most earlier video generation systems that only produced silent clips, LTX-2 combines video and audio generation in a unified architecture capable of producing coherent audiovisual scenes. The model uses a diffusion-transformer-based architecture designed to generate high-fidelity visual frames while simultaneously producing corresponding audio elements such as speech, music, ambient sound, or effects. ... -
3
Miso TTS
Miso TTS is an 8 billion, highly emotive text-to-speech model
Miso TTS is an advanced 8-billion-parameter text-to-speech model developed by Miso Labs for generating highly expressive and natural-sounding conversational speech. Built on an RVQ Transformer architecture inspired by Sesame CSM, it combines a powerful Llama-based backbone with an autoregressive audio decoder to produce high-quality audio from text. The model supports both standard speech synthesis and voice-conditioned generation using optional audio prompts for voice cloning. Miso TTS generates Mimi audio codes and can leverage conversation history to create more contextually aware and realistic dialogue. Designed for local deployment, it offers watermarking by default to help promote responsible use of generated audio. ... -
4
HeartMuLa
A Family of Open Sourced Music Foundation Models
...For text extraction from audio, it provides HeartTranscriptor, a Whisper-based model tuned specifically for lyrics transcription, which helps bridge generated or recorded audio back into structured text. It also introduces HeartCLAP, which aligns audio and text into a shared embedding space. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
MOSS-TTS Family
MOSS‑TTS Family open‑source speech and sound generation model
...Its flagship model focuses on stable long speech generation, multilingual and code-switched synthesis, pronunciation control, and zero-shot voice cloning. The broader family also includes dialogue generation, prompt-based voice creation, streaming voice-agent support, and a unified audio tokenizer. It is especially useful for developers building dubbing, podcasts, audiobooks, voice assistants, character voices, and creative audio tools. -
6
h3-metal
MiniMax H3 inference engine for Mac computers
h3-metal is a native MiniMax-H3 inference engine for Apple Silicon focused on generating video and audio locally with Metal. It supports prompt-to-video and prompt-to-audio workflows as well as first-frame, last-frame, image, video, and audio references. An interactive terminal session keeps prompt conditioning, the diffusion transformer, and the video decoder in memory for faster repeated generations. Users can trade speed, quality, and memory through denoising steps, layer counts, reuse modes, token reduction, internal render size, and SSD streaming. ... -
7
HunyuanVideo-Foley
Multimodal Diffusion with Representation Alignment
HunyuanVideo-Foley is a multimodal diffusion model from Tencent Hunyuan for high-fidelity Foley (sound effects) audio generation synchronized to video scenes. It is designed to generate audio that matches both visual content and textual semantic cues, for use in video production, film, advertising, games, etc. The model architecture aligns audio, video, and text representations to produce realistic synchronized soundtracks. Produces high-quality 48 kHz audio output suitable for professional use. ... -
8
Phonon
Phonon TTS inference using xn
Phonon TTS is an open-source text-to-speech inference engine that generates natural-sounding speech locally on computers, mobile devices, and web browsers. Built in Rust, it operates without PyTorch or a cloud connection after downloading its models. The software provides compact 31-million and 40-million parameter models for efficient deployment. It supports English, French, German, Spanish, and Portuguese speech synthesis. Users can select predefined voices, create custom voices, or clone... -
9
DramaBox
super expressive prompting model based on ltx2.3
...The project includes a warm inference server, a CLI workflow, and a Gradio app for interactive generation. It also supports additional LoRA training on top of DramaBox, making it possible to adapt the model for a specific speaker, language flavor, or performance style. DramaBox is aimed at developers, researchers, and audio creators who need highly expressive English TTS for character dialogue, narrative audio, prototyping, or voice experimentation. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
HunyuanCustom
Multimodal-Driven Architecture for Customized Video Generation
HunyuanCustom is a multimodal video customization framework by Tencent Hunyuan, aimed at generating customized videos featuring particular subjects (people, characters) under flexible conditions, while maintaining subject/identity consistency. It supports conditioning via image, audio, video, and text, and can perform subject replacement in videos, generate avatars speaking given audio, or combine multiple subject images. The architecture builds on HunyuanVideo, with added modules for... -
11
Qwen2.5-Omni
Capable of understanding text, audio, vision, video
Qwen2.5-Omni is an end-to-end multimodal flagship model in the Qwen series by Alibaba Cloud, designed to process multiple modalities (text, images, audio, video) and generate responses both as text and natural speech in streaming real-time. It supports “Thinker-Talker” architecture, and introduces innovations for aligning modalities over time (for example synchronizing video/audio), robust speech generation, and low-VRAM/quantized versions to make usage more accessible. It holds state-of-the-art performance in many multimodal benchmarks, particularly spoken language understanding, audio reasoning, image/video understanding, etc. ... -
12
GLM-TTS
Controllable & emotion-expressive zero-shot TTS
GLM-TTS is an advanced text-to-speech synthesis system built on large language model technologies that focuses on producing high-quality, expressive, and controllable spoken output, including features like emotion modulation and zero-shot voice cloning. It uses a two-stage architecture where a generative LLM first converts text into intermediate speech token sequences and then a Flow-based neural model converts those tokens into natural audio waveforms, enabling rich prosody and voice... -
13
Kitten TTS
State-of-the-art TTS model under 25MB
KittenTTS is an open-source, ultra-lightweight, and high-quality text-to-speech model featuring just 15 million parameters and a binary size under 25 MB. It is designed for real-time CPU-based deployment across diverse platforms. Ultra-lightweight, model size less than 25MB. CPU-optimized, runs without GPU on any device. High-quality voices, several premium voice options available. Fast inference, optimized for real-time speech synthesis. -
14
Qwen3-TTS
Qwen3-TTS is an open-source series of TTS models
Qwen3-TTS is an open-source text-to-speech (TTS) project built around the Qwen3 large language model family, focused on generating high-quality, natural-sounding speech from plain text input. It provides researchers and developers with tools to transform text into expressive, intelligible audio, supporting multiple languages and voice characteristics tuned for clarity and fluidity. The project includes pre-trained models and inference scripts that let users synthesize speech locally or integrate TTS into larger pipelines such as voice assistants, accessibility tools, or multimedia generation workflows. Because it’s part of the broader Qwen ecosystem, it benefits from the model’s understanding of linguistic nuances, enabling more accurate pronunciation, prosody, and contextual delivery than many traditional TTS systems. ... -
15
GLM-4-Voice
GLM-4-Voice | End-to-End Chinese-English Conversational Model
GLM-4-Voice is an open-source speech-enabled model from ZhipuAI, extending the GLM-4 family into the audio domain. It integrates advanced voice recognition and generation with the multimodal reasoning capabilities of GLM-4, enabling smooth natural interaction via spoken input and output. The model supports real-time speech-to-text transcription, spoken dialogue understanding, and text-to-speech synthesis, making it suitable for conversational AI, virtual assistants, and accessibility applications. ... -
16
HY-World 1.5
A Systematic Framework for Interactive World Modeling
HY-WorldPlay is a Hunyuan AI project focusing on immersive multimodal content generation and interaction within virtual worlds or simulated environments. It aims to empower AI agents with the capability to both understand and generate multimedia content — including text, audio, image, and potentially 3D or game-world elements — enabling lifelike dialogue, environmental interpretations, and responsive world behavior. -
17
CSM (Conversational Speech Model)
A Conversational Speech Generation Model
The CSM (Conversational Speech Model) is a speech generation model developed by Sesame AI that creates RVQ audio codes from text and audio inputs. It uses a Llama backbone and a smaller audio decoder to produce audio codes for realistic speech synthesis. The model has been fine-tuned for interactive voice demos and is hosted on platforms like Hugging Face for testing. CSM offers a flexible setup and is compatible with CUDA-enabled GPUs for efficient execution. -
18
DiffRhythm
Di♪♪Rhythm: Blazingly Fast & Simple End-to-End Song Generation
DiffRhythm is an open-source, diffusion-based model designed to generate full-length songs. Focused on music creation, it combines advanced AI techniques to produce coherent and creative audio compositions. The model utilizes a latent diffusion architecture, making it capable of producing high-quality, long-form music. It can be accessed on Huggingface, where users can interact with a demo or download the model for further use. DiffRhythm offers tools for both training and inference, and its flexibility makes it ideal for AI-based music production and research in music generation. -
19
video-subtitle-generator
A GUI tool for generating subtitle from videos, generating srt files
Video Subtitle Generator is a local speech-recognition tool that creates SRT subtitle files from audio or video. It is designed to perform transcription locally without requiring users to obtain a third-party speech API. The project supports numerous languages, including Chinese, English, Korean, Japanese, Vietnamese, Russian, Spanish, and Portuguese. Users can operate it through either a graphical interface or a command-line interface. Several recognition model sizes are available, allowing... -
20
Dia-1.6B
Dia-1.6B generates lifelike English dialogue and vocal expressions
Dia-1.6B is a 1.6 billion parameter text-to-speech model by Nari Labs that generates high-fidelity dialogue directly from transcripts. Designed for realistic vocal performance, Dia supports expressive features like emotion, tone control, and non-verbal cues such as laughter, coughing, or sighs. The model accepts speaker conditioning through audio prompts, allowing limited voice cloning and speaker consistency across generations. It is optimized for English and built for real-time performance... -
21
mms-300m-1130-forced-aligner
CTC-based forced aligner for audio-text in 158 languages
...The alignment pipeline includes audio processing, emission generation, tokenization, and span detection, making it suitable for speech analysis, transcription syncing, and dataset creation. This model is especially useful for researchers and developers working with low-resource languages or building multilingual speech systems. -
22
MiMo-V2.5
Omnimodal AI model for agents, coding, and long-context tasks
MiMo-V2.5 is a native omnimodal large language model developed by Xiaomi, designed for advanced agentic workflows, multimodal reasoning, and long-context processing. Built on a Mixture-of-Experts architecture with approximately 309B total parameters and around 15B activated per inference, it balances high capability with efficient execution. The model natively processes text, images, video, and audio within a unified system, enabling cross-modal understanding and complex task execution in a... -
23
Muse Spark Open
816B multimodal MoE model for coding, reasoning, and autonomous agents
...It contains 816B total parameters with 42B activated per token, using 256 experts and a dedicated 1.8B-parameter perception encoder. The model natively processes text, images, audio, and video and generates text, with a 1M-token context window for extended tasks. It supports more than 100 languages and configurable low, medium, high, and xhigh reasoning effort. Its capabilities include multi-step planning, tool calling, error recovery, software engineering, multimodal analysis, synthetic data generation, and model evaluation. ...
- Previous
- You're on page 1
- Next
