FugattoNVIDIA
|
Pika SoundtrackPika
|
|||||
Related Products
|
||||||
About
Using text and audio as inputs, a new generative AI model from NVIDIA can create any combination of music, voices, and sounds. A team of generative AI researchers created a Swiss Army knife for sound, one that allows users to control the audio output simply using text. While some AI models can compose a song or modify a voice, none have the dexterity of the new offering. Called Fugatto, it generates or transforms any mix of music, voices, and sounds described with prompts using any combination of text and audio files. For example, it can create a music snippet based on a text prompt, remove or add instruments from an existing song, change the accent or emotion in a voice, and even let people produce sounds never heard before. Supporting numerous audio generation and transformation tasks, Fugatto is the first foundational generative AI model that showcases emergent properties.
|
About
Pika Soundtrack is a video-to-audio model that turns silent video into a native soundtrack complete with motion-aware sound effects, music, ambience, and voiceover that follow what happens on screen. Users can leave the prompt blank to generate a full soundscape automatically or provide direction specifying what the model should emphasize, include, or leave out. Rather than simply generating sound with video attached, the model is designed to understand what is happening in a scene, place each sound at the right moment, and keep every audio layer coherent throughout the full video. This synchronization approach allows sound effects, ambience, music, and speech to feel as though they belong naturally within the same scene. Pika reports that, in its full-duration benchmark, Soundtrack achieved the strongest semantic alignment and lowest audiovisual desynchronization among the models tested, including LTX-2.3 Foley V2A, HunyuanVideo-Foley, and MMAudio v2.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Individuals and any user in search of a solution to generate music, voices, and sounds with AI
|
Audience
Filmmakers, video creators, game developers, storytellers, and creative teams seeking to automatically generate synchronized music, ambience, voiceover, and motion-aware sound effects for video
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationNVIDIA
Founded: 1993
United States
blogs.nvidia.com/blog/fugatto-gen-ai-sound-model/
|
Company InformationPika
Founded: 2023
United States
experiment.pika.art/blog/pika-audio-models
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
|
|
|