FugattoNVIDIA
|
StepAudio 3StepFun
|
|||||
Related Products
|
||||||
About
Using text and audio as inputs, a new generative AI model from NVIDIA can create any combination of music, voices, and sounds. A team of generative AI researchers created a Swiss Army knife for sound, one that allows users to control the audio output simply using text. While some AI models can compose a song or modify a voice, none have the dexterity of the new offering. Called Fugatto, it generates or transforms any mix of music, voices, and sounds described with prompts using any combination of text and audio files. For example, it can create a music snippet based on a text prompt, remove or add instruments from an existing song, change the accent or emotion in a voice, and even let people produce sounds never heard before. Supporting numerous audio generation and transformation tasks, Fugatto is the first foundational generative AI model that showcases emergent properties.
|
About
StepAudio 3 is StepFun’s next-generation audio model family, built to understand, generate, and interact through voice, sound, and music. The lineup includes StepAudio 3 Realtime for natural full-duplex conversation, StepAudio 3 ASR for speech recognition, StepAudio 3 TTS for speech synthesis, StepAudio 3 Gen for general-purpose audio generation, and StepAudio 3 Music for long-form music creation. Realtime is designed around a continuous listen-converse-think-act loop, understanding not only words but also hesitation, laughter, emotion, pauses, backchannels, and interruptions. It can think while speaking, reason through harder questions without breaking conversational flow, and use tools to complete tasks once it understands the user’s intent. StepAudio 3 Gen unifies zero-shot TTS, voice design, vocal generation, sound effects, music, and mixed audio generation within one framework, while StepAudio 3 Music supports text-controlled songs, instrumentals, vocal arrangement, and more.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Individuals and any user in search of a solution to generate music, voices, and sounds with AI
|
Audience
Developers, AI teams, and creators needing to build real-time voice agents, speech applications, transcription systems, and generative audio or music experiences
|
|||||
Support
Phone Support
Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Not Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Supported
Live Online
Not Supported
In Person
Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationNVIDIA
Founded: 1993
United States
blogs.nvidia.com/blog/fugatto-gen-ai-sound-model/
|
Company InformationStepFun
United States
static.stepfun.com/blog/stepaudio3/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
NVIDIA DGX Cloud
Not Supported
|
||||||
|
|
|