AudioLMGoogle
|
Seed Audio 1.0BytePlus
|
|||||
Related Products
|
||||||
About
AudioLM is a pure audio language model that generates high‑fidelity, long‑term coherent speech and piano music by learning from raw audio alone, without requiring any text transcripts or symbolic representations. It represents audio hierarchically using two types of discrete tokens, semantic tokens extracted from a self‑supervised model to capture phonetic or melodic structure and global context, and acoustic tokens from a neural codec to preserve speaker characteristics and fine waveform details, and chains three Transformer stages to predict first semantic tokens for high‑level structure, then coarse and finally fine acoustic tokens for detailed synthesis. The resulting pipeline allows AudioLM to condition on a few seconds of input audio and produce seamless continuations that retain voice identity, prosody, and recording conditions in speech or melody, harmony, and rhythm in music. Human evaluations show that synthetic continuations are nearly indistinguishable from real recordings.
|
About
Seed Audio 1.0 is a non-streaming audio generation API based on HTTP, designed to generate complete audio from text prompts, reference audio, or reference images. It supports text-only generation, where audio is created directly from the prompt; reference-audio generation, where uploaded reference clips guide the output; and reference-image generation, where an image reference can be passed to generate audio from the text to be synthesized. Built as part of BytePlus Seed Speech, Audio 1.0 uses the seed-audio-1.0 model version and is positioned as an audio creation capability rather than a standard speech-only endpoint. It can generate voice, music, and sound effects in a single pass, making it useful for producing richer audio scenes without separately creating and mixing every track. The API is intended for developers building audio generation into applications, workflows, and production systems, with a request-based structure that lets teams submit prompts.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Audio researchers and developers needing a solution for creating realistic speech and music continuations directly from raw audio
|
Audience
AI media engineers building apps that need prompt-based audio scenes, narration, music, and sound effects through a developer API
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationGoogle
United States
research.google/blog/audiolm-a-language-modeling-approach-to-audio-generation/
|
Company InformationBytePlus
United States
docs.byteplus.com/en/docs/byteplusvoice/seedaudio-01
|
|||||
Alternatives |
AlternativesNo Alternatives
|
|||||
|
|
||||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
|
|
|