AudioCraft

AudioCraft

Meta AI
PanGu-α

PanGu-α

Huawei
+
+

Related Products

  • Muzaic
    2 Ratings
    Visit Website
  • LTX
    182 Ratings
    Visit Website
  • 4K Video Downloader
    13,127 Ratings
    Visit Website
  • LALAL.AI
    5,443 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • Innoslate
    98 Ratings
    Visit Website
  • Screencapt
    140 Ratings
    Visit Website
  • Adobe Firefly
    25,051 Ratings
    Visit Website
  • FinOpsly
    3 Ratings
    Visit Website
  • pCloud Business
    189 Ratings
    Visit Website

About

AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals. With AudioCraft, we simplify the overall design of generative models for audio compared to prior work. Both MusicGen and AudioGen consist of a single autoregressive Language Model (LM) that operates over streams of compressed discrete music representation, i.e., tokens. We introduce a simple approach to leverage the internal structure of the parallel streams of tokens and show that, with a single model and elegant token interleaving pattern, our approach efficiently models audio sequences, simultaneously capturing the long-term dependencies in the audio and allowing us to generate high-quality audio. Our models leverage the EnCodec neural audio codec to learn the discrete audio tokens from the raw waveform. EnCodec maps the audio signal to one or several parallel streams of discrete tokens.

About

PanGu-α is developed under the MindSpore and trained on a cluster of 2048 Ascend 910 AI processors. The training parallelism strategy is implemented based on MindSpore Auto-parallel, which composes five parallelism dimensions to scale the training task to 2048 processors efficiently, including data parallelism, op-level model parallelism, pipeline model parallelism, optimizer model parallelism and rematerialization. To enhance the generalization ability of PanGu-α, we collect 1.1TB high-quality Chinese data from a wide range of domains to pretrain the model. We empirically test the generation ability of PanGu-α in various scenarios including text summarization, question answering, dialogue generation, etc. Moreover, we investigate the effect of model scales on the few-shot performances across a broad range of Chinese NLP tasks. The experimental results demonstrate the superior capabilities of PanGu-α in performing various tasks under few-shot or zero-shot settings.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Musicians, artists, and anyone looking for a tool to generate audio and sounds from written text

Audience

AI developers interested in a powerful large language model

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Meta AI
Founded: 2004
United States
audiocraft.metademolab.com

Company Information

Huawei
Founded: 1987
China
arxiv.org/abs/2104.12369

Alternatives

AudioLM

AudioLM

Google

Alternatives

PanGu-Σ

PanGu-Σ

Huawei
OPT

OPT

Meta
Seed-Music

Seed-Music

ByteDance
GPT-NeoX

GPT-NeoX

EleutherAI

Categories

Categories

AI Models Supported

Integrations

No info available.

Integrations

No info available.
Claim AudioCraft and update features and information
Claim AudioCraft and update features and information
Claim PanGu-α and update features and information
Claim PanGu-α and update features and information