ModelScopeAlibaba Cloud
|
Starchild-1Odyssey
|
|||||
Related Products
|
||||||
About
This model is based on a multi-stage text-to-video generation diffusion model, which inputs a description text and returns a video that matches the text description. Only English input is supported.
This model is based on a multi-stage text-to-video generation diffusion model, which inputs a description text and returns a video that matches the text description. Only English input is supported.
The text-to-video generation diffusion model consists of three sub-networks: text feature extraction, text feature-to-video latent space diffusion model, and video latent space to video visual space. The overall model parameters are about 1.7 billion. Support English input. The diffusion model adopts the Unet3D structure, and realizes the function of video generation through the iterative denoising process from the pure Gaussian noise video.
|
About
Starchild-1 is the first real-time multimodal world model, built to simulate both the visuals and sounds of the world in real time. Unlike language models, which learn from text, world models learn directly from the world itself through pixels, motion, and actions encoded in large-scale video, becoming capable of understanding and simulating an approximation of the world as it evolves. Starchild-1 goes beyond traditional world models, which have mostly focused on visual generation alone, by autoregressively generating synchronized audio and video while continuously responding to streaming user input. Instead of producing a fixed offline clip, it predicts the next audio and video state of a world based on past observations and live inputs, enabling environments, conversations, ambient sound, and world dynamics to change interactively. Users can stream text, speech, and action inputs into the model during rollout, dynamically altering what is seen and heard in real time.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Users interested in an open source text-to-video AI video generation model
|
Audience
Interactive AI researchers who need a real-time multimodal world model for synchronized audio-video simulation and responsive virtual environments
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationAlibaba Cloud
China
modelscope.cn/
|
Company InformationOdyssey
Founded: 2023
United States
odyssey.ml/introducing-starchild-1
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
01.AI
CodeQwen
GLM-4.5
Qwen
Qwen-7B
Qwen-Image
Qwen2
Qwen2-VL
Qwen2.5
Qwen2.5-1M
|
Integrations
01.AI
CodeQwen
GLM-4.5
Qwen
Qwen-7B
Qwen-Image
Qwen2
Qwen2-VL
Qwen2.5
Qwen2.5-1M
|
|||||
|
|
|