DeepInferDeepSeek
|
||||||
Related Products
|
||||||
About
Powerful, self-serve machine learning platform where you can turn models into scalable APIs in just a few clicks. Sign up for Deep Infra account using GitHub or log in using GitHub. Choose among hundreds of the most popular ML models. Use a simple rest API to call your model. Deploy models to production faster and cheaper with our serverless GPUs than developing the infrastructure yourself. We have different pricing models depending on the model used. Some of our language models offer per-token pricing. Most other models are billed for inference execution time. With this pricing model, you only pay for what you use. There are no long-term contracts or upfront costs, and you can easily scale up and down as your business needs change. All models run on A100 GPUs, optimized for inference performance and low latency. Our system will automatically scale the model based on your needs.
|
About
DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Supported
Cloud
Not Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Anyone in search of a solution to run the top AI models to improve their machine learning outcomes
|
Audience
Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
|||||
API
Offers API
Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
$0.70 per 1M input tokens
Free Version
Not Supported
Free Trial
Supported
|
Pricing
No information available.
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Pros & Cons from Real UsersPros
Cons
|
||||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationDeep Infra
deepinfra.com
|
Company InformationDeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
AI SpendOps
Supported
Code Llama
Supported
Codestral
Supported
Codestral Mamba
Supported
GitHub
Supported
Llama
Supported
Llama 3
Supported
Llama 3.1
Supported
Llama 3.2
Supported
Llama 3.3
Supported
|
Integrations
AI SpendOps
Not Supported
Code Llama
Not Supported
Codestral
Not Supported
Codestral Mamba
Not Supported
GitHub
Not Supported
Llama
Not Supported
Llama 3
Not Supported
Llama 3.1
Not Supported
Llama 3.2
Not Supported
Llama 3.3
Not Supported
|
|||||
|
|
|