DeepInfer

DeepInfer

DeepSeek
+
+

Related Products

  • Runpod
    230 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Compute with Hivenet
    4 Ratings
    Visit Website
  • IONOS Cloud GPU Servers
    45,340 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • AthenaHQ
    50 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website
  • Anaconda
    625 Ratings
    Visit Website
  • ONLYOFFICE Docs
    715 Ratings
    Visit Website

About

DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.

About

Nebius Token Factory is a scalable AI inference platform designed to run open-source and custom AI models in production without manual infrastructure management. It offers enterprise-ready inference endpoints with predictable performance, autoscaling throughput, and sub-second latency — even at very high request volumes. It delivers 99.9% uptime availability and supports unlimited or tailored traffic profiles based on workload needs, simplifying the transition from experimentation to global deployment. Nebius Token Factory supports a broad set of open source models such as Llama, Qwen, DeepSeek, GPT-OSS, Flux, and many others, and lets teams host and fine-tune models through an API or dashboard. Users can upload LoRA adapters or full fine-tuned variants directly, with the same enterprise performance guarantees applied to custom models.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.

Audience

Engineering and data science teams that need a production-grade inference system to deploy, scale, and manage open-source or custom AI models reliably in enterprise environments

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Supported
Free Trial Not Supported

Pricing

$0.02
Free Version Supported
Free Trial Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

DeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer

Company Information

Nebius
Founded: 2022
Netherlands
nebius.com/services/token-factory/enterprise-grade-inference

Alternatives

Alternatives

DeepSeek-V2

DeepSeek-V2

DeepSeek
FPT AI Factory

FPT AI Factory

FPT Cloud
ModelArk

ModelArk

ByteDance

Categories

AI Inference Supported

Categories

AI Fine-Tuning Supported
AI Inference Supported

Integrations

BGE Not Supported
DeepSeek Not Supported
DeepSeek R1 Not Supported
DeepSeek V3.1 Not Supported
FLUX.1 Not Supported
GLM-4.5-Air Not Supported
Gemma 3 Not Supported
JSON Not Supported
Kimi K2 Thinking Not Supported
Kimi K2.6 Not Supported
Kimi K3 Not Supported
Mistral AI Not Supported
Mistral NeMo Not Supported
NVIDIA Llama Nemotron Not Supported
Nebius Not Supported
QwQ-32B Not Supported
Qwen Not Supported
Qwen3 Not Supported
Qwen3-Coder Not Supported
pgvector Not Supported

Integrations

BGE Supported
DeepSeek Supported
DeepSeek R1 Supported
DeepSeek V3.1 Supported
FLUX.1 Supported
GLM-4.5-Air Supported
Gemma 3 Supported
JSON Supported
Kimi K2 Thinking Supported
Kimi K2.6 Supported
Kimi K3 Supported
Mistral AI Supported
Mistral NeMo Supported
NVIDIA Llama Nemotron Supported
Nebius Supported
QwQ-32B Supported
Qwen Supported
Qwen3 Supported
Qwen3-Coder Supported
pgvector Supported
Claim DeepInfer and update features and information
Claim DeepInfer and update features and information
Claim Nebius Token Factory and update features and information
Claim Nebius Token Factory and update features and information