DeepInfer

DeepInfer

DeepSeek
+
+

Related Products

  • Runpod
    230 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Compute with Hivenet
    4 Ratings
    Visit Website
  • IONOS Cloud GPU Servers
    45,340 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • AthenaHQ
    50 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website
  • Anaconda
    625 Ratings
    Visit Website
  • ONLYOFFICE Docs
    715 Ratings
    Visit Website

About

DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.

About

Introducing DeepSeek-V3.2-Exp, our latest experimental model built on V3.1-Terminus, debuting DeepSeek Sparse Attention (DSA) for faster and more efficient inference and training on long contexts. DSA enables fine-grained sparse attention with minimal loss in output quality, boosting performance for long-context tasks while reducing compute costs. Benchmarks indicate that V3.2-Exp performs on par with V3.1-Terminus despite these efficiency gains. The model is now live across app, web, and API. Alongside this, the DeepSeek API prices have been cut by over 50% immediately to make access more affordable. For a transitional period, users can still access V3.1-Terminus via a temporary API endpoint until October 15, 2025. DeepSeek welcomes feedback on DSA via its feedback portal. In conjunction with the release, DeepSeek-V3.2-Exp has been open-sourced: the model weights and supporting technology (including key GPU kernels in TileLang and CUDA) are available on Hugging Face.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.

Audience

Researchers and AI engineers looking for a solution providing a model that performs well on long-context tasks with reduced compute cost

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Supported
Free Trial Not Supported

Pricing

Free
Open source
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

DeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer

Company Information

DeepSeek
Founded: 2023
China
deepseek.com

Alternatives

Alternatives

DeepSeek-V3.2

DeepSeek-V3.2

DeepSeek
DeepSeek-V2

DeepSeek-V2

DeepSeek
MiniMax M2

MiniMax M2

MiniMax
ModelArk

ModelArk

ByteDance

Categories

AI Inference Supported

Categories

AI Models Supported
Foundation Models Supported

Integrations

DeepSeek Not Supported
Hugging Face Not Supported

Integrations

DeepSeek Supported
Hugging Face Supported
Claim DeepInfer and update features and information
Claim DeepInfer and update features and information
Claim DeepSeek-V3.2-Exp and update features and information
Claim DeepSeek-V3.2-Exp and update features and information