DeepInfer

DeepInfer

DeepSeek
+
+

Related Products

  • Runpod
    4.2 out of 5 stars 230 Ratings
    Visit Website for Runpod
  • LM-Kit.NET
    4.8 out of 5 stars 29 Ratings
    Visit Website for LM-Kit.NET
  • Compute with Hivenet
    5.0 out of 5 stars 4 Ratings
    Visit Website for Compute with Hivenet
  • IONOS Cloud GPU Servers
    4.6 out of 5 stars 45,816 Ratings
    Visit Website for IONOS Cloud GPU Servers
  • Gemini Enterprise Agent Platform
    4.3 out of 5 stars 1,178 Ratings
    Visit Website for Gemini Enterprise Agent Platform
  • AthenaHQ
    4.9 out of 5 stars 41 Ratings
    Visit Website for AthenaHQ
  • Google AI Studio
    4.8 out of 5 stars 42 Ratings
    Visit Website for Google AI Studio
  • Evertune
    5.0 out of 5 stars 1 Rating
    Visit Website for Evertune
  • Anaconda
    4.4 out of 5 stars 626 Ratings
    Visit Website for Anaconda
  • ONLYOFFICE Docs
    4.6 out of 5 stars 715 Ratings
    Visit Website for ONLYOFFICE Docs

About

DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.

About

NVIDIA OpenShell is an open, secure runtime for autonomous AI agents that governs how agents execute, what they can access, and where inference traffic goes. Security is enforced in the environment rather than inside the model or application: nothing is permitted by default, permissions are granted through policy, and enforcement happens outside the agent process so it cannot be bypassed through prompting. Each agent runs in an isolated sandbox with no direct network access, limited file access, and kernel-level monitoring of system calls. A gateway acts as the control plane, authenticating users, managing sandbox lifecycles, and delivering policies, settings, credentials, and inference configuration. A supervisor runs outside each sandbox, evaluates network requests against policy at the binary, destination, method, and path levels, and provides credentials only when allowed.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.

Audience

Developers, platform teams, and security or IT teams seeking to run autonomous AI agents with sandboxing, policy enforcement, credential controls, inference routing, and auditable access boundaries

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Supported
Live Online Not Supported
In Person Not Supported

Company Information

DeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer

Company Information

NVIDIA
Founded: 1993
United States
www.nvidia.com/en-us/ai/openshell/

Alternatives

Alternatives

nono

nono

Always Further
DeepSeek-V2

DeepSeek-V2

DeepSeek
IronClaw

IronClaw

Near AI
ModelArk

ModelArk

ByteDance

Categories

AI Inference Supported

Categories

Agentic AI Supported

Integrations

Globster Not Supported
NVIDIA Open Agent Safety Platform Not Supported

Integrations

Globster Supported
NVIDIA Open Agent Safety Platform Supported
Claim DeepInfer and update features and information
Claim DeepInfer and update features and information
Claim NVIDIA OpenShell and update features and information
Claim NVIDIA OpenShell and update features and information