DeepInfer

DeepInfer

DeepSeek
+
+

Related Products

  • Compute with Hivenet
    4 Ratings
    Visit Website
  • Runpod
    230 Ratings
    Visit Website
  • IONOS Cloud GPU Servers
    45,340 Ratings
    Visit Website
  • Google Compute Engine
    1,169 Ratings
    Visit Website
  • Servers.com by Nexcess
    15 Ratings
    Visit Website
  • CapLinked
    248 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Secure Eraser
    15 Ratings
    Visit Website
  • Google Cloud Platform
    61,066 Ratings
    Visit Website
  • Thinfinity Workspace
    16 Ratings
    Visit Website

About

Confidential AI provides private AI inference, agent environments, and confidential computing infrastructure for AI labs, inference providers, routers, and organizations handling sensitive workloads. Its hosted inference service runs open-weight models in hardware-backed trusted execution environments (TEEs), including Intel TDX and AMD SEV-SNP confidential VMs with NVIDIA GPUs in confidential computing mode. Prompts, responses, and workload data are protected from infrastructure operators, and clients can verify attestation before sending sensitive input. Customers can use an OpenAI-compatible API to deploy inference endpoints and agent workloads, or license the confidential-computing stack for on-premises infrastructure, bare metal, and major clouds. Use cases include serving models while limiting operator access to prompts and model assets, and running sensitive AI workloads on dedicated confidential compute.

About

DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

AI labs, inference providers, routers and regulated companies.

Audience

Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.

Support

Phone Support Not Supported
24/7 Live Support Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

No images available

Screenshots and Videos

Pricing

$0.20/1M input tokens
Cloud inference is metered per 1M tokens: DeepSeek V4 Flash costs $0.20 per 1M input tokens ($0.018 cached input) and $0.40 per 1M output tokens, invoiced monthly in arrears. GPU VMs are billed per GPU-hour; listed rates start at $1.90 per GPU-hour, depending on the GPU. Licensed software starts at $2,789 per GPU per year, invoiced monthly in arrears. Dedicated GPU VM orders have a $500 minimum and a three-month minimum term.
Free Version Supported
Free Trial Supported

Pricing

No information available.
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Supported
In Person Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Confidential AI
Founded: 2025
United States
confidential.ai

Company Information

DeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer

Alternatives

Alternatives

DeepSeek-V2

DeepSeek-V2

DeepSeek
Targon

Targon

Manifold Labs
ModelArk

ModelArk

ByteDance

Categories

AI Inference Supported
Cloud GPU Supported
Confidential AI Supported
Virtual Machine Supported

Categories

AI Inference Supported

Integrations

OpenAI Supported

Integrations

OpenAI Not Supported
Claim Confidential AI and update features and information
Claim Confidential AI and update features and information
Claim DeepInfer and update features and information
Claim DeepInfer and update features and information