DeepInferDeepSeek
|
QVACTether Data
|
|||||
Related Products
|
||||||
About
DeepInfer is an open-source inference framework for running DeepSeek language models on Linux systems with supported NVIDIA or Huawei Ascend accelerators. It provides offline inference and runtime components for model execution, optimized kernels, distributed parallelism, asynchronous batch scheduling, speculative decoding, deterministic generation, and structured outputs such as JSON Schema, regular expressions, and EBNF formats. The project documents DeepSeek-V4.1-Flash support and includes build instructions, configuration guidance, examples, and evaluation tools. It is intended for developers and infrastructure teams building or evaluating self-managed inference deployments. Its repository notes that production services may require additional KV-cache, prefill/decode disaggregation, and load-balancing components not included in this release.
|
About
QVAC SDK is a developer toolkit for adding on-device AI inference to applications built with JavaScript/TypeScript or Python. It provides a common API for running supported language, vision, and speech models on mobile and desktop devices, with model discovery and downloads, inference APIs, and optional remote providers. Developers can build offline-capable AI features and, for local inference, keep prompts and processing on the device. QVAC also offers an OpenAI-compatible server and plugins that connect local models to developer tools. The SDK is intended for developers building AI-enabled applications. Its documentation covers setup, model selection, text generation, image and audio tasks, and tool calling; available features depend on the selected model and platform. QVAC SDK is free, open-source software under Apache 2.0; local inference requires no hosted QVAC account.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Supported
Cloud
Not Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Supported
Mac
Supported
Linux
Supported
Cloud
Not Supported
On-Premises
Supported
iPhone
Supported
iPad
Supported
Android
Supported
Chromebook
Not Supported
|
|||||
Audience
Developers and infrastructure teams deploying or evaluating DeepSeek model inference on supported accelerator hardware.
|
Audience
Software developers and product teams building AI-enabled mobile, desktop, and other applications that need local or peer-to-peer AI inference.
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Supported
Free Trial
Not Supported
|
Pricing
$0
Free and open source under Apache 2.0. Local inference has no subscription, API-key, or per-token charge.
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationDeepSeek
Founded: 2023
China
github.com/deepseek-ai/DeepInfer
|
Company InformationTether Data
El Salvador
qvac.tether.io/products/sdk
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Hugging Face
Not Supported
OpenClaw
Not Supported
OpenCode
Not Supported
|
||||||
|
|
|