DeepSpeed MII Files

MII makes low-latency and high-throughput inference possible

This is an exact mirror of the DeepSpeed MII project, hosted at https://github.com/microsoft/DeepSpeed-MII. SourceForge is not affiliated with DeepSpeed MII. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-03-25	479 Bytes	0
v0.3.3 source code.tar.gz	2025-03-25	5.6 MB	0
v0.3.3 source code.zip	2025-03-25	5.7 MB	0
Totals: 3 Items		11.2 MB	0

What's Changed

Update version.txt after 0.3.2 release by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/561
Add pyproject.toml using setuptools legacy build backend. by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/562
Add build to the requires list for building the wheel. by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/563

Full Changelog: https://github.com/deepspeedai/DeepSpeed-MII/compare/v0.3.2...v0.3.3

Source: README.md, updated 2025-03-25

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Level Up Your Cyber Defense with External Threat Management

See every risk before it hits. From exposed data to dark web chatter. All in one unified view.

Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.

Try for Free

Recommended Projects

DeepSpeed
DeepSpeed is an easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference. With DeepSpeed you can: 1. Train/Inference dense or sparse models with billions or trillions of parameters 2. Achieve excellent system...
DeepSeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective. DeepSpeed delivers extreme-scale model training for everyone, from data scientists training on massive supercomputers to those training on low-end clusters or even on a single GPU....
gemma.cpp
Gemma.cpp is a C++ implementation for running inference with Gemma models efficiently on CPUs and GPUs. Developed by Google, it allows running large language models (LLMs) like Gemma with minimal hardware, focusing on optimized performance and low latency. Gemma.cpp is intended for developers...
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications. TensorRT-based applications perform up to 40X faster than CPU-only...
Portkey AI Gateway
Portkey AI Gateway aims to offer a blazing fast, secure, and flexible gateway for interacting with a wide variety of models and enforcing guardrails. It presents a single, friendly API through which you can route to 200+ LLMs, while applying configurable input/output guardrails to enforce...

DeepSpeed MII Files

MII makes low-latency and high-throughput inference possible

Get an email when there's a new version of DeepSpeed MII

What's Changed