DeepSpeed MII Files

MII makes low-latency and high-throughput inference possible

This is an exact mirror of the DeepSpeed MII project, hosted at https://github.com/microsoft/DeepSpeed-MII. SourceForge is not affiliated with DeepSpeed MII. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-03-19	1.0 kB	0
v0.3.2 source code.tar.gz	2025-03-19	5.6 MB	1
v0.3.2 source code.zip	2025-03-19	5.7 MB	0
Totals: 3 Items		11.2 MB	1

What's Changed

Update version.txt by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/539
Update CODEOWNERS file by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/552
Update contributing language on README for CLA->DCO by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/554
Update references due to DeepSpeed* GH repo move by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/553
Replace CLA with DCO in Contributing.md by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/558
Fixed to enable to use pydantic v2 package by @tishizaki in https://github.com/deepspeedai/DeepSpeed-MII/pull/560
Update build process on invoking setup.py by @loadams in https://github.com/deepspeedai/DeepSpeed-MII/pull/555

New Contributors

@tishizaki made their first contribution in https://github.com/deepspeedai/DeepSpeed-MII/pull/560

Full Changelog: https://github.com/deepspeedai/DeepSpeed-MII/compare/v0.3.1...v0.3.2

Source: README.md, updated 2025-03-19

Other Useful Business Software

Level Up Your Cyber Defense with External Threat Management Icon

Level Up Your Cyber Defense with External Threat Management

See every risk before it hits. From exposed data to dark web chatter. All in one unified view.

Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.

Try for Free

Gen AI apps are built with MongoDB Atlas Icon

Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.

Start Free

Recommended Projects

DeepSpeed
DeepSpeed is an easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference. With DeepSpeed you can: 1. Train/Inference dense or sparse models with billions or trillions of parameters 2. Achieve excellent system...
DeepSeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective. DeepSpeed delivers extreme-scale model training for everyone, from data scientists training on massive supercomputers to those training on low-end clusters or even on a single GPU....
GLM-130B
GLM-130B is an open bilingual (English and Chinese) dense language model with 130 billion parameters, released by the Tsinghua KEG Lab and collaborators as part of the General Language Model (GLM) series. It is designed for large-scale inference and supports both left-to-right generation and...
gemma.cpp
Gemma.cpp is a C++ implementation for running inference with Gemma models efficiently on CPUs and GPUs. Developed by Google, it allows running large language models (LLMs) like Gemma with minimal hardware, focusing on optimized performance and low latency. Gemma.cpp is intended for developers...
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications. TensorRT-based applications perform up to 40X faster than CPU-only...