DeepSpeed MII Files

MII makes low-latency and high-throughput inference possible

This is an exact mirror of the DeepSpeed MII project, hosted at https://github.com/microsoft/DeepSpeed-MII. SourceForge is not affiliated with DeepSpeed MII. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
DeepSpeed-MII v0.3.0 source code.tar.gz	2024-08-22	5.6 MB	0
DeepSpeed-MII v0.3.0 source code.zip	2024-08-22	5.7 MB	0
README.md	2024-08-22	644 Bytes	0
Totals: 3 Items		11.2 MB	0

What's Changed

Update version.txt by @loadams in https://github.com/microsoft/DeepSpeed-MII/pull/511
Fix scheduling for non-persistent pipeline by @tohtana in https://github.com/microsoft/DeepSpeed-MII/pull/515
Add Kubernetes health check route to REST server by @richiejp in https://github.com/microsoft/DeepSpeed-MII/pull/445
Pydantic v2 migration by @mrwyattii in https://github.com/microsoft/DeepSpeed-MII/pull/423

New Contributors

@richiejp made their first contribution in https://github.com/microsoft/DeepSpeed-MII/pull/445

Full Changelog: https://github.com/microsoft/DeepSpeed-MII/compare/v0.2.4...v0.3.0

Source: README.md, updated 2024-08-22

Other Useful Business Software

Keep company data safe with Chrome Enterprise Icon

Keep company data safe with Chrome Enterprise

Protect your business with AI policies and data loss prevention in the browser

Make AI work your way with Chrome Enterprise. Block unapproved sites and set custom data controls that align with your company's policies.

Download Chrome

Simple, Secure Domain Registration Icon

Simple, Secure Domain Registration

Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.

Sign up for free

Recommended Projects

DeepSpeed
DeepSpeed is an easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for Deep Learning Training and Inference. With DeepSpeed you can: 1. Train/Inference dense or sparse models with billions or trillions of parameters 2. Achieve excellent system...
DeepSeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective. DeepSpeed delivers extreme-scale model training for everyone, from data scientists training on massive supercomputers to those training on low-end clusters or even on a single GPU....
GLM-130B
GLM-130B is an open bilingual (English and Chinese) dense language model with 130 billion parameters, released by the Tsinghua KEG Lab and collaborators as part of the General Language Model (GLM) series. It is designed for large-scale inference and supports both left-to-right generation and...
gemma.cpp
Gemma.cpp is a C++ implementation for running inference with Gemma models efficiently on CPUs and GPUs. Developed by Google, it allows running large language models (LLMs) like Gemma with minimal hardware, focusing on optimized performance and low latency. Gemma.cpp is intended for developers...
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications. TensorRT-based applications perform up to 40X faster than CPU-only...