DeepSpeed

DeepSpeed

Microsoft
MXNet

MXNet

The Apache Software Foundation
+
+

Related Products

  • Gemini Enterprise Agent Platform
    999 Ratings
    Visit Website
  • Runpod
    230 Ratings
    Visit Website
  • Cloudflare
    2,042 Ratings
    Visit Website
  • Qloo
    23 Ratings
    Visit Website
  • Fraud.net
    56 Ratings
    Visit Website
  • Dragonfly
    16 Ratings
    Visit Website
  • PackageX OCR Scanning
    48 Ratings
    Visit Website
  • Elecard Boro
    9 Ratings
    Visit Website
  • Retool
    593 Ratings
    Visit Website
  • Bright Data
    1,424 Ratings
    Visit Website

About

DeepSpeed is an open source deep learning optimization library for PyTorch. It's designed to reduce computing power and memory use, and to train large distributed models with better parallelism on existing computer hardware. DeepSpeed is optimized for low latency, high throughput training. DeepSpeed can train DL models with over a hundred billion parameters on the current generation of GPU clusters. It can also train up to 13 billion parameters in a single GPU. DeepSpeed is developed by Microsoft and aims to offer distributed training for large-scale models. It's built on top of PyTorch, which specializes in data parallelism.

About

A hybrid front-end seamlessly transitions between Gluon eager imperative mode and symbolic mode to provide both flexibility and speed. Scalable distributed training and performance optimization in research and production is enabled by the dual parameter server and Horovod support. Deep integration into Python and support for Scala, Julia, Clojure, Java, C++, R and Perl. A thriving ecosystem of tools and libraries extends MXNet and enables use-cases in computer vision, NLP, time series and more. Apache MXNet is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision-making process have stabilized in a manner consistent with other successful ASF projects. Join the MXNet scientific community to contribute, learn, and get answers to your questions.

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Deep learning model developers

Audience

Developers and researchers requiring an open-source deep learning framework for research prototyping and production

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Open source
Free Version Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Microsoft
Founded: 1975
United States
www.deepspeed.ai/

Company Information

The Apache Software Foundation
Founded: 1999
United States
mxnet.apache.org

Alternatives

Alternatives

GPT-NeoX

GPT-NeoX

EleutherAI
AWS Neuron

AWS Neuron

Amazon Web Services
Caffe

Caffe

BAIR

Categories

AI Development Supported
Deep Learning Supported

Categories

AI Development Supported
Deep Learning Supported
Neural Network Supported

Integrations

AWS Marketplace Not Supported
Amazon EC2 Inf1 Instances Not Supported
Amazon Elastic Inference Not Supported
Amazon SageMaker Debugger Not Supported
Amazon SageMaker Model Building Not Supported
Axolotl Supported
Cake AI Supported
Cameralyze Not Supported
Flower Not Supported
GPUonCLOUD Not Supported
Google Cloud Deep Learning VM Image Not Supported
Gradient Not Supported
Guild AI Not Supported
Horovod Not Supported
LeaderGPU Not Supported
MLReef Not Supported
NVIDIA Triton Inference Server Not Supported
Nurix Supported
PyTorch Supported

Integrations

AWS Marketplace Supported
Amazon EC2 Inf1 Instances Supported
Amazon Elastic Inference Supported
Amazon SageMaker Debugger Supported
Amazon SageMaker Model Building Supported
Axolotl Not Supported
Cake AI Not Supported
Cameralyze Supported
Flower Supported
GPUonCLOUD Supported
Google Cloud Deep Learning VM Image Supported
Gradient Supported
Guild AI Supported
Horovod Supported
LeaderGPU Supported
MLReef Supported
NVIDIA Triton Inference Server Supported
Nurix Not Supported
PyTorch Not Supported
Claim DeepSpeed and update features and information
Claim DeepSpeed and update features and information
Claim MXNet and update features and information
Claim MXNet and update features and information