Amazon EMR

Amazon EMR

Amazon
MLlib

MLlib

Apache Software Foundation
+
+

Related Products

  • TIMi
    68 Ratings
    Visit Website
  • Anaconda
    625 Ratings
    Visit Website
  • HiveMQ
    92 Ratings
    Visit Website
  • Flagsmith
    43 Ratings
    Visit Website
  • JS7 JobScheduler
    1 Rating
    Visit Website
  • Apify
    1,800 Ratings
    Visit Website
  • Google Cloud Platform
    61,066 Ratings
    Visit Website
  • Parasoft
    152 Ratings
    Visit Website
  • Source Defense
    7 Ratings
    Visit Website
  • wp2print
    7,748 Ratings
    Visit Website

About

Amazon EMR is the industry-leading cloud big data platform for processing vast amounts of data using open-source tools such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi, and Presto. With EMR you can run Petabyte-scale analysis at less than half of the cost of traditional on-premises solutions and over 3x faster than standard Apache Spark. For short-running jobs, you can spin up and spin down clusters and pay per second for the instances used. For long-running workloads, you can create highly available clusters that automatically scale to meet demand. If you have existing on-premises deployments of open-source tools such as Apache Spark and Apache Hive, you can also run EMR clusters on AWS Outposts. Analyze data using open-source ML frameworks such as Apache Spark MLlib, TensorFlow, and Apache MXNet. Connect to Amazon SageMaker Studio for large-scale model training, analysis, and reporting.

About

​Apache Spark's MLlib is a scalable machine learning library that integrates seamlessly with Spark's APIs, supporting Java, Scala, Python, and R. It offers a comprehensive suite of algorithms and utilities, including classification, regression, clustering, collaborative filtering, and tools for constructing machine learning pipelines. MLlib's high-quality algorithms leverage Spark's iterative computation capabilities, delivering performance up to 100 times faster than traditional MapReduce implementations. It is designed to operate across diverse environments, running on Hadoop, Apache Mesos, Kubernetes, standalone clusters, or in the cloud, and accessing various data sources such as HDFS, HBase, and local files. This flexibility makes MLlib a robust solution for scalable and efficient machine learning tasks within the Apache Spark ecosystem. ​

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Companies that want to easily run and scale Apache Spark, Hive, Presto, and other big data frameworks

Audience

Data scientists and engineers wanting a machine learning solution for efficient data processing and analysis within the Apache Spark framework

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Supported
Live Online Not Supported
In Person Supported

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/emr/

Company Information

Apache Software Foundation
Founded: 1995
United States
spark.apache.org/mllib/

Alternatives

AWS Glue

AWS Glue

Amazon

Alternatives

Apache Spark

Apache Spark

Apache Software Foundation
Apache Mahout

Apache Mahout

Apache Software Foundation
E-MapReduce

E-MapReduce

Alibaba
Amazon EMR

Amazon EMR

Amazon
Apache Spark

Apache Spark

Apache Software Foundation

Categories

Big Data Supported

Categories

Machine Learning Supported

Integrations

Apache HBase Supported
Apache Hive Supported
Apache Spark Supported
Hadoop Supported
AWS Data Exchange Supported
AWS Step Functions Supported
Amazon SageMaker Studio Supported
Immuta Supported
Java Not Supported
MapReduce Not Supported
Okera Supported
Presto Supported
Protegrity Supported
Quorso Supported
R Not Supported
Saagie Supported
Service Center Supported
Tecton Supported
TrustLogix Supported
Unravel Supported

Integrations

Apache HBase Supported
Apache Hive Supported
Apache Spark Supported
Hadoop Supported
AWS Data Exchange Not Supported
AWS Step Functions Not Supported
Amazon SageMaker Studio Not Supported
Immuta Not Supported
Java Supported
MapReduce Supported
Okera Not Supported
Presto Not Supported
Protegrity Not Supported
Quorso Not Supported
R Supported
Saagie Not Supported
Service Center Not Supported
Tecton Not Supported
TrustLogix Not Supported
Unravel Not Supported
Claim Amazon EMR and update features and information
Claim Amazon EMR and update features and information
Claim MLlib and update features and information
Claim MLlib and update features and information