Audience
IT administrators in need of a solution to deploy HPC clusters on AWS to optimize their data-intensive workloads
About AWS ParallelCluster
AWS ParallelCluster is an open-source cluster management tool that simplifies the deployment and management of High-Performance Computing (HPC) clusters on AWS. It automates the setup of required resources, including compute nodes, a shared filesystem, and a job scheduler, supporting multiple instance types and job submission queues. Users can interact with ParallelCluster through a graphical user interface, command-line interface, or API, enabling flexible cluster configuration and management. The tool integrates with job schedulers like AWS Batch and Slurm, facilitating seamless migration of existing HPC workloads to the cloud with minimal modifications. AWS ParallelCluster is available at no additional charge; users only pay for the AWS resources consumed by their applications. With AWS ParallelCluster, you can use a simple text file to model, provision, and dynamically scale the resources needed for your applications in an automated and secure manner.
Other Popular Alternatives & Related Software
Rocky Linux
CIQ empowers people to do amazing things by providing innovative and stable software infrastructure solutions for all computing needs. From the base operating system, through containers, orchestration, provisioning, computing, and cloud applications, CIQ works with every part of the technology stack to drive solutions for customers and communities with stable, scalable, secure production environments. CIQ is the founding support and services partner of Rocky Linux, and the creator of the next generation federated computing stack.
- Rocky Linux, open, Secure Enterprise Linux
- Apptainer, application Containers for High Performance Computing
- Warewulf, cluster Management and Operating System Provisioning
- HPC2.0, the Next Generation of High Performance Computing, a Cloud Native Federated Computing Platform
- Traditional HPC, turnkey computing stack for traditional HPC
Learn more about Rocky Linux
Amazon Elastic Container Service (Amazon ECS)
Amazon Elastic Container Service (Amazon ECS) is a fully managed container orchestration service. Customers such as Duolingo, Samsung, GE, and Cook Pad use ECS to run their most sensitive and mission-critical applications because of its security, reliability, and scalability. ECS is a great choice to run containers for several reasons. First, you can choose to run your ECS clusters using AWS Fargate, which is serverless compute for containers. Fargate removes the need to provision and manage servers, lets you specify and pay for resources per application, and improves security through application isolation by design. Second, ECS is used extensively within Amazon to power services such as Amazon SageMaker, AWS Batch, Amazon Lex, and Amazon.com’s recommendation engine, ensuring ECS is tested extensively for security, reliability, and availability.
Learn more about Amazon Elastic Container Service (Amazon ECS)
Bright Cluster Manager
NVIDIA Bright Cluster Manager offers fast deployment and end-to-end management for heterogeneous high-performance computing (HPC) and AI server clusters at the edge, in the data center, and in multi/hybrid-cloud environments. It automates provisioning and administration for clusters ranging in size from a couple of nodes to hundreds of thousands, supports CPU-based and NVIDIA GPU-accelerated systems, and enables orchestration with Kubernetes. Heterogeneous high-performance Linux clusters can be quickly built and managed with NVIDIA Bright Cluster Manager, supporting HPC, machine learning, and analytics applications that span from core to edge to cloud. NVIDIA Bright Cluster Manager is ideal for heterogeneous environments, supporting Arm® and x86-based CPU nodes, and is fully optimized for accelerated computing with NVIDIA GPUs and NVIDIA DGX™ systems.
Learn more about Bright Cluster Manager
Azure CycleCloud
Create, manage, operate, and optimize HPC and big compute clusters of any scale. Deploy full clusters and other resources, including scheduler, compute VMs, storage, networking, and cache. Customize and optimize clusters through advanced policy and governance features, including cost controls, Active Directory integration, monitoring, and reporting. Use your current job scheduler and applications without modification. Give admins full control over which users can run jobs, as well as where and at what cost. Take advantage of built-in autoscaling and battle-tested reference architectures for a wide range of HPC workloads and industries. CycleCloud supports any job scheduler or software stack—from proprietary in-house to open-source, third-party, and commercial applications. Your resource demands evolve over time, and your cluster should, too. With scheduler-aware autoscaling, you can fit your resources to your workload.
Learn more about Azure CycleCloud
Integrations
Company Information
Amazon
Founded: 1994
United States
aws.amazon.com/hpc/parallelcluster/
Videos and Screen Captures
Other Useful Business Software
Endpoint Management with Remote Control Built In
Save 50% on your first year when you switch from your existing RMM to Splashtop AEM. Automate patching, track inventory, and jump directly into 1-click unattended remote sessions without switching tools.
Product Details
Platforms Supported
Cloud
Training
Documentation
Webinars
In Person
Videos
Support
Phone Support
24/7 Live Support
Online
AWS ParallelCluster Frequently Asked Questions
Q: What kinds of users and organization types does AWS ParallelCluster work with?
AWS ParallelCluster works with these users and organization types: Mid Size Business, Small Business, Enterprise, Freelance, Nonprofit, Government, and Startup.
Q: What languages does AWS ParallelCluster support in their product?
AWS ParallelCluster supports these languages: English.
Q: What kind of support options does AWS ParallelCluster offer?
AWS ParallelCluster offers support via phone support, 24/7 live support, and online.
Q: What other applications or services does AWS ParallelCluster integrate with?
AWS ParallelCluster integrates with: Amazon API Gateway, AWS Batch, AWS EC2 Trn3 Instances, AWS Elastic Fabric Adapter (EFA), AWS HPC, AWS Lambda, AWS Parallel Computing Service, Amazon Web Services (AWS), GitHub, Slurm, and Python.
Q: What type of training does AWS ParallelCluster provide?
AWS ParallelCluster provides training in the form of documentation, webinars, in person, and videos.
