Search Results for "hpc"
Sort By:
Showing 109 open source projects for "hpc"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
-
2
Covalent workflow
Pythonic tool for running machine-learning/high performance workflows
Covalent is a Pythonic workflow tool for computational scientists, AI/ML software engineers, and anyone who needs to run experiments on limited or expensive computing resources including quantum computers, HPC clusters, GPU arrays, and cloud services. Covalent enables a researcher to run computation tasks on an advanced hardware platform – such as a quantum computer or serverless HPC cluster – using a single line of code. Covalent overcomes computational and operational challenges inherent in AI/ML experimentation. -
3
Appfl
Advanced Privacy-Preserving Federated Learning framework
APPFL (Advanced Privacy-Preserving Federated Learning) is a Python framework enabling researchers to easily build and benchmark privacy-aware federated learning solutions. It supports flexible algorithm development, differential privacy, secure communications, and runs efficiently on HPC and multi-GPU setups. -
4
Hermit Kernel
A Rust-based, lightweight unikernel
Hermit Kernel is the core component of HermitCore, a Rust-based unikernel that runs directly on hypervisors or bare-metal systems to support high-performance cloud and HPC applications. This repository contains the microkernel’s implementation, optimized for running Rust applications natively in a lightweight, single-address-space environment. Hermit Kernel is designed to reduce latency and overhead by avoiding traditional OS abstractions, while still providing essential services such as scheduling, memory management, and networking. ... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
AWS ParallelCluster Cookbook
The Chef cookbook used to build and bootstrap AWS ParallelCluster
AWS ParallelCluster is an AWS supported Open Source cluster management tool that makes it easy for you to deploy and manage High Performance Computing (HPC) clusters in the AWS cloud. Built on the Open Source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and a shared filesystem and offers a variety of batch schedulers such as AWS Batch and Slurm. AWS ParallelCluster facilitates both quick start proof of concepts (POCs) and production deployments. ... -
6
libfabric
AWS Libfabric
...Its custom-built operating system (OS) bypass hardware interface enhances the performance of inter-instance communications, which is critical to scaling these applications. With EFA, High Performance Computing (HPC) applications using the Message Passing Interface (MPI) and Machine Learning (ML) applications using NVIDIA Collective Communications Library (NCCL) can scale to thousands of CPUs or GPUs. As a result, you get the application performance of on-premises HPC clusters with the on-demand elasticity and flexibility of the AWS cloud. -
7
AWS ParallelCluster Node
Python package installed on the Amazon EC2 instances
aws-parallelcluster-node is the python package installed on the Amazon EC2 instances launched as part of AWS ParallelCluster. AWS ParallelCluster is an AWS-supported Open Source cluster management tool that makes it easy for you to deploy and manage High-Performance Computing (HPC) clusters in the AWS cloud. Built on the Open Source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and a shared filesystem and offers a variety of batch schedulers such as AWS Batch and Slurm. AWS ParallelCluster facilitates both quick start proof of concepts (POCs) and production deployments. ... -
8
Beta9
Run serverless GPU workloads with fast cold starts on bare-metal
beta9 is a platform that enables running serverless GPU workloads with fast cold starts on bare-metal servers globally. It allows developers to deploy and scale GPU-accelerated applications without managing underlying infrastructure, offering flexibility and efficiency for AI and high-performance computing tasks. beta9 supports various frameworks and provides tools for monitoring and managing deployments effectively. -
9
LAMMPS
Public development project of the LAMMPS MD software package
LAMMPS is a large-scale classical molecular dynamics simulator for modeling atoms, molecules, coarse-grained particles, and other particle-based systems. It is designed for high-performance computing and can run efficiently on desktops, clusters, and supercomputers. The software is widely used in materials science, chemistry, physics, nanotechnology, soft matter, and computational engineering. It supports many interaction models, including pair potentials, many-body potentials, reactive... -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
10
nextflow
A DSL for data-driven computational pipelines
Nextflow is a powerful workflow orchestration tool designed for the development and execution of data-intensive pipelines, especially in the field of bioinformatics. It enables reproducible and portable workflows that can run seamlessly across different environments including local, HPC clusters, and cloud platforms. With support for containers and software package managers, Nextflow makes it easy to define complex data processes using a concise DSL and manage dependencies efficiently. -
11
lockfree
A collection of lock-free data structures written in standard C++11
lockfree is a collection of lock-free data structures written in standard C++11 and suitable for all platforms - from deeply embedded to HPC. Lock-free data structures are data structures that are thread and interrupt-safe for concurrent use without having to use mutual exclusion mechanisms. They are most useful for inter-process communication and often scale much better than lock-based structures with the number of operations and threads. -
12
LFortran
Official main repository for LFortran
LFortran is a modern open-source (BSD licensed) interactive Fortran compiler built on top of LLVM. It can execute the user’s code interactively to allow exploratory work (much like Python, MATLAB or Julia) as well as compile binaries with the goal of running the user’s code on modern architectures such as multi-core CPUs and GPUs. LFortran is in alpha (it is expected to not work on third-party codes and users enthusiastically participate in bug reporting and fixing). -
13
DifferentialEquations.jl
Multi-language suite for high-performance solvers of equations
...The well-optimized DifferentialEquations solvers benchmark as some of the fastest implementations, using classic algorithms and ones from recent research which routinely outperform the “standard” C/Fortran methods, and include algorithms optimized for high-precision and HPC applications. At the same time, it wraps the classic C/Fortran methods, making it easy to switch over to them whenever necessary. Solving differential equations with different methods from different languages and packages can be done by changing one line of code, allowing for easy benchmarking to ensure you are using the fastest method possible. -
14
Perceval
An open source framework for programming photonic quantum computers
An open-source framework for programming photonic quantum computers. Through a simple object-oriented Python API, Perceval provides tools for composing circuits from linear optical components, defining single-photon sources, manipulating Fock states, running simulations, reproducing published experimental papers and experimenting with a new generation of quantum algorithms. It aims to be a companion tool for developing photonic circuits – for simulating and optimizing their design, modeling... -
15
OrdinaryDiffEq.jl
High performance ordinary differential equation (ODE)
...The well-optimized DifferentialEquations solvers benchmark as some of the fastest implementations, using classic algorithms and ones from recent research that routinely outperform the “standard” C/Fortran methods, and include algorithms optimized for high-precision and HPC applications. At the same time, it wraps the classic C/Fortran methods, making it easy to switch over to them whenever necessary. Solving differential equations with different methods from different languages and packages can be done by changing one line of code, allowing for easy benchmarking to ensure you are using the fastest method possible. -
16
Unified Communication X
Communication framework for data-centric high-performance applications
Accelerate Your Network Performance with UCX. Collaboration between industry, laboratories, and academia to create an open-source, production-grade communication framework for data-centric and high-performance applications. Unified Communication X (UCX) is an award winning, optimized production proven communication framework for modern, high-bandwidth and low-latency networks. UCX exposes a set of abstract communication primitives which utilize the best of available hardware resources and... -
17
FortranBSD
FortranBSD is DragonflyBSD-based OS with built-in GNU Fortran
I'm excited to introduce the first release of FortranBSD, a new operating system designed specifically for Fortran developers who demand high-performance and seamless multithreading support. FortranBSD is based on DragonflyBSD which is an outstanding OS for HPC application and: 🔹 Superior parallel computing capabilities beat Linux/MS Windows over the performance. 🔹 Optimized for Fortran programming 🔹 Built on a robust, efficient foundation 🔹 Ideal for scientific computing, simulations, and high-performance Computation (HPC) applications FortranBSD is a game-changer for anyone working with Fortran who wants an OS that fully supports and enhances multithreaded execution. ... -
18
GCMT
Gentoo Cluster Managment Tools
A collection of bash scripts to manage Gentoo System Images (GSIs), compute nodes, file servers and users on a Gentoo-based HPC cluster. GCMT works with PXE boot, dhcp, tftp, qmail, djbdns and tinydns, NIS, NFS, and TORQUE. -
19
oxiida
A DSL for scientific workflow construction.
... - `oxiida` supports construct and run tasks/jobs with different timespan from seconds to months. - `oxiida` supports run tasks/jobs on local machine, cloud or HPC. - `oxiida` has native support for Workflow Definition Language (WDL). - `oxiida` as a language can embed into Python, Julia and Lua to powerup and standard your current workflow setup. -
20
GASNet is a language-independent, networking middleware layer that provides network-independent, high-performance communication primitives including Remote Memory Access (RMA) and Active Messages (AM). It has been used to implement parallel programming models and libraries such as UPC, UPC++, Co-Array Fortran, Legion, Chapel, and many others.
-
21
UNICORE
UNiform Interface to COmputing and data REsources
UNICORE is a software suite for building federated systems, providing secure and seamless access to heterogeneous resource such as compute clusters and file systems. UNICORE deals with authentication, user mapping and authorization, and provides a comprehensive set of RESTful APIs for HPC access and workflows. Contributors: visit https://github.com/UNICORE-EU -
22
Kaleidoscope-SDK
User toolkit for analyzing and interfacing with Large Language Models
kaleidoscope-sdk is a Python module used to interact with large language models hosted via the Kaleidoscope service available at: https://github.com/VectorInstitute/kaleidoscope. It provides a simple interface to launch LLMs on an HPC cluster, asking them to perform basic features like text generation, but also retrieve intermediate information from inside the model, such as log probabilities and activations. Users must authenticate using their Vector Institute cluster credentials. This can be done interactively instantiating a client object. This will generate an authentication token that will be used for all subsequent requests. ... -
23
Thrust
The C++ parallel algorithms library
...It also provides a number of general-purpose facilities similar to those found in the C++ Standard Library. The NVIDIA C++ Standard Library is an open-source project; it is available on GitHub and included in the NVIDIA HPC SDK and CUDA Toolkit. If you have one of those SDKs installed, no additional installation or compiler flags are needed to use libcu++. Thrust is a header-only library; there is no need to build or install the project unless you want to run the Thrust unit tests. -
24
T81 558
Applications of Deep Neural Networks
...Application of these architectures to computer vision, time series, security, natural language processing (NLP), and data generation will be covered. High-Performance Computing (HPC) aspects will demonstrate how deep learning can be leveraged both on graphical processing units (GPUs), as well as grids. -
25
Singularity
Open source container platform designed to be simple, fast, and secure
Singularity is an open-source container platform designed to be simple, fast, and secure. Many container platforms are available, but Singularity is designed for ease of use on shared systems and in high-performance computing (HPC) environments.
