Search Results for "mpi"
Sort By:
Showing 219 open source projects for "mpi"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
MPI.jl
MPI wrappers for Julia
This is a basic Julia wrapper for the portable message-passing system Message Passing Interface (MPI). Inspiration is taken from mpi4py, although we generally follow the C and not the C++ MPI API. (The C++ MPI API is deprecated.) MPI is based on a single program, multiple data (SPMD) model, where multiple processes are launched running independent programs, which then communicate as necessary via messages. As the main entry point for users, MPI.jl provides a high-level interface which loosely follows the MPI C API and is described in details in the following sections. ... -
2
ImplicitGlobalGrid.jl
Distributed parallelization of stencil-based GPU and CPU applications
...It renders the distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid almost trivial and enables close to ideal weak scaling of real-world applications on thousands of GPUs [1, 2, 3]. ImplicitGlobalGrid relies on the Julia MPI wrapper (MPI.jl) to perform halo updates close to hardware limit and leverages CUDA-aware or ROCm-aware MPI for GPU-applications. The communication can straightforwardly be hidden behind computation [1, 3] (how this can be done automatically when using ParallelStencil.jl is shown in; a general approach particularly suited for CUDA C applications is explained in. -
3
Likwid
Performance monitoring and benchmarking suite
Likwid is a simple to install and use toolsuite of command line applications and a library for performance oriented programmers. It works for Intel, AMD, ARMv8 and POWER9 processors on the Linux operating system. There is additional support for Nvidia and AMD GPUs. There is support for ARMv7 and POWER8/9 but there is currently no test machine in our hands to test them properly. -
4
DL_POLY
General purpose classical molecular dynamics (MD) simulation software
...It has evolved from older replicated-memory designs into a distributed-memory code suitable for modern parallel computing. The software can be built in serial form or with MPI for larger simulations. It is used for molecular modeling in chemistry, physics, materials science, and condensed-matter research. DL_POLY provides a mature simulation environment for studying atomic and molecular systems under classical force-field descriptions. Its main value is offering a long-running, research-grade MD package with a strong focus on parallel execution and general scientific use. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
RM3 Engine Multi Platform Interface is an open source interface in development for easy integration of the RM3 Engine product by Capgemini. The RM3 Engine is a piece of software written in Java, which calculates promotions for POS applications. More info can be found at https://web.archive.org/web/20220425075602/https://www.capgemini.com/service/retail-mix-match-module-rm3/
-
6
Kubeflow Trainer
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
...The platform supports a wide range of machine learning frameworks, including PyTorch, JAX, Hugging Face, DeepSpeed, and XGBoost, making it highly flexible for different AI use cases. One of its key innovations is the integration of MPI-based distributed computing within Kubernetes, allowing efficient communication between nodes for high-performance training. It also includes advanced scheduling capabilities through integrations with tools like Kueue and Volcano, enabling topology-aware resource allocation and multi-cluster job orchestration. -
7
Volcano
A Cloud Native Batch System (Project under CNCF)
...It provides a suite of mechanisms that are commonly required by many classes of batch & elastic workload including machine learning/deep learning, bioinformatics/genomics, and other "big data" applications. These types of applications typically run on generalized domain frameworks like TensorFlow, Spark, Ray, PyTorch, MPI, etc, which Volcano integrates with. Volcano builds upon a decade and a half of experience running a wide variety of high-performance workloads at scale using several systems and platforms, combined with best-of-breed ideas and practices from the open-source community. Until June 2021, Volcano has been widely used around the world at a variety of industries such as Internet/Cloud/Finance/ Manufacturing/Medical. ... -
8
Kubeflow Training Operator
Distributed ML Training and Fine-Tuning on Kubernetes
Kubeflow Training Operator is a Kubernetes-native project for fine-tuning and scalable distributed training of machine learning (ML) models created with various ML frameworks such as PyTorch, TensorFlow, XGBoost, MPI, Paddle, and others. -
9
Appfl
Advanced Privacy-Preserving Federated Learning framework
APPFL (Advanced Privacy-Preserving Federated Learning) is a Python framework enabling researchers to easily build and benchmark privacy-aware federated learning solutions. It supports flexible algorithm development, differential privacy, secure communications, and runs efficiently on HPC and multi-GPU setups. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
libfabric
AWS Libfabric
...Its custom-built operating system (OS) bypass hardware interface enhances the performance of inter-instance communications, which is critical to scaling these applications. With EFA, High Performance Computing (HPC) applications using the Message Passing Interface (MPI) and Machine Learning (ML) applications using NVIDIA Collective Communications Library (NCCL) can scale to thousands of CPUs or GPUs. As a result, you get the application performance of on-premises HPC clusters with the on-demand elasticity and flexibility of the AWS cloud. -
11
FFTW++ is a C++ header class for the FFTW Fast Fourier Transform library that automates memory allocation, alignment, planning, wisdom, and communication on both serial and parallel (OpenMP/MPI) architectures. In 2D and 3D, hybrid dealiasing of convolutions substantially reduces memory usage and computation time. Wrappers for C, Python, and Fortran are included.
-
12
ceenv
Computer Experiment Environment
...It is being developed and distributed as a training environment of UNIX (UNIX commands, network, Emacs, Gnuplot), programming language (C, C++, Fortran, Python 2/3, MPI, OpenMP, BLAS/LAPACK), etc. The whole environment is included in one VirtualBox virtual disk image, and users can use it immediately by simply importing the image into VirtualBox. -
13
PelicanHPC is an iso-hybrid (CD or USB) image that let's you set up a high performance computing cluster in a few minutes. A Pelican cluster allows you to do parallel computing using MPI. You can run Pelican on a single multiple core machine to use all cores to solve a problem, or you can network multiple computers together to make a cluster. The frontend node (either a real computer or a virtual machine) boots from the image. The compute nodes boot by PXE, using the frontend node as the server. All of the nodes of the cluster get their filesystems from the same image, so it is guaranteed that all nodes run the the same software. ...
-
14
Hex
Hydrogen-Electron Collisions
A computer code for simulation of electron-hydrogen scattering. Contains three (more or less) finished sub-programs: (a) “hex-ecs” which solves the Schrödinger equation in the B-spline basis, (b) “hex-dwba” which computes scattering variables for high energies using the distorted wave Born approximation of the first order and finally (c) “hex-db” which is a user interface to a plain SQLite database, where the intermediate results are being stored, and which is used to extract... -
15
SAGECAL
GPU/MIC accelerated radio interferometric calibration program
...It can calibrate along hundreds of directions without running out of memory in almost real time. Intel Xeon Phi acceleration is also available. Distributed calibration using MPI and consensus optimization is enabled. Also tools to build/restore sky models are included. -
16
SWAN is a third-generation wave model, developed at Delft University of Technology, that computes random, short-crested wind-generated waves in coastal regions and inland waters.
-
17
DAE Tools Project
Object-oriented equation-based modelling and optimisation software
DAE Tools is a cross-platform equation-based object-oriented modelling, simulation and optimisation software. It is not a modelling language nor a collection of numerical libraries but rather a higher level structure – an architectural design of interdependent software components providing an API for: - Model development/specification - Activities on developed models, such as simulation, optimisation, sensitivity analysis and parameter estimation - Processing of the results, such as... -
18
Classdesc is a system for adding reflection to C++, ie the ability to query an object's structure at runtime.
-
19
SUNTANS
Unstructured-grid, nonhydrostatic ocean model
The Stanford unstructured-grid, nonhydrostatic, parallel coastal ocean model. For simulation of nonhydrostatic flows at high resolution in estuaries and coastal seas. Requires a grid generator and ParMETIS (if run in parallel). -
20
CPSeis is the open-source version of ConocoPhillips' former seismic processing system. Uses Fortran 90 and C/C++ layers for I/O. The new system was designed using an MPI-parallel model and works well on Linux clusters or on individual workstations.
-
21
ParDRe
Parallel tool to remove duplicate DNA reads
...This tool will let the users to avoid the analysis of not necessary reads, reducing the time of subsequent procedures with the dataset (e.g., assemblies, mappings, etc.). The tool is implemented with MPI in order to exploit the parallel capabilities of multicore clusters. It is faster than multithreaded counterparts (end of 2015) for the same number of cores and, thanks to the message-passing technology, it can be executed on clusters. There also exists a MapReduce counterpart of ParDRe, called MarDRe (see the link above). ... -
22
SWASH is a general-purpose numerical tool for simulating unsteady, non-hydrostatic, free-surface, rotational flow and transport phenomena in coastal waters as driven by waves, tides, buoyancy and wind forces. It provides a general basis for describing wave transformations from deep water to a beach, port or harbour, complex changes to rapidly varied flows, and density driven flows in coastal seas, estuaries, lakes and rivers.
-
23
Evolutionary Computation Framework
C++ framework for application of any type of evolutionary computation.
ECF is a framework intended for application of any type of evolutionary computation (GA/GP, DE, Clonalg, ES, PSO, ABC, GAn, local search...). It offers simplicity for the end-user (parameterless usage, tutorial) and customization for experienced EC practicioners. -
24
BoxMG4WRF
The BoxMG elliptic equation solver for WRF
...It has been updated to allow single-precision solutions and is posted here for use with an upcoming release of WRF (Weather Research and Forecasting) model including storm electrification. Only runs under MPI at this time (i.e., no SMP/OpenMP support). The code here is not actively developed and is provided solely for use with WRF to support the WRF_ELEC storm electrification option. Supported architectures are Intel/AMD processors under Linux or OS X. -
25
Computational electromagnetics software. Uses surface Method of Moments, enhanced by using the Multilevel Fast Multipole Method. Code is parallelized and runs on laptops, desktops and clusters. The code precision is adjustable, it is fast and uses little memory. CFIE is used for closed surfaces, and EFIE for open PEC surfaces. Can function on GMSH, GiD and ANSYS meshes.
