Search Results for "cluster computing"
Sort By:
Showing 87 open source projects for "cluster computing"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
1
Kraken
P2P Docker registry capable of distributing TBs of data in seconds
Kraken is a P2P-powered Docker registry that focuses on scalability and availability. It is designed for Docker image management, replication, and distribution in a hybrid cloud environment. With pluggable backend support, Kraken can easily integrate into existing Docker registry setups as the distribution layer. Kraken has been in production at Uber since early 2018. In our busiest cluster, Kraken distributes more than 1 million blobs per day, including 100k 1G+ blobs. At its peak... -
2
Java Multiprocessing
Java explicit multiprocessing, SSI and cluster management tool
â–ª JMP library allows to do multiprocessing in Java with a simple API that resembles Java multithreading. JMP allows running a piece of Java code on a separate process either locally or on remote machine. â–ª If the code in question is not present on the target machine, it can be dynamically uploaded. â–ª JMP allows setting affinity for a new process explicitly instead of relying on the OS. â–ª JMP also contains a simple cluster management / load balancing tool called JMP node. â–ª JMP = SSI +... -
3
dispy
Distributed and Parallel Computing with/for Python.
dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing. -
4
GPU, a Global Processing Unit
A framework for distributed computing
An extensible framework for distributed computing on P2P grids. We support peaceful free and open research and build an internet supercomputer. We render movies, solve Eternity puzzles, predict climate and improve a ~30 GHz cluster of clients. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
SAFMQ: Store and Forward Message Queue, message oriented middleware. Uses include Assured Async Messaging, SOA, Delayed/Batch, and Cluster/Grid Computing. The SAFMQ server provides cross platform communication among C++, PHP, Java, and .NET clients.
-
6
A framework to run MATLAB programs as batch jobs. Features a structured input description, integrity constraints and GUI.Independent parts of a job can execute in parallel on a cluster computer. Developed at Freiburg Brain Imaging (FBI) - http://fbi.uniklinik-freiburg.de/
-
7
Postgres-XL is a PostgreSQL-based scale-out cluster that handles both OLTP write intensive workloads as well as OLAP/BI type of workloads thanks to MPP parallelism. Postgres-XL is fully ACID and supports cluster-wide Multi-version Concurrency Control (MVCC) for global consistency and performance. There are commercial companies such as 2ndQuadrant, who provide support and consulting around Postgres-XL. Please visit http://2ndquadrant.com/en/resources/postgres-xl/ for more details.
-
8
Moscrack is a perl application designed to facilitate cracking WPA keys on a cluster of computers. This is accomplished with any one of Mosix clustering software, ssh, rsh or Pyrit connectivity to nodes. Cluster nodes can run any Un*x variant (includ
-
9
OpenSearchServer Store
A file server with a RESTFul web service.
An open source (Apache 2 license) file server software with a RESTFul web service for file management in a cluster of nodes. Including 4 set of API - Store API: Upload, download files and directories - Process API: Managing the long term process runs - Glacier API: Uploading from the server to Glacier - Cluster API: Manage the nodes in the cluster -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
10
glusterfs-roll
Glusterfs filesystem for Rocks Cluster
Glusterfs is a high performance filesystem from Red Hat. This Roll integrates Glusterfs in Rocks -
11
lustre-roll
lustre client roll for rocks clusters
This roll provides rpm packages to mount the lustre filesystem on the frontends and compute nodes of a rocks cluster. Please contact me if you need this roll for another kernel and/or lustre version. -
12
These are 2 OS definitions and a scheduler script that are designed for the full virtualization of linux and windows systems on Ganeti. They works good on my KVM-based production environment and provides all that you need in order to create, backup and restore instances. Note: I was told that it works pretty good even under XEN hypervisor.
-
13
neuranep
Neural Network Engineering Platform
A parallel-programming framework for concurrently running large numbers of small autonomous jobs, or microthreads, across multiple cores in a CPU or CPUs in a cluster. NeuraNEP emulates a distributed processing environment capable of handling millions of microthreads in parallel, for example running neural networks with millions of spiking cells. Microthreads are general processing elements that can also represent non-neural elements, such as cell populations, extracellular space, emulating... -
14
XCPU is a suite of tools for cluster management. It includes utilities for job starting, cluster resource management, scalable distribution of boot images as well as creation and control of virtual machines in a cluster environment.
-
15
MediaEncodingCluster is an Enterprise Class, Video Cluster Environment with a Plattform Independent Client - Server Architecture for distributed video/audio converting/encoding tool over a grid Computing Network Design. more on http://docs.codergrid.de
-
16
C.H.A.O.S. Linux
C.H.A.O.S. is a Linux distro made for clusters.
C.H.A.O.S. Linux is a distribution based on the Arch Linux operating system. It's a cluster oriented OS that does not providea graphical environment. Being based on standard Arch releases, this distro supports both i686 and x86_64 architectures. C.H.A.O.S. was created with a fixed main purpose: let admins get their cluster running in almost no time; despite having to manually install it on every node, the built-in textual installer will automate most of the process. More informations at... -
17
TaskManager
TaskManager manages calculation jobs in a computer cluster environment
TaskManager is an open source infrastructure software for distributing and managing calculation jobs in a Unix computer cluster environment. The TaskManager was designed to control the utilization of a set of hosts even if you are not the administrator of the system. The hosts are embedded in a Unix environment and the user's home directories are mounted on each host. The hosts may have different numbers of CPUs/cores and different kernels. Keep in mind that a user is able to log into each... -
18
RainforestCluster
Dynamically manage Amazon EC2 clusters
RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any... -
19
ThunderstormDistributor
Distribute jobs to compute nodes on dynamic clusters
ThunderstormDistributor is a queuing system that distributes jobs and computational workload across dynamic clusters in the cloud. It manages the assignment of jobs to maximize CPU and memory usage and prevent oversubscription of compute nodes. It also performs advanced statistics collection on individual compute nodes and jobs to graph the distribution of disk, network, CPU, and memory usage over time, which facilitates the advanced optimization and tuning of computational workflows. -
20
Phoenix Cluster Project is an open cluster architecture. It is built using Gentoo Linux with RootFS shared between all nodes of the cluster. The main components are: Torque/Maui, Network Raid, Ganglia, LAMP Platform, KVM and GLSL for GPGPU.
-
21
PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.
-
22
Kepler Monitoring
Kepler is a monitoring system for HPC clusters
Kepler is a monitoring system for HPC clusters : it allows users to monitor cluster elements like nodes, network devices and storage nodes. Analyse can be centered on jobs to determine performances and behaviours. -
23
HADOS
High Availability Distributed Object Storage
HADOS is a server software for storing files in a cluster of server. The goal is to handle high availability by storing copy of the same file on several nodes. HADOS provides RESTFUL APIs to easily store, check or retrieve files. Using the powerful cluster APIs you can retrieve the files whatever the node that hosts it. To avoid any single point of failure, it is possible to apply a request to any node of the cluster, there is no master node. -
24
gossimon
Cluster Monitoring tool using gossip mechanisem
Gossip based distributed information monitoring system for a cluster of Linux nodes. The package includes a daemon to run on every node of the cluster and client programs for obtaining and displaying information about all nodes -
25
SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability for MPI codes.