Search Results for "cluster"
Sort By:
Showing 45 open source projects for "cluster"
View related business solutions-
Ship AI Apps Faster with Vertex AIShip AI apps and features faster with Vertex AI—your end-to-end AI platform. Access Gemini 3 and 200+ foundation models, fine-tune for your needs, and deploy with enterprise-grade MLOps. Build chatbots, agents, or custom models. New customers get $300 in free credit.
-
Cut Cloud Costs with Google Compute EngineSave on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
-
1
Kubespray
Deploy a Production Ready Kubernetes Cluster
...To ensure auto-updates don't break your cluster look into e.g. yum version lock plugin or apt pin). The target servers must have access to the Internet in order to pull docker images. Otherwise, additional configuration is required. The target servers are configured to allow IPv4 forwarding. If using IPv6 for pods and services, the target servers are configured to allow IPv6 forwarding. -
2
sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
...Ability to capture the output of SQL queries as Pandas dataframes to interact with other Python libraries (e.g. matplotlib). Send local files or dataframes to a remote cluster (e.g. sending pretrained local ML model straight to the Spark cluster) Authenticate to Livy via Basic Access authentication or via Kerberos. -
3
Genv
GPU environment management and cluster orchestration
Genv is an open-source environment and cluster management system for GPUs. Genv lets you easily control, configure, monitor and enforce the GPU resources that you are using in a GPU machine or cluster. It is intended to ease up the process of GPU allocation for data scientists without code changes. -
4
Roxy-WI
Web interface for managing Haproxy, Nginx, Apache and Keepalived
For those who need a convenient interface for managing all services in one place. Roxy-WI was created for people who want to have a fault-tolerant infrastructure, but do not want to plunge deep into the details of setting up and creating a cluster based on HAProxy, NGINX, Apache, and Keepalived. Use Roxy-WI to build a high available cluster for a couple of clicks: install HAProxy, NGINX, Apache, Keepalived, and its exporters, and carry out the initial configuration for the services. Collect download statistics in one place. Choose one of the three available monitoring options or use them all. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Robusta
Kubernetes observability and automation
Keep your Kubernetes microservices up and running. Connect your existing Prometheus, gain 360° observability. Robusta is both an automation engine for Kubernetes and a multi-cluster observability platform. Robusta is commonly used alongside Prometheus, but other tools are supported too. By listening to all the events in your cluster, Robusta can tell you why alerts fired, what happened at the same time, and what you can do about it. Robusta can either improve your existing alerts or be used to define new alerts triggered by APIServer changes. -
6
Kubez-ansible
To provide quick deployment tools for kubernetes cluster
To provide quick deployment tools for Kubernetes cluster and cloud-native applications. This session has been tested on Rocky 8.5, Debian 11, and Ubuntu 20.04+ which are supported by python3. -
7
MicroK8s
Single-package Kubernetes for developers, IoT and edge
Low-ops, minimal production Kubernetes, for devs, cloud, clusters, workstations, Edge and IoT. MicroK8s automatically chooses the best nodes for the Kubernetes datastore. When you lose a cluster database node, another node is promoted. No admin needed for your bulletproof edge. MicroK8s is small, with sensible defaults that ‘just work’. A quick install, easy upgrades and great security make it perfect for micro clouds and edge computing. As the publishers of MicroK8s, we deliver the world’s most efficient multi-cloud, multi-arch Kubernetes. ... -
8
Android Emulator Container Scripts
Minimal scripts to run the emulator in a container for various systems
...The project focuses on reproducibility and scale: you define which system image to boot, how to persist or reset data, and how many instances to run, then schedule them like any other workload. GPU acceleration, audio, and sensors can be enabled depending on your host and cluster capabilities, while fallbacks like SwiftShader keep things usable when no GPU is available. -
9
AWS ParallelCluster Node
Python package installed on the Amazon EC2 instances
aws-parallelcluster-node is the python package installed on the Amazon EC2 instances launched as part of AWS ParallelCluster. AWS ParallelCluster is an AWS-supported Open Source cluster management tool that makes it easy for you to deploy and manage High-Performance Computing (HPC) clusters in the AWS cloud. Built on the Open Source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and a shared filesystem and offers a variety of batch schedulers such as AWS Batch and Slurm. ... -
Cut Data Warehouse Costs up to 54% with BigQueryBigQuery delivers up to 54% lower TCO than cloud alternatives. Migrate from legacy or competing warehouses using free BigQuery Migration Service with automated SQL translation. Get serverless scale with no infrastructure to manage, compressed storage, and flexible pricing—pay per query or commit for deeper discounts. New customers get $300 in free credit.
-
10
Datahosting ipfs kubo-cluster
Managed IPFS Kubo pinning with IPFS Cluster replication
This project provides an open-source setup for IPFS Kubo (public and private pinning) combined with IPFS Cluster replication, designed for reliable, production-ready decentralized storage. It is suitable for developers, infrastructure operators, and Web3 projects that need predictable IPFS availability without maintaining complex node infrastructure. The system supports multiple retention plans for IPFS Kubo pinning, allowing users to choose how long data remains pinned, with transparent pay-per-GB prepaid pricing. ... -
11
KubiScan
A tool to scan Kubernetes cluster for risky permissions
A tool for scanning Kubernetes cluster for risky permissions in Kubernetes's Role-based access control (RBAC) authorization model. KubiScan helps cluster administrators identify permissions that attackers could potentially exploit to compromise the clusters. This can be especially helpful on large environments where there are lots of permissions that can be challenging to track. -
12
Spilo
Highly available elephant herd: HA PostgreSQL cluster using Docker
Spilo is a Docker-based HA PostgreSQL cluster built on Patroni and heavily optimized for Kubernetes environments. It includes components for failover, streaming replication, backups, and connection pooling. Spilo is used in production by Zalando and is designed to provide a resilient, self-healing Postgres cluster with minimal manual intervention. -
13
ceph-ansible
Ansible playbooks to deploy Ceph, the distributed filesystem
...After you’ve cloned the ceph-ansible repository, selected your branch and installed Ansible then you’ll need to create your inventory file, playbook and configuration for your Ceph cluster. The Ansible inventory file defines the hosts in your cluster and what roles each host plays in your Ceph cluster. The default location for an inventory file is /etc/ansible/hosts but this file can be placed anywhere and used with the -i flag of ansible-playbook. You must have a playbook to pass to the ansible-playbook command when deploying your cluster. ... -
14
dispy
Distributed and Parallel Computing with/for Python.
dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing. -
15
sty-pub-raspi-modbus-drivers
modbus python scripts for rs485 devices, RTU and TCP
...Some files come from history beginnings and others have a higher level of abstraction where it becomes simple to add a new device with given documentation. You'll find basically SMA cluster controller, SMA inverter manager, SMA inverters, Schneider meter, Adtek meter, ABB inverters. See readme for more informations -
16
DeepCluster
Deep Clustering for Unsupervised Learning of Visual Features
DeepCluster is a classic self-supervised clustering-based representation learning algorithm that iteratively groups image features and uses the cluster assignments as pseudo-labels to train the network. In each round, features produced by the network are clustered (e.g. k-means), and the cluster IDs become supervision targets in the next epoch, encouraging the model to refine its representation to better separate semantic groups. This alternating “cluster & train” scheme helps the model gradually discover meaningful structure without labels. ... -
17
pyspider
A powerful Spider(Web Crawler) system in Python
...Since pyspider has various components, you can just run pyspider to start a standalone and third service free instance. Or using MySQL or MongoDB and RabbitMQ to deploy a distributed crawl cluster. To deploy pyspider in product environment, running component in each process and store data in database service is more reliable and flexible. To deploy pyspider components in each single processes, you need at least one database service. pyspider now supports MySQL, MongoDB and PostgreSQL. You can choose one of them. -
18
-
19
Manage node sets, node groups and execute commands on cluster nodes in parallel. Provides an event-based Python library to improve administration of large compute clusters or server farms. Command line tools: clush and nodeset included.
-
20
Unified Cluster
Run bioinformatic task on supercomputers
The web bases system that allows one user register himself in web interface and run bioinformatic tasks on multiple clusters. -
21
TaskManager
TaskManager manages calculation jobs in a computer cluster environment
...However, he should use the TaskManager to submit calculation jobs to the cluster to avoid an overload of the hosts. Jobs which are under the control of the TaskManager are executed on a host of the computer cluster with the rights of the respective user to ensure that the executing jobs have the permission to access the user's files. -
22
Hierarchical cluster engine HCE
Hierarchical Cluster Engine project
The main idea of this project – to implement the solution that can be used to: construct custom network mesh or distributed network cluster structure with several relations types between nodes, formalize the data flow processing goes from upper node level central source point to down nodes and backward, formalize the management requests handling from multiple source points, support native reducing of multiple nodes results (aggregation, duplicates elimination, sorting and so on), internally support powerful full-text search engine and data storage, provide transactions-less and transactional requests processing, support flexible run-time changes of cluster infrastructure, have many languages bindings for client-side integration APIs in one product build on C++ language... ... -
23
RainforestCluster
Dynamically manage Amazon EC2 clusters
...It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. Originally it was developed as a different version for the Wall Lab at Harvard CBMI. -
24
PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.
-
25
CIMHA is aimed to create integrated suite to provision and manage HA clusters in virtual environment. It analyzes kernel/hardware health of cluster nodes by using VESPER(linux kernel prober) and migrates the Resources based on probe signals.
