Search Results for "partitioning"
Sort By:
Showing 137 open source projects for "partitioning"
View related business solutions-
Gemini 3 and 200+ AI Models on One PlatformBuild, govern, and optimize agents and models with Gemini Enterprise Agent Platform.
-
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
1
pg_partman
Partition management extension for PostgreSQL
pg_partman is a PostgreSQL extension for managing time-based and serial-based table partitioning. It automates the creation, maintenance, and retention of partitions, making it easier to manage large datasets with better performance and query efficiency. Designed for both native and trigger-based partitioning, pg_partman is ideal for applications handling time-series or log data. -
2
yabai
A tiling window manager for macOS based on binary space partitioning
yabai is a tiling window manager for macOS that extends the native windowing system with fully scriptable command-line control. It uses a binary space partitioning algorithm to auto-tile windows, supports extensive keyboard shortcut mapping (via skhd), and enhances productivity for power users. -
3
hekate
A GUI based Nintendo Switch Bootloader
...The bootloader features a touchscreen-enabled graphical user interface called Nyx, allowing users to navigate options, manage configurations, and execute tools directly from the device. It provides advanced storage management capabilities such as backing up and restoring eMMC data, managing emulated NAND environments, and partitioning SD cards for multiple operating systems. hekate also includes utilities for hardware diagnostics, benchmarking, and system inspection, offering detailed insights into device components like memory, battery, and storage. -
4
Easy GPU PV
A Project dedicated to making GPU Partitioning on Windows easier
Easy-GPU-PV is an open-source project that automates the relatively complex steps required to set up GPU Paravirtualization (GPU-PV) on Windows Hyper-V, letting you partition a physical GPU and assign slices to virtual machines for low-latency remote use. It creates and installs a Windows VM, copies the necessary GPU-PV driver files into the VM, and helps install Parsec (an ultra-low-latency remote-desktop client) so you can connect to the VM at high framerates. The repo is practical and... -
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
5
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
6
Infinispan
Infinispan is an open source data grid platform
Infinispan is a distributed in-memory data grid and caching system designed for high-performance computing. It allows applications to scale dynamically by distributing data across multiple nodes, reducing latency and improving resilience. -
7
DLRM
An implementation of a deep learning recommendation model (DLRM)
...The architecture combines dense (MLP) and sparse (embedding) branches, then interacts features via dot product or feature interactions before passing through further dense layers to predict click-through, ranking scores, or conversion probabilities. The implementation is optimized for performance at scale, supporting multi-GPU and multi-node execution, quantization, embedding partitioning, and pipelined I/O to feed huge embeddings efficiently. It includes data loaders for standard benchmarks (like Criteo), training scripts, evaluation tools, and capabilities like mixed precision, gradient compression, and memory fusion to maximize throughput. -
8
Arch Installer
Arch Linux installer - guided, templates etc.
Just another guided/automated Arch Linux installer with a twist. The installer also doubles as a python library to install Arch Linux and manage services, packages, and other things inside the installed system (Usually from a live medium). -
9
exo
Run your own AI cluster at home with everyday devices
Run your own AI cluster at home with everyday devices. Maintained by exo labs. Forget expensive NVIDIA GPUs, unify your existing devices into one powerful GPU, iPhone, iPad, Android, Mac, Linux, or pretty much any device. Now the default models, run 8B, 70B, and 405B parameter models on your own devices. -
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Resurrecting Project in LinUtil
Automated Arch Linux Install
Resurrecting Project in LinUtil is an automated Arch Linux installation project created by Chris Titus that wraps Arch’s traditionally manual install process in a guided script. It aims to make Arch more approachable by handling tasks like disk partitioning, base system installation, and desktop environment selection through a menu-driven interface. The repository includes configuration presets and scripts that not only install the system but also set up a curated software stack and sensible defaults. Over time, the project evolved and was eventually archived in favor of a newer, streamlined Arch install script, but ArchTitus remains available as a reference for its original approach. ... -
11
Redis
An in-memory database that persists on disk
...Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. You can run atomic operations on these types, like appending to a string; incrementing the value in a hash; pushing an element to a list; computing set intersection, union and difference; or getting the member with highest ranking in a sorted set. To achieve top performance, Redis works with an in-memory dataset. ... -
12
Spring Batch
Spring Batch is a framework for writing batch applications using Java
...Spring Batch provides reusable functions that are essential in processing large volumes of records, including logging/tracing, transaction management, job processing statistics, job restart, skip, and resource management. It also provides more advanced technical services and features that will enable extremely high-volume and high performance batch jobs through optimization and partitioning techniques. Simple as well as complex, high-volume batch jobs can leverage the framework in a highly scalable manner to process significant volumes of information. -
13
AWS SDK for pandas
Easy integration with Athena, Glue, Redshift, Timestream, Neptune
...With a few lines of code, you can read from and write to Amazon S3 in Parquet/CSV/JSON/ORC, register tables in the AWS Glue Data Catalog, and query with Amazon Athena directly into pandas. The library abstracts efficient patterns like partitioning, compression, and vectorized I/O so you get performant data lake operations without hand-rolling boilerplate. It also supports Redshift, OpenSearch, and other services, enabling ETL tasks that blend SQL engines and Python transformations. Operational helpers handle IAM, sessions, and concurrency while exposing knobs for encryption, versioning, and catalog consistency. ... -
14
pgstream
PostgreSQL replication with DDL changes
pgstream is an open source CDC command-line tool and library that offers Postgres replication support with DDL changes to any provided output. One of the main differentiators of pgstream is the fact that it tracks and replicates schema changes automatically. It relies on SQL triggers that will populate a Postgres table (pgstream.schema_log) containing a history log of all DDL changes for a given schema. Whenever a schema change occurs, this trigger creates a new row in the schema log table... -
15
YugabyteDB
The high-performance distributed SQL database for global apps
...Achieve continuous availability during infrastructure failures and on maintenance tasks such as software upgrades and distributed backups. Use powerful replication and data geo-partitioning capabilities to achieve the latency, resilience, and compliance your applications need. Deploy YugabyteDB in public, private, and hybrid cloud environments, on VMs, containers, or bare metal. Lower TCO for dev, staging, and production deployments. Powering a wide range of cloud-native workloads. Risk-free migration from on-prem to the cloud. -
16
Magnetic tape partitioning tool
command line tool to partition LTO-5+ tapes
This little shell script can create partitions on an LTO-5+ tape. LTO-5 tapes can hold 2 partitions, LTO-6+ tapes can hold up to 4 partitions. It can work as batch and interactive (menu driven) on console/terminal. -
17
Liftbridge
Lightweight, fault-tolerant message streams
...Use Liftbridge as a simpler and lighter alternative to systems like Kafka and Pulsar or to add streaming semantics to an existing NATS deployment. Stream replication provides high availability and durability of messages. Clustering and partitioning provide horizontal scalability for streams and their consumers. No heavy or unwieldy dependencies like ZooKeeper or the JVM. Liftbridge is a single static binary roughly 16MB in size. It has a simple gRPC-based API which makes it quick to implement client libraries. Create streams that match wildcard topics, such as stock.nyse. or stock.nasdaq. in addition to topic literals like stock.nasdaq.msft. ... -
18
rav1e
The fastest and safest AV1 encoder
...Despite aiming for simplicity, rav1e supports a wide range of AV1 features: different bit depths, chroma subsampling formats, prediction and transform modes, and block partitioning options, which means it can produce reasonably efficient compressed video. -
19
GenStage
Producer and consumer actors with back-pressure for Elixir
...Developers implement callbacks like handle_demand and handle_events to control how items are emitted, transformed, and consumed across asynchronous boundaries. Because stages are OTP processes, you gain fault tolerance, supervised restarts, and concurrency tuned via configurable demand and partitioning. GenStage underpins higher-level libraries like Flow and Broadway, but it can also be used directly for custom pipelines where timing and throughput matter. Its clear separation of concerns encourages testable, composable stages that can be rearranged as requirements evolve. In production, this leads to predictable, resilient dataflows for event ingestion, batching, and parallel processing. -
20
TurboGears
Python web framework with full-stack layer
TurboGears is a hybrid web framework able to act both as a Full Stack framework or as a Microframework. TurboGears helps you get going fast and gets out of your way when you want it! TurboGears can be used both as a full stack framework or as a microframework in single-file mode. TurboGears 2 is built on top of the experience of several next-generation web frameworks including TurboGears 1 (of course), Django, and Rails. All of these frameworks had limitations that frustrated us, and TG2 was... -
21
Petastorm
Petastorm library enables single machine or distributed training
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code. Petastorm is an open-source data access library developed at Uber ATG. This library enables single machine or distributed training and evaluation of deep learning models directly from datasets in Apache Parquet format. Petastorm supports popular... -
22
The Recursive Zonal Equal Area (EQ) Sphere Partitioning Toolbox is a suite of Matlab functions for partitioning and point distribution on multidimensional spheres.
-
23
pyeqsp
Python port of the eq_sphere_partitions Matlab toolbox
PyEQSP is a Python library that implements the Recursive Zonal Equal Area (EQ) Sphere Partitioning algorithm, originally developed as a Matlab toolbox by Paul Leopardi. For an overview of the features of PyEQSP, see README.md -
24
CXXGraph
Header-Only C++ Library for Graph Manipulation and Algorithms
CXXGraph is a small library, header only, that manages the Graph and it's algorithms in C++. In other words a "Comprehensive C++ Graph Library". -
25
19 August 2024 my new project is here : https://sourceforge.net/projects/recovery/ Ikki Boot is a Live DVD/USB multiboot which aims troubleshooting, disk partitioning, system rescue, backup and restore data. It contains : GParted, Clonezilla, a customized version of Porteus and Tiny Core Linux, and a lot of tools like Nwipe, Boot repair and Super Grub2 Disk. /!\ 9 May 2024 : Ikki Boot 24.05, this is the last version the project is abandoned. /!\ https://ikkiboot.tuxfamily.org/en/news.html
