Search Results for "data replication"
Sort By:
Showing 114 open source projects for "data replication"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
pglogical
Logical Replication extension for PostgreSQL
pglogical is an advanced logical replication extension for PostgreSQL that allows selective replication of data between databases. Unlike physical replication, it enables fine-grained control of which tables or changes to replicate. It’s well-suited for multi-master setups, version upgrades, and real-time data distribution across environments. -
2
pg_easy_replicate
Easily setup logical replication and switchover to new database
pg_easy_replicate is a simple tool for replicating PostgreSQL data from one database to another using logical replication. It abstracts away the complexity of publication/subscription setup and enables selective table replication. Ideal for developers or data engineers who want quick replication without deep Postgres expertise. -
3
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
4
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
6
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL) and more into a diverse array of databases, data warehouses, and data lakes, enabling AI and ML use-cases at all three levels: Edge, Fog and Cloud. ... -
7
Kubegres
Kubegres is a Kubernetes operator allowing to deploy clusters
Kubegres is a Kubernetes operator that allows to deployment one or many clusters of PostgreSQL pods with data replication and failover enabled out-of-the-box. It brings simplicity when using PostgreSQL considering how complex managing a stateful-set's life cycle and data replication could be with Kubernetes. Kubegres is fully integrated with Kubernetes' lifecycle as it runs as an operator written in Go. It is minimalist in terms of codebase compared to other open-source Postgres operators. ... -
8
Redis
An in-memory database that persists on disk
Redis is an open-source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. ... -
9
RxDB
Client side, offline-first, reactive database for JavaScript apps
...Reactive means that you can not only query the current state but subscribe to all state changes like the result of a query or even a single field of a document. This is great for UI-based real-time applications in a way that makes it easy to develop and also has great performance benefits. To replicate data between your clients and server, RxDB provides modules for real-time replication with any CouchDB compliant endpoint and also with custom GraphQL endpoints. Multiplatform support for browsers, nodejs, electron, Cordova, react-native and every other javascript runtime. Replication between client and server-data, compatible with pouchdbPouchDB, couchdbCouchDB, and cloudantIBM Cloudant. ... -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
10
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
11
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
12
CouchDB.NET
EF Core-like CouchDB experience for .NET
CouchDB-Net is a .NET client library for Apache CouchDB, providing developers with a simple way to interact with the database using C#. It enables document storage, querying, and replication in .NET applications. -
13
Kraken
P2P Docker registry capable of distributing TBs of data in seconds
...Kraken is capable of distributing Docker images at > 50% of max download the speed limit on every host. Cluster size and image size do not have a significant impact on download speed. Support uploader authentication and data integrity protection through TLS. Other than pluggable storage, Kraken only has an optional dependency on DNS. -
14
pgwire
PostgreSQL wire protocol implemented as a rust library.
Build a Postgres compatible access layer for your data service. This library implements PostgreSQL Wire Protocol and provides essential APIs to write PostgreSQL-compatible servers and clients. If you are interested in a related topic, you can check project ideas to build on top of this library. -
15
ClickHouse
A fast open-source OLAP database management system
...Apart from its blazing speed, ClickHouse is highly reliable and fault tolerant. It supports multi-master asynchronous replication with the option of being deployed across multiple datacenters. With all nodes equal, there is no single point of failure. Downtime of a single node or even the whole datacenter won't affect the system's availability. ClickHouse also has exceptional hardware efficiency and a host of other features, including a feature-rich SQL database, vectorized query execution, real-time query processing and data ingestion, and more. -
16
Sequin
Postgres change data capture to streams and queues like Kafka
Sequin is a change data capture (CDC) system that replicates API data to Postgres in real time. It syncs services like Stripe, Salesforce, and GitHub into PostgreSQL tables, enabling developers to query third-party data with standard SQL. Sequin is ideal for building data-driven applications that need immediate visibility into external SaaS platforms. -
17
ReductStore
The fastest time series object store for Edge AI
History storage and management of images, vibration data, text, labels, and more - all in one place with the highest performance. Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. ... -
18
MusicBrainz Server
Server for the MusicBrainz project (website, API, database tools)
...Internationalization, release group types, tagging, and flexible entity relationships reflect the complexity of music cataloging. As a large-scale open-data service, the server must remain performant under frequent reads, submitted edits, replication traffic, and API clients. -
19
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
20
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
21
Sanoid
These are policy-driven snapshot management and replication tools
...It sets and respects ZFS properties, places holds to protect in-use snapshots, and surfaces health issues so you notice problems before recovery time. Paired with its sibling syncoid, it also handles local and remote replication of incremental snapshots over SSH, supporting resume tokens, bandwidth shaping, and common accelerators like mbuffer. The design favors safety and observability: dry-run modes, verbose logging, and conservative defaults reduce the risk of accidental data loss. In production, Sanoid turns ZFS’s powerful but low-level primitives into dependable, auditable data protection for everything from home labs to multi-tenant servers. -
22
cbl-dart
Couchbase Lite for Dart and Flutter
CBL-Dart is a Dart wrapper for Couchbase Lite, allowing Flutter and Dart applications to integrate with Couchbase’s NoSQL database. It enables offline data storage, synchronization, and efficient querying for mobile and embedded applications. -
23
Elasticsearch
A Distributed RESTful Search Engine
Elasticsearch is a distributed, RESTful search and analytics engine that lets you store, search and analyze with ease at scale. It lets you perform and combine many types of searches; it scales seamlessly, and offers answers incredibly fast with search results you can rank based on a variety of factors. Elasticsearch can be used for a wide variety of use cases, from maps and metrics to site search and workplace search, and with all data types. -
24
pg_auto_failover
Postgres extension and service for automated failover
pg_auto_failover is a PostgreSQL extension and management tool for automated high availability. It handles health checks, failover, and monitoring without requiring third-party tools or complex configuration. Designed by the Citus Data team at Microsoft, it's ideal for developers and ops teams wanting reliable HA with minimal effort. -
25
Aerospike Node.js Client
Node.js client for the Aerospike database
Aerospike Node.js Client is the official Node.js driver for Aerospike, a high-performance NoSQL database optimized for real-time applications. It provides low-latency access to key-value stores and supports advanced data structures for AI, financial, and IoT applications.