Search Results for "data replication"
Sort By:
Showing 117 open source projects for "data replication"
View related business solutions-
PRTG Catches Network Issues Before They Cause DowntimeReactive troubleshooting usually means hearing about a problem from frustrated users, not your monitoring tool. PRTG sets threshold-based alerts across devices, servers and applications, notifying your team by email, SMS or push the moment a metric crosses a set limit. That means catching a failing disk or overloaded server before it becomes an outage and getting time back from firefighting. Start a free trial and set your first alerts today.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
pg_easy_replicate
Easily setup logical replication and switchover to new database
pg_easy_replicate is a simple tool for replicating PostgreSQL data from one database to another using logical replication. It abstracts away the complexity of publication/subscription setup and enables selective table replication. Ideal for developers or data engineers who want quick replication without deep Postgres expertise. -
2
pglogical
Logical Replication extension for PostgreSQL
pglogical is an advanced logical replication extension for PostgreSQL that allows selective replication of data between databases. Unlike physical replication, it enables fine-grained control of which tables or changes to replicate. It’s well-suited for multi-master setups, version upgrades, and real-time data distribution across environments. -
3
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
4
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
6
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL) and more into a diverse array of databases, data warehouses, and data lakes, enabling AI and ML use-cases at all three levels: Edge, Fog and Cloud. ... -
7
RxDB
Client side, offline-first, reactive database for JavaScript apps
...Reactive means that you can not only query the current state but subscribe to all state changes like the result of a query or even a single field of a document. This is great for UI-based real-time applications in a way that makes it easy to develop and also has great performance benefits. To replicate data between your clients and server, RxDB provides modules for real-time replication with any CouchDB compliant endpoint and also with custom GraphQL endpoints. Multiplatform support for browsers, nodejs, electron, Cordova, react-native and every other javascript runtime. Replication between client and server-data, compatible with pouchdbPouchDB, couchdbCouchDB, and cloudantIBM Cloudant. ... -
8
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
9
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Kubegres
Kubegres is a Kubernetes operator allowing to deploy clusters
Kubegres is a Kubernetes operator that allows to deployment one or many clusters of PostgreSQL pods with data replication and failover enabled out-of-the-box. It brings simplicity when using PostgreSQL considering how complex managing a stateful-set's life cycle and data replication could be with Kubernetes. Kubegres is fully integrated with Kubernetes' lifecycle as it runs as an operator written in Go. It is minimalist in terms of codebase compared to other open-source Postgres operators. ... -
11
pgwire
PostgreSQL wire protocol implemented as a rust library.
Build a Postgres compatible access layer for your data service. This library implements PostgreSQL Wire Protocol and provides essential APIs to write PostgreSQL-compatible servers and clients. If you are interested in a related topic, you can check project ideas to build on top of this library. -
12
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
13
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
14
CouchDB.NET
EF Core-like CouchDB experience for .NET
CouchDB-Net is a .NET client library for Apache CouchDB, providing developers with a simple way to interact with the database using C#. It enables document storage, querying, and replication in .NET applications. -
15
Sanoid
These are policy-driven snapshot management and replication tools
...It sets and respects ZFS properties, places holds to protect in-use snapshots, and surfaces health issues so you notice problems before recovery time. Paired with its sibling syncoid, it also handles local and remote replication of incremental snapshots over SSH, supporting resume tokens, bandwidth shaping, and common accelerators like mbuffer. The design favors safety and observability: dry-run modes, verbose logging, and conservative defaults reduce the risk of accidental data loss. In production, Sanoid turns ZFS’s powerful but low-level primitives into dependable, auditable data protection for everything from home labs to multi-tenant servers. -
16
Redis
An in-memory database that persists on disk
Redis is an open-source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. ... -
17
ReductStore
The fastest time series object store for Edge AI
History storage and management of images, vibration data, text, labels, and more - all in one place with the highest performance. Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. ... -
18
Kraken
P2P Docker registry capable of distributing TBs of data in seconds
...Kraken is capable of distributing Docker images at > 50% of max download the speed limit on every host. Cluster size and image size do not have a significant impact on download speed. Support uploader authentication and data integrity protection through TLS. Other than pluggable storage, Kraken only has an optional dependency on DNS. -
19
Sequin
Postgres change data capture to streams and queues like Kafka
Sequin is a change data capture (CDC) system that replicates API data to Postgres in real time. It syncs services like Stripe, Salesforce, and GitHub into PostgreSQL tables, enabling developers to query third-party data with standard SQL. Sequin is ideal for building data-driven applications that need immediate visibility into external SaaS platforms. -
20
ClickHouse
A fast open-source OLAP database management system
...Apart from its blazing speed, ClickHouse is highly reliable and fault tolerant. It supports multi-master asynchronous replication with the option of being deployed across multiple datacenters. With all nodes equal, there is no single point of failure. Downtime of a single node or even the whole datacenter won't affect the system's availability. ClickHouse also has exceptional hardware efficiency and a host of other features, including a feature-rich SQL database, vectorized query execution, real-time query processing and data ingestion, and more. -
21
ddia
Designing Data-Intensive Application
ddia is a Chinese translation and online reading project for “Designing Data-Intensive Applications.” It covers both the first edition and ongoing second-edition translation work. The repository organizes the book content into chapters about data systems, storage, encoding, replication, partitioning, transactions, distributed systems, consistency, and derived data. It is built for readers who want deep systems design material in Chinese with a structured web reading experience. ... -
22
pg_auto_failover
Postgres extension and service for automated failover
pg_auto_failover is a PostgreSQL extension and management tool for automated high availability. It handles health checks, failover, and monitoring without requiring third-party tools or complex configuration. Designed by the Citus Data team at Microsoft, it's ideal for developers and ops teams wanting reliable HA with minimal effort. -
23
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. Support replicas and erasure coding engines, users can choose flexibly according to business scenarios. ... -
24
Postgres for Everything
How to reduce complexity and move faster? Just Postgres for everything
...Rather than being a single application, it collects projects, extensions, articles, and examples built around PostgreSQL. Covered uses include message queues, analytics, GIS, search, time-series data, NoSQL, graphs, caching, APIs, and access control. It also catalogs approaches for replication, monitoring, testing, scaling, visualization, and data security. The project's central idea is that teams may reduce architectural complexity by extending an already capable relational database instead of deploying many independent services. ... -
25
MusicBrainz Server
Server for the MusicBrainz project (website, API, database tools)
...Internationalization, release group types, tagging, and flexible entity relationships reflect the complexity of music cataloging. As a large-scale open-data service, the server must remain performant under frequent reads, submitted edits, replication traffic, and API clients.
