Search Results for "data replication"
Sort By:
Showing 130 open source projects for "data replication"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
pglogical
Logical Replication extension for PostgreSQL
pglogical is an advanced logical replication extension for PostgreSQL that allows selective replication of data between databases. Unlike physical replication, it enables fine-grained control of which tables or changes to replicate. It’s well-suited for multi-master setups, version upgrades, and real-time data distribution across environments. -
2
pg_easy_replicate
Easily setup logical replication and switchover to new database
pg_easy_replicate is a simple tool for replicating PostgreSQL data from one database to another using logical replication. It abstracts away the complexity of publication/subscription setup and enables selective table replication. Ideal for developers or data engineers who want quick replication without deep Postgres expertise. -
3
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
4
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
6
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL) and more into a diverse array of databases, data warehouses, and data lakes, enabling AI and ML use-cases at all three levels: Edge, Fog and Cloud. ... -
7
RxDB
Client side, offline-first, reactive database for JavaScript apps
...Reactive means that you can not only query the current state but subscribe to all state changes like the result of a query or even a single field of a document. This is great for UI-based real-time applications in a way that makes it easy to develop and also has great performance benefits. To replicate data between your clients and server, RxDB provides modules for real-time replication with any CouchDB compliant endpoint and also with custom GraphQL endpoints. Multiplatform support for browsers, nodejs, electron, Cordova, react-native and every other javascript runtime. Replication between client and server-data, compatible with pouchdbPouchDB, couchdbCouchDB, and cloudantIBM Cloudant. ... -
8
Anna’s Archive
Comprehensive search engine for books, papers, comics, magazines
...It relies heavily on technologies such as Elasticsearch for search functionality and MariaDB for structured data storage, enabling fast and efficient querying across massive datasets. The system is designed with redundancy and replication in mind, allowing distributed deployments and mirrored environments to handle high traffic and large data volumes. It also includes tooling for importing datasets, managing metadata, and maintaining structured archives using custom formats. -
9
Redis
An in-memory database that persists on disk
Redis is an open-source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. ... -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
ClickHouse
A fast open-source OLAP database management system
...Apart from its blazing speed, ClickHouse is highly reliable and fault tolerant. It supports multi-master asynchronous replication with the option of being deployed across multiple datacenters. With all nodes equal, there is no single point of failure. Downtime of a single node or even the whole datacenter won't affect the system's availability. ClickHouse also has exceptional hardware efficiency and a host of other features, including a feature-rich SQL database, vectorized query execution, real-time query processing and data ingestion, and more. -
11
Kubegres
Kubegres is a Kubernetes operator allowing to deploy clusters
Kubegres is a Kubernetes operator that allows to deployment one or many clusters of PostgreSQL pods with data replication and failover enabled out-of-the-box. It brings simplicity when using PostgreSQL considering how complex managing a stateful-set's life cycle and data replication could be with Kubernetes. Kubegres is fully integrated with Kubernetes' lifecycle as it runs as an operator written in Go. It is minimalist in terms of codebase compared to other open-source Postgres operators. ... -
12
pgwire
PostgreSQL wire protocol implemented as a rust library.
Build a Postgres compatible access layer for your data service. This library implements PostgreSQL Wire Protocol and provides essential APIs to write PostgreSQL-compatible servers and clients. If you are interested in a related topic, you can check project ideas to build on top of this library. -
13
ReductStore
The fastest time series object store for Edge AI
History storage and management of images, vibration data, text, labels, and more - all in one place with the highest performance. Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. ... -
14
CouchDB.NET
EF Core-like CouchDB experience for .NET
CouchDB-Net is a .NET client library for Apache CouchDB, providing developers with a simple way to interact with the database using C#. It enables document storage, querying, and replication in .NET applications. -
15
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
16
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
17
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
18
Kraken
P2P Docker registry capable of distributing TBs of data in seconds
...Kraken is capable of distributing Docker images at > 50% of max download the speed limit on every host. Cluster size and image size do not have a significant impact on download speed. Support uploader authentication and data integrity protection through TLS. Other than pluggable storage, Kraken only has an optional dependency on DNS. -
19
Sanoid
These are policy-driven snapshot management and replication tools
...It sets and respects ZFS properties, places holds to protect in-use snapshots, and surfaces health issues so you notice problems before recovery time. Paired with its sibling syncoid, it also handles local and remote replication of incremental snapshots over SSH, supporting resume tokens, bandwidth shaping, and common accelerators like mbuffer. The design favors safety and observability: dry-run modes, verbose logging, and conservative defaults reduce the risk of accidental data loss. In production, Sanoid turns ZFS’s powerful but low-level primitives into dependable, auditable data protection for everything from home labs to multi-tenant servers. -
20
PULSAR
Distributed pub-sub messaging system
...scale for over 5 years, with millions of messages per second across millions of topics. Expand capacity seamlessly to hundreds of nodes. Low publish latency (< 5ms) at scale with strong durability guarantees. Configurable replication between data centers across multiple geographic regions. Built from the ground up as a multi-tenant system. Supports isolation, authentication, authorization and quotas. Persistent message storage based on Apache BookKeeper. IO-level isolation between write and read operations. Flexible messaging models with high-level APIs for Java, Go, Python, C++, Node.js, WebSocket and C#. -
21
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
22
MusicBrainz Server
Server for the MusicBrainz project (website, API, database tools)
...Internationalization, release group types, tagging, and flexible entity relationships reflect the complexity of music cataloging. As a large-scale open-data service, the server must remain performant under frequent reads, submitted edits, replication traffic, and API clients. -
23
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. Support replicas and erasure coding engines, users can choose flexibly according to business scenarios. ... -
24
SlateDB
A cloud native embedded storage engine built on object storage
Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage to provide bottomless storage capacity, high durability, and easy replication. SlateDB is an embedded storage engine built as a log-structured merge-tree. Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage (S3, GCS, ABS, MinIO, Tigris, and so on). Leveraging object storage allows SlateDB to provide bottomless storage capacity, high durability, and easy replication. -
25
Elasticsearch
A Distributed RESTful Search Engine
Elasticsearch is a distributed, RESTful search and analytics engine that lets you store, search and analyze with ease at scale. It lets you perform and combine many types of searches; it scales seamlessly, and offers answers incredibly fast with search results you can rank based on a variety of factors. Elasticsearch can be used for a wide variety of use cases, from maps and metrics to site search and workplace search, and with all data types.
