Search Results for "data capture framework"
Sort By:
Showing 184 open source projects for "data capture framework"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
atk4/data
Data Access PHP Framework for SQL & high-latency databases
ATK Data is a data persistence and modeling framework for PHP, developed as part of the Agile Toolkit. It provides a high-level abstraction for working with databases, making it easier to define and manipulate data models with minimal boilerplate code. It supports various SQL and NoSQL databases and integrates seamlessly with Agile UI and other PHP frameworks. -
2
Spring Data Neo4j
Provide support to increase developer productivity in Java
...The template programming model is equivalent to other Spring templates and builds the basis for interaction with the graph and is also used for the Spring Data repository support. Spring Data Neo4j is a core part of the Spring Data project which aims to provide convenient data access for NoSQL databases. Spring Data builds on Spring Framework, check the spring.io web-site for a wealth of reference documentation. If you are just starting out with Spring, try one of the guides. -
3
Entity Framework 6
This is the codebase for Entity Framework 6
Entity Framework 6 (EF6) is a proven object-relational (O/RM) mapper for .NET with many years of feature development and stabilization. Like O/RM, EF6 reduces the impedance mismatch between the relational and object-oriented worlds, allowing developers to write applications that interact with data stored in relational databases with strongly typed .NET objects that represent the domain of the database. application, and eliminate the need for much of the data access "mechanical" code that you would normally write. ... -
4
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
5
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
6
Sequin
Postgres change data capture to streams and queues like Kafka
Sequin is a change data capture (CDC) system that replicates API data to Postgres in real time. It syncs services like Stripe, Salesforce, and GitHub into PostgreSQL tables, enabling developers to query third-party data with standard SQL. Sequin is ideal for building data-driven applications that need immediate visibility into external SaaS platforms. -
7
Flink CDC
Flink CDC is a streaming data integration tool
Apache Flink CDC is a distributed data integration tool that captures data changes in real-time from various databases. It leverages Change Data Capture (CDC) technology to stream data changes into Apache Flink, enabling real-time analytics and data processing. Flink CDC simplifies data pipeline development with its declarative YAML configurations. -
8
Turso Database
Turso is an in-process SQL database, compatible with SQLite
...It supports SQLite’s SQL dialect, file formats, and C API while adding newer database capabilities. The project is currently in beta, so it is best used with care and proper backups for production data. Turso includes support for concurrent writes through MVCC, change data capture, and faster schema management. It offers bindings and integrations across languages such as Rust, JavaScript, Go, Python, Java, .NET, and WebAssembly. The database also includes vector support, asynchronous Linux I/O with io_uring, and a built-in MCP server that lets AI assistants inspect and modify databases through structured tools. -
9
Npgsql
Npgsql is the .NET data provider for PostgreSQL
Npgsql is an open source ADO.NET Data Provider for PostgreSQL, it allows programs written in C#, Visual Basic, F# to access the PostgreSQL database server. It is implemented in 100% C# code, is free and is open source. An Entity Framework Core provider is also available and exposes some features unique to the PostgreSQL database to EF Core users. Finally, a legacy Entity Framework 6.x (non-Core) provider is also available but is no longer being actively maintained. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
CDC Connectors for Apache Flink
CDC Connectors for Apache Flink
This project provides a set of source connectors for Apache Flink® directly ingesting changes coming from different databases using Change Data Capture(CDC). CDC Connectors for Apache Flink® is a set of source connectors for Apache Flink®, ingesting changes from different databases using change data capture (CDC). CDC Connectors for Apache Flink® integrates Debezium as the engine to capture data changes. So it can fully leverage the ability of Debezium. Supports reading database snapshot and continues to read transaction logs with exactly-once processing even failures happen. ... -
11
Supabase Wrappers
Postgres Foreign Data Wrapper development framework in Rust
Supabase Wrappers is a collection of PostgreSQL extensions (written in Rust) that allow Postgres to interact with external systems like APIs, files, and other databases. It uses Foreign Data Wrappers (FDWs) to treat external resources as if they were native SQL tables, enabling seamless integration with external services directly from SQL queries. -
12
StarRocks
StarRocks is a next-gen sub-second MPP database for full analytics
...From streaming data to change data capture, StarRocks meets the data ingestion demands of real-time analytics. Scale storage and computing power horizontally and support tens of thousands of concurrent users. All of your BI tools work with StarRocks through standard SQL. StarRocks provides superior performance. It is also a unified OLAP covering most data analytics scenarios. -
13
ddia
Designing Data-Intensive Application
ddia is a Chinese translation and online reading project for “Designing Data-Intensive Applications.” It covers both the first edition and ongoing second-edition translation work. The repository organizes the book content into chapters about data systems, storage, encoding, replication, partitioning, transactions, distributed systems, consistency, and derived data. It is built for readers who want deep systems design material in Chinese with a structured web reading experience. ... -
14
Bytebase
The GitHub/GitLab for database DevSecOps
The GitHub/GitLab for database DevSecOps. World's most advanced database DevSecOps solution for Developer, Security, DBA and Platform Engineering teams. -
15
Pop Database
A Tasty Treat For All Your Database Needs
Pop is a data access toolkit for Go that simplifies database interactions. It combines the power of an ORM with the flexibility of SQL, providing developers with tools to manage database schemas, run migrations, and perform CRUD operations. -
16
Enferno
Modern Flask framework optimized for AI-assisted development
Enferno is a framework for building developer-first cloud backends using PostgreSQL and TypeScript. It offers primitives for defining data models, APIs, and access rules directly in code, enabling quick iteration and deployment. Enferno is designed to accelerate SaaS and internal tool development by combining the benefits of traditional backends with developer ergonomics. -
17
Exposed
Kotlin SQL framework
Welcome to Exposed, an ORM framework for Kotlin. Exposed offers two levels of database access: typesafe SQL wrapping DSL and lightweight data access objects. Our official mascot is Cuttlefish, which is best known for its outstanding mimicry abilities letting it blend seamlessly in any environment. Just like our mascot, Exposed can mimic a variety of database engines and help you build database applications without hard dependencies on any specific database engine, and switch between them with very little or no changes in your code. ... -
18
react-native-mmkv-storage
Encrypted mobile key-value storage framework for React Native
An ultra fast(0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI. This library aims to provide a fast & reliable solution for you data storage needs in react-native apps. It uses MMKV by Tencent under the hood on Android and iOS both that is used by their WeChat app(more than 1 Billion users). Unlike other storage solutions for React Native, this library lets you store any kind of data type, in any number of database instances, with or without encryption in a very fast and efficient way. ... -
19
Logstash
Centralize, transform and stash your data
Logstash is a server-side data processing pipeline that dynamically ingests data from numerous sources, transforms it, and ships it to your favorite “stash” regardless of format or complexity. It supports and ingests data of all shapes, sizes and sources, dynamically transforms and prepares this data, and transports it to the output of your choice. Logstash is extensible, with over 200 plugins available to let you create and configure your pipeline how you choose. -
20
Medoo
The lightweight PHP database framework to accelerate the development
Medoo is an open-source project under MIT license and will always be free to use. A lightweight PHP database framework to accelerate development. Supports MySQL, MSSQL, SQLite, MariaDB, PostgreSQL, Sybase, Oracle, and more. Supports various common and complex SQL queries, data mapping, and prevents SQL injection. Works well with every PHP framework, like Laravel, Yii, Slim, and framework which supports singleton extension or composer. -
21
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
22
MyBatis
MyBatis SQL mapper framework for Java
MyBatis is a first class persistence framework with support for custom SQL, stored procedures and advanced mappings. MyBatis eliminates almost all of the JDBC code and manual setting of parameters and retrieval of results. MyBatis can use simple XML or Annotations for configuration and map primitives, Map interfaces and Java POJOs (Plain Old Java Objects) to database records. Every MyBatis application centers around an instance of SqlSessionFactory. A SqlSessionFactory instance can be... -
23
HugeGraph
A graph database that supports more than 100+ billion data
HugeGraph is a convenient, efficient, and adaptable graph database compatible with the Apache TinkerPop3 framework and the Gremlin query language. HugeGraph supports fast import performance in the case of more than 10 billion Vertices and Edges Graph, millisecond-level OLTP query capability, and can be integrated into big data platforms like Hadoop or Spark for OLAP analysis. The main scenarios of HugeGraph include correlation search, fraud detection, and knowledge graph. ... -
24
DBreeze Database
C# .NET NOSQL ( key value store embedded ) ACID database
DBreeze Database is a professional, open-source, multi-paradigm (embedded Key-Value store, objects, NoSql, text search, multi-parameter search, embedding vector database, vector similarity search/clustering, etc.), multi-threaded, transactional and ACID-compliant data management system for .NET5> / .NET Framework 3.5> / Xamarin MONO Android iOS / .NET Core 1.0> / .NET Standard 1.6> / Universal Windows Platform / .NET Portable / UNITY / CoreRT. -
25
MMKV
The fastest key/value storage for React Native
...Encryption support (secure storage). Multiple instances support (separate user-data with global data). Customize storage location. High performance because everything is written in C++. ~30x faster than AsyncStorage. Uses JSI instead of the "old" Bridge. iOS, Android and Web support. Easy to use React Hooks API. StorageBenchmark compares popular storage libraries against each other by reading a value from storage for 1000 times.
