Search Results for "streaming"
Sort By:
Showing 51 open source projects for "streaming"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
RisingWave
RisingWave: the next-generation streaming database in the cloud
RisingWave is a cloud-native streaming database that uses SQL as the interface. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results in its own storage so that users can access data efficiently. -
2
MatrixOne
Hyperconverged cloud-edge native database
MatrixOne is a future-oriented hyperconverged cloud & edge native DBMS that supports transactional, analytical, and streaming workload with a simplified and distributed database engine, across multiple data centers, clouds, edges and other heterogeneous infrastructures. A monolithic database engine is designed to support hybrid workloads: transactional, analytical, streaming, time-series, machine learning, etc. MatrixOne supports seamless workload migration and bursting among different locations and infrastructures. ... -
3
repmgr
A lightweight replication manager for PostgreSQL (Postgres)
repmgr is a management tool for PostgreSQL replication, providing monitoring, failover, and administrative capabilities for streaming replication setups. It simplifies the configuration of primary/standby clusters and automates failover processes for high availability. repmgr is widely used in production environments where database resilience and minimal downtime are critical. -
4
Autobase
Automated database platform for PostgreSQL
autobase is an automated, lightweight PostgreSQL replication setup tool for streaming replication using repmgr. It simplifies the configuration and management of PostgreSQL high availability clusters by handling role switching, connection settings, and initial replication setup with minimal manual effort. It's particularly useful for small to medium-sized teams looking to deploy resilient database clusters quickly. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Lantern Database
PostgreSQL vector database extension for building AI applications
Lantern is a real-time data transformation engine that enables data engineers to build, run, and monitor streaming data pipelines with SQL. It’s designed to process events in motion, offering low-latency stream transformations, aggregations, and enrichment in a declarative way. Lantern is especially suited for modern data infrastructure and analytics platforms. -
6
marko
A declarative, HTML-based language that makes building web apps fun
A declarative, HTML-based language that makes building web apps fun. If you know HTML, CSS, and Javascript, you know Marko. Streaming, partial hydration, an optimizing compiler, & a small runtime. Start with simple HTML templates and add powerful components as needed. Marko is powering high-traffic websites like ebay.com. Marko is HTML re-imagined as a language for building dynamic and reactive user interfaces. Just about any valid HTML is valid Marko, but Marko extends the HTML language to allow building modern applications in a declarative way. ... -
7
ZeusDB Vector Database
Blazing-fast vector DB with similarity search and metadata filtering
...The storage layer is designed for durability and growth, supporting sharding, replication, and background compaction while keeping query tails predictable. Developers get multiple ingestion paths—batch, streaming, and upsert—making it easy to keep embeddings synchronized as content changes. Hybrid search is a core design goal, allowing you to mix vector, keyword, and filter queries in a single request for practical relevance. Observability and safety round out the system, with metrics, tracing, and guardrails to manage recalls, deletions, and privacy-sensitive data at scale. -
8
node-mssql
Microsoft SQL Server client for Node.js
node-mssql is a Microsoft SQL Server client for Node.js, providing a robust and feature-rich interface for connecting to and interacting with SQL Server databases. -
9
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
Memgraph
Open-source graph database, tuned for dynamic analytics environments
A high-performance, in-memory graph database designed for real-time analytics and complex network data processing. -
11
GreptimeDB
An open-source, cloud-native, unified time series database for metrics
GreptimeDB treats all time series as contextual events with timestamps, and thus unifies the processing of metrics, logs, and events. It supports analyzing metrics, logs, and events with SQL, PromQL, and streaming with continuous aggregation. GreptimeDB is a time-series database optimized for storing and querying large amounts of time-series data, commonly used in monitoring and IoT applications. -
12
Flink CDC
Flink CDC is a streaming data integration tool
Apache Flink CDC is a distributed data integration tool that captures data changes in real-time from various databases. It leverages Change Data Capture (CDC) technology to stream data changes into Apache Flink, enabling real-time analytics and data processing. Flink CDC simplifies data pipeline development with its declarative YAML configurations. -
13
osm2pgsql
Import OpenStreetMap data into a PostgreSQL/PostGIS database
osm2pgsql is a powerful tool for importing OpenStreetMap (OSM) data into a PostgreSQL/PostGIS database, enabling geographic data analysis and map rendering. It supports various rendering schemas like "flex" and "lua" to customize how data is loaded and indexed. Designed for performance and scalability, osm2pgsql is widely used in map tile generation pipelines and by GIS professionals handling large-scale spatial datasets. -
14
StarRocks
StarRocks is a next-gen sub-second MPP database for full analytics
...Get amazing query performance on Star or Snowflake Schemas directly. From canceled orders to updated items, your analytics applications can easily handle them with StarRocks. From streaming data to change data capture, StarRocks meets the data ingestion demands of real-time analytics. Scale storage and computing power horizontally and support tens of thousands of concurrent users. All of your BI tools work with StarRocks through standard SQL. StarRocks provides superior performance. It is also a unified OLAP covering most data analytics scenarios. -
15
KubeBlocks
KubeBlocks is an open-source control plane that runs and manages datab
...However, the most prominent obstacles are the difficulties of integrating with cloud providers, the lack of reliable operators, and the steep learning curve of K8s. KubeBlocks offers an open-source option that helps application developers and platform engineers set up feature-rich services for RDBMS, NoSQL, streaming and analytical systems. No need to be a K8s professional, anyone can set up a full-stack, production-ready data infrastructure in minutes. KubeBlocks extends K8s StatefulSet capability with ReplicationSet and ConsensusSet workloads. They are aware of different roles in a database cluster, and choose the best update strategy with minimal impact on business continuity, monitoring data replication status and automatically fixing errors and lags. -
16
OpenHMS brands a collection of projects and many subprojects developed by Health Market Science. This is a robust collection of development libraries, APIs, and tools oriented around data manipulation and professional software development.
-
17
SymmetricDS
Database Replication, Filtered Synchronization, and Transformation
SymmetricDS is database replication and file synchronization software. It is a platform-independent, web-enabled, and database-agnostic synchronization tool. With initial data load, bidirectional change data capture, conflict resolution, and data transformation, it is a comprehensive data replication solution. -
18
HStreamDB
HStreamDB is an open-source, cloud-native streaming database
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications. By subscribing to streams in HStreamDB, any update of the data stream will be pushed to your apps in real-time, and this promotes your apps to be more responsive. You can also replace message brokers with HStreamDB and everything you do with message brokers can be done better with HStreamDB. -
19
Greenplum Database
Massive parallel data platform for analytics, machine learning and AI
...Based on PostgreSQL, Greenplum provides you with more control over the software you deploy, reducing vendor lock-in, and allowing open influence on product direction. Greenplum reduces data silos by providing you with a single, scale-out environment for converging analytic and operational workloads, like streaming ingestion. All major Greenplum contributions are part of the Greenplum Database project and share the same database core, including the MPP architecture, analytical interfaces, and security capabilities. -
20
Arctic TimeSeries and Tick store
High performance datastore for time series and tick data
...Has different types of Stores, each with it's own benefits. Eg. Versionstore allows you to version and snapshot stuff, TickStore is for storage and highly efficient retrieval of streaming data, ChunkStore allows you to chunk and efficiently retrieve ranges of chunks. -
21
Speedb
A RocksDB compliant high performance scalable embedded key-value store
...Join the Hive, Speedb’s open-source community, to interact, improve, and share knowledge and best practices on RocksDB. Speedb is a compatible alternative for LevelDB and RocksDB users who would like to take their application to the next level. When using event streaming platforms like Kafka, Flink, Spark, Splunk, Elastic, or others, consider using Speedb to enhance its performance. The increase in metadata in modern data sets is causing significant performance issues for many applications. With Speedb you can keep costs low and ensure your applications continue to run smoothly even under heavy loads. ... -
22
JQuickBase
elementary database files for Java, B+ tree index files, ISAM
Java API to realize quick ISAM (Index Sequential Access Method) functionality for application in the file system. Includes scalable database files w/ space recovery and variable record length, scalable B+Tree index files. Supports file backup and restore. Two package types: one with and one without strong file encryption using Twofish algorithm and state-of-the-art encryption technology. -
23
levelup
A wrapper for abstract-leveldown compliant stores, for Node.js
...LevelDB supports arbitrary byte arrays as both keys and values, singular get, put and delete operations, batched put and delete, bi-directional iterators and simple compression using the very fast Snappy algorithm. LevelDB stores entries sorted lexicographically by keys. This makes the streaming interface of levelup - which exposes LevelDB iterators as Readable Streams, a very powerful query mechanism. The most common store is leveldown which provides a pure C++ binding to LevelDB. Many alternative stores are available such as level.js in the browser or memdown for an in-memory store. They typically support strings and Buffers for both keys and values. ... -
24
Demo Scene
Scripts and samples to support Confluent Demos, Talks, and Blogs
Demo Scene is a collection of resources and examples provided by Confluent Inc. to demonstrate the capabilities of Apache Kafka and its ecosystem. It includes various demos showcasing real-time data streaming, processing, and integration patterns -
25
ksqlDB
The database purpose-built for stream processing applications
...Use a familiar, lightweight syntax to pack a powerful punch. Capture, process, and serve queries using only SQL. No other languages or services are required. ksqlDB enables you to build event streaming applications leveraging your familiarity with relational databases. Three categories are foundational to building an application: collections, stream processing, and queries. Streams are immutable, append-only sequences of events. They're useful for representing a series of historical facts. Tables are mutable collections of events. ...
