Search Results for "data"
Sort By:
Showing 78 open source projects for "data"
View related business solutions-
Cut Cloud Costs with Google Compute EngineSave on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
-
Build on Google Cloud with $300 in Free CreditStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.
-
1
etcd
Distributed reliable key-value store for the most critical data
...Mainly used as a separate coordination service, in distributed systems. And designed to hold small amounts of data that can fit entirely in memory. Read and write values using standard HTTP tools, such as curl. Store data in hierarchically organized directories, as in a standard filesystem. Watch specific keys or directories for changes and react to changes in values. -
2
Milvus
Vector database for scalable similarity search and AI applications
...Rich APIs designed for data science workflows. Consistent user experience across laptop, local cluster, and cloud. Embed real-time search and analytics into virtually any application. Milvus’ built-in replication and failover/failback features ensure data and applications can maintain business continuity in the event of a disruption. Component-level scalability makes it possible to scale up and down on demand. -
3
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
4
DoltgreSQL
DoltgreSQL - Version Controlled PostgreSQL
DoltgreSQL is an experimental Postgres fork that adds Git-like version control to your database. It allows users to commit, branch, merge, and revert changes to data and schema, bringing collaborative workflows to SQL databases. DoltgreSQL is designed for teams who want full auditability and control over every change made in their data layer. -
Managed MySQL, PostgreSQL, and SQL Databases on Google CloudCloud SQL is a fully managed relational database for MySQL, PostgreSQL, and SQL Server. We handle patching, backups, replication, encryption, and failover—so you can focus on your app. Migrate from on-prem or other clouds with free Database Migration Service. IDC found customers achieved 246% ROI. New customers get $300 in credits plus a 30-day free trial.
-
5
Grafana
Leading open-source visualization and observability platform
Grafana OSS is a leading open-source visualization and observability platform that lets you query, visualize, alert on, and explore your data—regardless of where it’s stored. With support for 100+ data source plugins (such as Prometheus, Loki, Elasticsearch, InfluxDB, SQL/NoSQL databases, OTel, and more), you can unify metrics, logs, traces, and other observability signals in one place. Grafana OSS empowers you to build dynamic, reusable dashboards with rich visualizations, template variables, interactive filtering, and cross-panel linking. ... -
6
InfluxDB
The open source time series database
...Time series is currently the fastest growing database category there is, and InfluxDB is here to ensure businesses can keep up. InfluxDB provides infrastructure and application monitoring, IoT monitoring and analytics and more. It has APIs for storing and querying data, processing it in the background for ETL or monitoring and alerting purposes. This data can also be visualized, explored and more to help businesses seize opportunities and make the best decisions. InfluxDB is easy to start and easy to scale. Learn more about it on https://www.influxdata.com/ -
7
immudb
Immutable database based on zero trust, SQL and Key-Value, tamperproof
immudb is a database with built-in cryptographic proof and verification. It tracks changes in sensitive data and the integrity of the history will be protected by the clients, without the need to trust the database. It can operate both as a key-value store, and/or as a relational database (SQL). Traditional database transactions and logs are mutable, and therefore there is no way to know for sure if your data has been compromised. immudb is immutable. -
8
Beats
Lightweight data shippers of the Elastic Stack
Beats is a platform of lightweight, single-use data shippers written in Go. It captures all sorts of operational data from hundreds or thousands of machines and systems and sends them to Logstash or Elasticsearch. Beats is lightweight in that it has a small installation footprint, uses limited system resources and has no runtime dependencies. It consists of: Auditbeat (for audit data), Filebeat (for log files), Functionbeat (serverless shipper), Heartbeat (for uptime monitoring), Metricbeat (for metrics), Packetbeat (for monitoring network data), and Winlogbeat (for Windows Event logs), with many other Beats created by the community. -
9
Scany
Library for scanning data from a database into Go structs and more
Go favors simplicity, and it's pretty common to work with a database via driver directly without any ORM. It provides great control and efficiency in your queries, but here is a problem: you need to manually iterate over database rows and scan data from all columns into a corresponding destination. It can be error-prone verbose and just tedious. scany aims to solve this problem. It allows developers to scan complex data from a database into Go structs and other composite types with just one function call and doesn't bother with row iteration. -
Cut Data Warehouse Costs up to 54% with BigQueryBigQuery delivers up to 54% lower TCO than cloud alternatives. Migrate from legacy or competing warehouses using free BigQuery Migration Service with automated SQL translation. Get serverless scale with no infrastructure to manage, compressed storage, and flexible pricing—pay per query or commit for deeper discounts. New customers get $300 in free credit.
-
10
Greenmask
PostgreSQL database anonymization and synthetic data generation tool
Greenmask is a powerful open-source utility that is designed for logical database backup dumping, obfuscation, and restoration. It offers extensive functionality for backup, anonymization, and data masking. Greenmask is written in pure Go and includes ported PostgreSQL libraries that allows for platform independence. This tool is stateless and does not require any changes to your database schema. It is designed to be highly customizable and backward-compatible with existing PostgreSQL utilities. The Greenmask utility plays a central role in the Greenmask ecosystem. ... -
11
db
Data access layer for PostgreSQL, CockroachDB, MySQL, SQLite, etc.
upper/db is a productive data access layer (DAL) for Go that provides agnostic tools to work with different data sources. Data access layer for PostgreSQL, CockroachDB, MySQL, SQLite and MongoDB with ORM-like features. Our agnostic API is compatible with SQL and NoSQL databases. Use the SQL builder or raw SQL statements for advanced cases. An (optional) ORM-like layer is available for all your data modelling needs. -
12
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
13
Dolt
Dolt, it's Git for data
...We host public data for free. If you want to host your own version of DoltHub, we have DoltLab. If you want us to run a Dolt server for you, we have Hosted Dolt. MySQL comes with a MySQL server called mysqld and a MySQL client called mysql. You're only interested in the client. After following the instructions from MySQL's documentation, make sure you have a copy of the mysql client on your path. -
14
PocketBase
Open Source realtime backend in 1 file
PocketBase is an open-source backend written in Go, packaged as a single binary. It features an embedded SQLite database, real-time subscriptions, built-in authentication and file management, a web-based admin dashboard, and a simple REST-style API—ideal for building self‑contained apps on a single server. -
15
OSV.dev
Open source vulnerability DB and triage service
...This repository contains the full infrastructure code for deploying osv.dev on Google Cloud Platform, including Terraform configurations, APIs, data pipelines, indexers, and background workers for vulnerability ingestion and impact analysis. It also integrates with automated feeds from sources like NVD and OSS-Fuzz, enabling continuous updates and high data accuracy. -
16
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
17
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
18
Dungbeetle
A distributed job server
Dungbeetle is a metadata and data lineage tracking tool developed by Zerodha to map and visualize how data flows across systems. It helps teams maintain data transparency by tracking dependencies between databases, tables, and reports, offering a centralized view of data pipelines. Dungbeetle is designed to enhance observability and trust in analytics ecosystems. -
19
LinDB
LinDB is a scalable, high performance, high availability database
...A single server could easily support more than one million write TPS; With fundamental techniques like efficient compression storage and parallel computing, LinDB delivers highly optimized query performance. The multi-channel replication protocol supports any amount of nodes, and ensures the system's availability. Schema-free multi-dimensional data model with Metric, Tags, and Fields; The LinQL is flexible yet handy for real-time data analytics. Horizontal scalable is made simple by adding more new broker and storage nodes without too much thinking and manual operations. And the tags-based sharding strategy resolves the hotspot problem. LinDB is designed to work under a Multi-Active IDCs cloud architecture. ... -
20
Prometheus
Open source monitoring system and time series database
...It works by collecting metrics from configured targets at given intervals, evaluating rule expressions, and then displaying the results. It can also signal an alert if a condition is observed to be true. What sets Prometheus apart from other monitoring systems is its highly dimensional data model, powerful query language, autonomous single server nodes, among many other distinguishing features. It also offers several client libraries for easy instrumentation of services, as well as many integration options. -
21
KubeBlocks
KubeBlocks is an open-source control plane that runs and manages datab
...No need to be a K8s professional, anyone can set up a full-stack, production-ready data infrastructure in minutes. KubeBlocks extends K8s StatefulSet capability with ReplicationSet and ConsensusSet workloads. They are aware of different roles in a database cluster, and choose the best update strategy with minimal impact on business continuity, monitoring data replication status and automatically fixing errors and lags. -
22
Cortex
A horizontally scalable, multi-tenant, long term Prometheus
Horizontally scalable, highly available, multi-tenant, long-term storage for Prometheus. Durably store data for longer than the lifetime of any single machine, and use this data for long-term capacity planning. Cortex makes your PromQL queries blazin' fast through aggressive parallelization and caching. Cortex gives you a global view of Prometheus time series data that includes data in long-term storage, greatly expanding the usefulness of PromQL for analytical purposes. ... -
23
Bitalosdb
Bitalosdb is a high-performance KV storage engine
BitalosDB is a distributed, high-performance key-value database designed for cloud-native applications. It is optimized for scalability, supporting large workloads while maintaining low latency and high availability. -
24
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
25
rqlite
The lightweight, distributed relational database built on SQLite
rqlite is an easy-to-use, lightweight, distributed relational database, which uses SQLite as its storage engine. rqlite is simple to deploy, operating it is very straightforward, and its clustering capabilities provide you with fault-tolerance and high availability. rqlite is available for Linux, macOS, and Microsoft Windows. rqlite gives you the functionality of a rock solid, fault-tolerant, replicated relational database, but with very easy installation, deployment, and operation. With it you've got a lightweight and reliable distributed relational data store. Think etcd or Consul, but with relational data modeling also available. You could use rqlite as part of a larger system, as a central store for some critical relational data, without having to run larger, more complex distributed databases. rqlite uses Raft to achieve consensus across all the instances of the SQLite databases, ensuring that every change made to the system is made to a quorum of SQLite databases.
