Showing 632 open source projects for "data"

View related business solutions
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Try Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 1
    Vince

    Vince

    Self Hosted Alternative To Google Analytics

    vince is a versatile tool that assists in data analysis and visualization, providing users with insights through interactive charts and graphs.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Numaflow

    Numaflow

    Kubernetes-native platform to run massively parallel data/streaming

    Numaflow is a Kubernetes-native tool for running massively parallel stream processing. A Numaflow Pipeline is implemented as a Kubernetes custom resource and consists of one or more source, data processing, and sink vertices. Numaflow installs in a few minutes and is easier and cheaper to use for simple data processing applications than a full-featured stream processing platform.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3
    Milvus

    Milvus

    Vector database for scalable similarity search and AI applications

    ...Rich APIs designed for data science workflows. Consistent user experience across laptop, local cluster, and cloud. Embed real-time search and analytics into virtually any application. Milvus’ built-in replication and failover/failback features ensure data and applications can maintain business continuity in the event of a disruption. Component-level scalability makes it possible to scale up and down on demand.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 4
    Flexprice

    Flexprice

    Usage-based pricing and billing for developers

    ...It’s particularly useful for startups, DTC brands, and marketplaces looking to replace static pricing with responsive, data-driven pricing logic.
    Downloads: 8 This Week
    Last Update:
    See Project
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 5
    Volcano

    Volcano

    A Cloud Native Batch System (Project under CNCF)

    ...It provides a suite of mechanisms that are commonly required by many classes of batch & elastic workload including machine learning/deep learning, bioinformatics/genomics, and other "big data" applications. These types of applications typically run on generalized domain frameworks like TensorFlow, Spark, Ray, PyTorch, MPI, etc, which Volcano integrates with. Volcano builds upon a decade and a half of experience running a wide variety of high-performance workloads at scale using several systems and platforms, combined with best-of-breed ideas and practices from the open-source community. ...
    Downloads: 161 This Week
    Last Update:
    See Project
  • 6
    Nightingale Visualization

    Nightingale Visualization

    An all-in-one observability solution

    An all-in-one observability solution that aims to combine the advantages of Prometheus and Grafana. It manages alert rules and visualizes metrics, logs, and traces in a beautiful web UI.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 7
    kpt

    kpt

    Automate Kubernetes Configuration Editing

    kpt is a package-centric toolchain that enables a WYSIWYG configuration authoring, automation, and delivery experience, which simplifies managing Kubernetes platforms and KRM-driven infrastructure (e.g., Config Connector, Crossplane) at scale by manipulating declarative Configuration as Data. Any general-purpose or domain-specific language can be used to create functions to transform and/or validate the YAML KRM input/output format, but we provide SDKs to simplify the function authoring process, in Go, Typescript, and Starlark, a Python-like embedded language. A catalog of off-the-shelf, tested functions. kpt makes configuration easy to create and transform, via reusable functions. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 8
    Sonic JSON

    Sonic JSON

    A blazingly fast JSON serializing & deserializing library

    A blazingly fast JSON serializing & deserializing library, accelerated by JIT (just-in-time compiling) and SIMD (single-instruction-multiple-data).
    Downloads: 3 This Week
    Last Update:
    See Project
  • 9
    Nuclio

    Nuclio

    High-Performance Serverless event and data processing platform

    Nuclio is an open source and managed serverless platform used to minimize development and maintenance overhead and automate the deployment of data-science-based applications. Real-time performance running up to 400,000 function invocations per second. Portable across low laptops, edge, on-prem and multi-cloud deployments. The first serverless platform supporting GPUs for optimized utilization and sharing. Automated deployment to production in a few clicks from Jupyter notebook. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 10
    Kopia

    Kopia

    Cross-platform backup tool for Windows, macOS and Linux

    ...Its architecture supports end-to-end encryption, optional compression, and deduplication, so multiple backups can share data efficiently, and repositories can be stored securely even in untrusted locations.
    Downloads: 15 This Week
    Last Update:
    See Project
  • 11
    pdfcpu

    pdfcpu

    A PDF processor written in Go

    pdfcpu is a PDF processing library written in Go supporting encryption. It provides both an API and a CLI. Supported are all versions up to PDF 1.7 (ISO-32000). This is an effort to build a comprehensive PDF processing library from the ground up written in Go. Over time pdfcpu aims to support the standard range of PDF processing features and also any interesting use cases that may present themselves along the way. The main focus lies on strong support for batch processing and scripting via a...
    Downloads: 18 This Week
    Last Update:
    See Project
  • 12
    Fluid

    Fluid

    Fluid, elastic data abstraction and acceleration for BigData/AI apps

    Fluid, elastic data abstraction and acceleration for BigData/AI applications in the cloud. Provide DataSet abstraction for underlying heterogeneous data sources with multidimensional management in a cloud environment. Enable dataset warmup and acceleration for data-intensive applications by using a distributed cache in Kubernetes with observability, portability, and scalability.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Kapacitor

    Kapacitor

    Open source framework for processing, monitoring, and alerting

    Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    PeerDB

    PeerDB

    Fast, Simple and a cost effective tool to replicate data from Postgres

    PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    SFTPGo

    SFTPGo

    Fully featured and highly configurable SFTP server with optional HTTP

    Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support. Several storage backends are supported: local filesystem, encrypted local filesystem, S3 (compatible) Object Storage, Google Cloud Storage, Azure Blob Storage, SFTP. SFTPGo is an Open Source project and you can of course use it for free but please don't ask for free support as well. Support for serving local filesystem, encrypted local filesystem, S3 Compatible Object Storage, Google Cloud...
    Downloads: 67 This Week
    Last Update:
    See Project
  • 16
    Functional programming library golang

    Functional programming library golang

    functional programming library for golang

    ...For each data type, there exists a small set of composition functions. These functions are called the same across all data types, so you only have to learn a small number of function names. The semantic of functions of the same name is consistent across all data types.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 17
    Open Policy Agent

    Open Policy Agent

    An open source, general-purpose policy engine

    Policy-based control for cloud-native environments. Flexible, fine-grained control for administrators across the stack. Stop using a different policy language, policy model, and policy API for every product and service you use. Use OPA for a unified toolset and framework for policy across the cloud-native stack. Whether for one service or for all your services, use OPA to decouple policy from the service's code so you can release, analyze, and review policies (which security and compliance...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 18
    pprof

    pprof

    pprof is a tool for visualization and analysis of profiling data

    pprof is a profiling visualization and analysis tool that ingests profiles in the profile.proto format and generates human-readable and graph-based reports. It supports multiple profile types (CPU, heap, allocations, contention, etc.) and can present data as text tables, call graphs (via Graphviz/dot), flame graphs, and interactive web UIs. The tool helps developers find hot paths, quantify resource usage, and compare profiles across runs to validate performance changes. It is widely used in Go but also has bindings and exporters for other ecosystems, and the repository includes a Go package for reading and writing profiles programmatically. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 19
    Pomerium

    Pomerium

    Pomerium is an identity and context-aware access proxy

    ...Pomerium adds authentication and authorization to any application or server, giving IT Management a centralized panel for organization-wide control. Assert compliance in your current architecture without giving up control over data tenancy. Pomerium supports your infrastructure and can be deployed in all environments: cloud, hybrid, or on-prem. From AWS to Kubernetes and more, your internal and 3rd-party apps are covered.
    Downloads: 14 This Week
    Last Update:
    See Project
  • 20
    Telegram Drive

    Telegram Drive

    Telegram Drive

    Telegram Drive is a powerful utility that enables you to organize your telegram files and much more. Teldrive stands out among similar tools, thanks to its implementation in Go, a language known for its efficiency. Its performance surpasses alternatives written in Python and other languages, with the exception of Rust. Teldrive not only excels in speed but also offers an intuitive user interface for efficient file interaction which other tool lacks. Its compatibility with Rclone further...
    Downloads: 108 This Week
    Last Update:
    See Project
  • 21
    dasel

    dasel

    Select, put and delete data from JSON, TOML, YAML, XML and CSV files

    Dasel (short for data-selector) allows you to query and modify data structures using selector strings. Say goodbye to learning new tools just to work with a different data format. Dasel uses a standard selector syntax no matter the data format. This means that once you learn how to use dasel you immediately have the ability to query/modify any of the supported data types without any additional tools or effort.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Ninjabot

    Ninjabot

    A fast cryptocurrency platform for trading bot in Go

    A fast cryptocurrency trading bot framework implemented in Go. Ninjabot permits users to create and test custom strategies for spot markets. Ninjabot is an open-source platform that provides tools to implement custom strategies and backtests for trading cryptocurrencies in Go. Ninjabot CLI provides utilities commands to support backtesting and bot development. Currently, we only support Binance exchange. If you want to include support for other exchanges, you need to implement a new struct...
    Downloads: 136 This Week
    Last Update:
    See Project
  • 23
    MinIO

    MinIO

    High performance object storage server compatible with Amazon S3 APIs

    MinIO is a high performance object storage server that is API compatible with Amazon S3 cloud storage service. MinIO makes it easy to build high performance, cloud native data infrastructure for machine learning, analytics and application data workloads. It is incredibly fast, enabling object storage to operate as the primary storage tier for a diverse set of workloads. It is also built to be cloud native and enterprise ready. MinIO is being used worldwide in various production deployments, and is leading the way as the most downloaded object storage server in the industry.
    Downloads: 18 This Week
    Last Update:
    See Project
  • 24
    DoltgreSQL

    DoltgreSQL

    DoltgreSQL - Version Controlled PostgreSQL

    DoltgreSQL is an experimental Postgres fork that adds Git-like version control to your database. It allows users to commit, branch, merge, and revert changes to data and schema, bringing collaborative workflows to SQL databases. DoltgreSQL is designed for teams who want full auditability and control over every change made in their data layer.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 25
    Pachyderm

    Pachyderm

    Data-Centric Pipelines and Data Versioning

    Data-driven pipelines automatically trigger based on detecting data changes. Automatic immutable data lineage and data versioning of all data types. Autoscaling and parallel processing built on Kubernetes for resource orchestration. Uses standard object stores for data storage with automatic deduplication. Runs across all major cloud providers and on-premises installations.
    Downloads: 0 This Week
    Last Update:
    See Project