Search Results for "structured storage"
Sort By:
Showing 20 open source projects for "structured storage"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
RocksDB
A library with an embeddable, persistent key-value store for storage
RocksDB uses a log structured database engine, written entirely in C++, for maximum performance. Keys and values are just arbitrarily-sized byte streams. RocksDB is optimized for fast, low latency storage such as flash drives and high-speed disk drives. RocksDB exploits the full potential of high read/write rates offered by flash or RAM. RocksDB is adaptable to different workloads. -
2
Apache Spark
A unified analytics engine for large-scale data processing
...Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. With Spark Streaming (microbatches) and Structured Streaming, it delivers low-latency event processing suitable for real-time analytics. The built-in MLlib library provides scalable machine learning algorithms, while GraphX enables graph computations integrated with data pipelines. Spark supports multiple languages—Scala, Java, Python, R—and connects with many storage systems like HDFS, S3, Cassandra, and streaming platforms like Kafka, making it a versatile choice for big data workloads in analytics, ETL, and data science. -
3
Apache Drill
Apache Drill is a distributed MPP query layer for self describing data
Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. It was inspired in part by Google's Dremel. Get faster insights without the overhead (data loading, schema creation and maintenance, transformations, etc.) Analyze the multi-structured and nested data in non-relational datastores directly without transforming or restricting the data. Leverage your existing SQL skillsets and BI tools including Tableau, Qlikview, MicroStrategy, Spotfire, Excel and more. ... -
4
Google Cloud Platform Python Samples
Code samples used on cloud.google
Google Cloud Platform Python Samples repository is a large, curated collection of Python code examples that demonstrate how to use a wide range of Google Cloud services in real-world scenarios. It serves as a practical companion to official documentation, providing runnable snippets that illustrate how to authenticate, configure environments, and interact with APIs across products such as storage, AI services, and data processing tools. The repository is organized into product-specific... -
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
5
Scrapy
A fast, high-level web crawling and web scraping framework
Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring... -
6
System Design
Learn how to design systems and prepare for system design interviews
This project is an open, course-style repository designed to help you learn system design from fundamentals through advanced, interview-ready thinking. It organizes core networking and distributed-systems concepts into a structured path, so you can build intuition before jumping into “design X” exercises. It covers the building blocks that show up in real architectures, such as DNS, load balancing, caching, CDNs, proxies, scalability and availability tradeoffs, and storage patterns, then connects those pieces to larger system goals. The materials are geared toward clarity and repeatability, making it useful both for self-study and for quick review before interviews. ... -
7
Changelog.com
Changelog makes world-class developer pods
This is the open-source codebase for Changelog, a popular podcast and media site for software developers. Built with Elixir and the Phoenix framework, it serves as a real-world example of a production-grade Phoenix application. The app powers the site’s content publishing, episode distribution, and user interactions, including subscriptions and comments. It emphasizes maintainability and transparency, with clear code structure, tests, and CI/CD workflows. Because the repository is open,... -
8
aws-devops-zero-to-hero
AWS zero to hero repo for devops engineers to learn AWS in 30 Days
aws-devops-zero-to-hero is a 30-day AWS learning roadmap aimed squarely at DevOps engineers who want both conceptual understanding and hands-on projects. The README is structured as a day-by-day syllabus, starting with “Day 1: Introduction to AWS” and moving through IAM, EC2, VPC networking, security, DNS (Route 53), storage (S3), and many other core services. Each day mixes explanation with at least one concrete project or lab, such as deploying applications on EC2, designing secure VPCs, setting up CI/CD pipelines, or configuring CloudWatch monitoring. ... -
9
Substrate Node Template
A rust implementation of the Quip Protocol forked from Substrate
...It also includes tools for running single-node or multi-node networks, enabling developers to simulate distributed consensus systems locally. The architecture is designed for extensibility, allowing custom consensus algorithms, storage models, and transaction logic to be integrated. -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
10
Pachyderm
Data-Centric Pipelines and Data Versioning
...Automatic immutable data lineage and data versioning of all data types. Autoscaling and parallel processing built on Kubernetes for resource orchestration. Uses standard object stores for data storage with automatic deduplication. Runs across all major cloud providers and on-premises installations. Automatic and intelligent versioning of even the largest data sets of unstructured and structured data. Git-like structure enables effective team collaboration. Full versioning for metadata including all analysis, parameters, artifacts, models, and intermediate results. ... -
11
FlowLens MCP
Open-source MCP server that gives your coding agent
FlowLens MCP Server is an open-source tool designed to give AI-powered coding agents (like Claude Code, Cursor, GitHub Copilot / Codex, and others) full, replayable browser context to dramatically improve debugging, bug reporting, and regression testing for web applications. It works together with a companion browser extension: when a user reproduces a bug or a complicated UI interaction, the extension captures a rich session log, including screen/video recording, network traffic, console... -
12
Doctor Dok
Doctor Dok is an AI based medical data framework
Store, manage, and understand your medical history in one secure place that only you can access. Built to protect your privacy with full end-to-end encryption. Convert all your Blood Tests, MRI Scans, TK Scans, Visit reports, and Hospital Admission Reports to JSON, safely store in the cloud, and discuss, annotate, and translate them with AI. Doctor Dok is a secure storage, digitization, sharing, and AI discovery platform for all your family and/or folder health data. All health history -... -
13
DocWire SDK
Award-winning modern data processing SDK in C++20
DocWire SDK, a standout C++20AI driven data processing tool, has received award from SourceForge and strong backing from Microsoft. It handles nearly 100 file types, empowering efficient text extraction, web data extraction, and document analysis. For businesses, the shift to DocWire SDK signifies a leap forward. It promises comprehensive document format support and the ability to extract valuable insights from email boxes, databases, and websites using cutting-edge AI. DocWire SDK aims to... -
14
OpenMCDF
Structured Storage .net component - pure C#
OpenMCDF is a 100% .net / C# component that allows developers to manipulate Microsoft Compound Document File Format for OLE structured storage. It supports read/write operations on streams and storages and traversal of structures tree. Development and issue tracking has moved to github platform at https://github.com/ironfede/openmcdf -
15
Unified Code Generation
Open-source code generator for Simulink/Stateflow
...Currently a Simulink and Stateflow front-end and a C-language back-end are included. Some of the strengths of UCGN: - Clearly readable source-code - Separation of functionality and parameters ("tunable parameters") - Robust data storage (compile-time static structures in favor of pointer run-time constructs) - Clear software architecture, direct correspondence to the model architecture - Separation of reusable library code - Simplicity and uniformity of software interfaces (for testing etc.) The following features are supported by the Simulink/UCGN - Discrete single-rate Simulink models and libraries - Block library with 50+ standard Simulink blocks - Periodic, condition-driven Stateflow charts (including flowgraphs, loops) - Structured data types through bus objects - Simulink native enumer -
16
chibicc
A small C compiler
...Despite being categorized as a “toy” compiler, it is powerful enough to compile real-world programs such as Git, SQLite, and libpng without modification. The project is structured incrementally, with each commit representing a step in building a full compiler, making it particularly valuable for educational purposes. It includes support for advanced C features such as floating-point types, variable-length arrays, thread-local storage, and atomic operations. Chibicc also provides clear error messages, helping developers understand compilation issues more effectively. -
17
PowerShellForGitHub
Microsoft PowerShell wrapper for GitHub API
...The module handles authentication flows, pagination, and rate-limit concerns transparently so scripts can focus on business logic like triage, bulk updates, or migration tasks. Because it returns structured objects, outputs are easy to pipe into other PowerShell commands for filtering, reporting, or storage. This makes it a natural fit for CI/CD orchestrations, scheduled housekeeping jobs, or bulk on-boarding workflows where manual web UI clicks would be tedious and error-prone. With commands that mirror everyday GitHub activities, the module helps integrate repository management into standard PowerShell automation estates. -
18
REST Layer
REST Layer, Go (golang) REST API framework
REST Layer is a Go framework for building customizable REST APIs on top of pluggable storage backends. It is inspired by Python Eve and aims to reduce repetitive API boilerplate while still allowing developers to model business-specific resources. The framework focuses on schema-driven resources, validation, filtering, hooks, and storage abstraction. It is useful for teams that want to expose structured data through a REST interface without hand-writing every endpoint from scratch. ... -
19
POLE is a portable C++ library to access structured storage, allowing a file system within a file. Structured storage created by POLE is compatible with Microsoft Structured Storage (also called OLE Compound Document), which is used in Microsoft Office.
-
20
Metakit is an efficient database library with a small footprint. It's a cross between flat-file, RDBMS, and OODBMS. Keywords: structured storage, transacted, load on-demand, portable, C++, Python, Tcl, instant schema versioning.
- Previous
- You're on page 1
- Next