Search Results for "structured storage"
Sort By:
Showing 107 open source projects for "structured storage"
View related business solutions-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
Streamline Azure Security with Palo Alto Networks VM-SeriesImprove your security posture and reduce incident response time. Use the VM-Series to natively analyze Azure traffic and dynamically drive policy updates based on workload changes.
-
1
HDF5
Official HDF5® Library Repository
HDF5 (Hierarchical Data Format v5) is a widely-used data management library and file format for storing large and complex scientific data sets efficiently. -
2
Recordly
Recordly is an open‑source screen recorder for MacOS/Windows/Linux
Recordly is a lightweight recording and data capture tool designed to streamline the process of collecting, organizing, and replaying structured information, likely oriented toward developers or productivity workflows. The project focuses on simplicity and speed, allowing users to record interactions or data streams with minimal configuration while maintaining clarity and usability. It appears to function as a logging or session recording utility that can be used for debugging, auditing, or... -
3
Apache Spark
A unified analytics engine for large-scale data processing
...Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. With Spark Streaming (microbatches) and Structured Streaming, it delivers low-latency event processing suitable for real-time analytics. The built-in MLlib library provides scalable machine learning algorithms, while GraphX enables graph computations integrated with data pipelines. Spark supports multiple languages—Scala, Java, Python, R—and connects with many storage systems like HDFS, S3, Cassandra, and streaming platforms like Kafka, making it a versatile choice for big data workloads in analytics, ETL, and data science. -
4
SlateDB
A cloud native embedded storage engine built on object storage
Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage to provide bottomless storage capacity, high durability, and easy replication. SlateDB is an embedded storage engine built as a log-structured merge-tree. Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage (S3, GCS, ABS, MinIO, Tigris, and so on). Leveraging object storage allows SlateDB to provide bottomless storage capacity, high durability, and easy replication. ... -
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
Anna’s Archive
Comprehensive search engine for books, papers, comics, magazines
...The project includes all the infrastructure required to run a full instance locally or in production, combining web servers, databases, and search indexing systems into a scalable architecture. It relies heavily on technologies such as Elasticsearch for search functionality and MariaDB for structured data storage, enabling fast and efficient querying across massive datasets. The system is designed with redundancy and replication in mind, allowing distributed deployments and mirrored environments to handle high traffic and large data volumes. It also includes tooling for importing datasets, managing metadata, and maintaining structured archives using custom formats. -
6
Unstract
No-code LLM Platform to launch APIs and ETL Pipelines
...It integrates a visual Prompt Studio environment where users can iteratively design extraction schemas, compare outputs from different models, and monitor costs and accuracy side by side, making it easier to refine prompts and extraction logic before deploying at scale. Unstract supports deploying structured extraction as REST API endpoints or embedding it into data engineering ETL pipelines, which allows it to plug directly into data warehouses, cloud storage, or downstream analytics systems. Its platform works with a broad variety of file types — from PDFs and spreadsheets to images — and includes integrations with databases, cloud storage providers, and vector databases. -
7
Alexandrie
Web application for Markdown note taking
Alexandrie is a fast, modern, and open-source web application for taking and organizing notes using an extended Markdown syntax, designed for students, creators, and knowledge workers. It offers a structured note-taking experience with support for workspaces and categories, making it easy to organize large repositories of information intuitively. The application runs as a responsive web interface that works online or offline, with search and export features that help users retrieve and reuse their content effectively. Built with a clear focus on productivity, Alexandrie includes support for custom storage backends like S3-compatible services or local file systems via Docker Compose setups. ... -
8
Cockpit Content Platform
Cockpit Core - Content Platform
Cockpit is a flexible, API-first content management system (CMS) designed for developers who need a headless CMS to manage structured content for websites and applications. -
9
OpenViking
Context database designed specifically for AI Agents
...The project is implemented with performance in mind, often leveraging optimized data structures that balance fast reads and writes with minimal resource consumption. Developers can integrate OpenViking into modern AI stacks to unify context storage across services, enabling consistent session history, personalized responses, and richer search experiences. -
Compliant and Reliable File Transfers Backed by Top Security CertificationsStop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.
-
10
GBrain
Garry's Opinionated OpenClaw/Hermes Agent Brain
GBrain is an open-source AI memory system designed to give autonomous agents persistent, structured, and scalable long-term memory across interactions and workflows. It operates by transforming large collections of markdown documents, personal notes, and external data into a searchable knowledge base backed by PostgreSQL and vector embeddings, enabling both semantic and keyword-based retrieval. The system is tightly integrated with agent frameworks such as OpenClaw and Hermes, allowing AI... -
11
Memary
The Open Source Memory Layer For Autonomous Agents
Memary is a journaling and personal memory management application that helps users record and retrieve past experiences. It focuses on simplicity, ease of use, and structured data storage for personal reflections and knowledge tracking. -
12
Sanity
Rapidly configure content workspaces powered by structured content
Sanity is an open-source real-time headless content management system that allows developers to manage structured content for websites, applications, and digital platforms. At the core of the system is Sanity Studio, a customizable editing environment built with React that can be configured to match the workflows and content models of different teams. Instead of using predefined content templates, Sanity allows developers to define schemas in code that determine how content is structured and... -
13
EverMemOS
Long-term memory OS for AI with structured recall and context awarenes
EverMemOS is an open-source memory operating system built to give AI agents long-term, structured memory. It captures conversations, transforms them into organized memory units, and enables agents to recall past interactions with context and meaning. Instead of treating each prompt independently, it builds evolving user profiles, tracks preferences, and connects related events into coherent narratives. Its architecture combines memory storage, indexing, and retrieval with agent-level reasoning, allowing AI systems to make informed decisions based on prior interactions. ... -
14
Eidos
An extensible framework for Personal Data Management
Eidos is an extensible personal data management platform designed to help users organize and interact with their information using a local-first architecture. The system transforms SQLite into a flexible personal database that can store structured and unstructured information such as notes, documents, datasets, and knowledge resources. Its interface is inspired by tools like Notion, allowing users to create documents, databases, and custom views to organize personal information. Unlike cloud-based knowledge tools, Eidos runs entirely on the user’s machine, ensuring privacy and high performance through local storage. -
15
OpenMemory
Local long-term memory engine for AI apps with persistent storage
OpenMemory is a self-hosted memory engine designed to provide long-term, persistent storage for AI and LLM-powered applications. It enables developers to give otherwise stateless models a structured memory layer that can store, retrieve, and manage contextual information over time. OpenMemory is built around a hierarchical memory architecture that organizes data into semantic sectors and connects them through a graph-based structure for efficient retrieval. -
16
ReMe
Memory Management Kit for Agents
ReMe is a memory management kit for AI agents that gives them structured, persistent memory capabilities, enabling agents to extract, store, and reuse information across sessions, tasks, and interactions. It is designed to support long-running agent workflows where context matters and working memory alone isn’t enough, helping agents remember user preferences, task histories, and relevant past observations. -
17
Bunkr Downloader
Yet bunkrr album downloader
...The use of SQLite for local storage ensures efficient tracking of downloads and metadata synchronization. Overall, bonkrr is a practical utility for users who want to maintain organized offline collections of media from online album sources. -
18
Beads
A memory upgrade for your coding agent
...This approach helps coding agents — and human collaborators — track which tasks depend on others, what has been done, and where workflows branch or reunify without losing important data. By leveraging Git as the storage backbone, the project ensures that memory is persistent, diffable, and sharable, with the ability to roll back, branch, or merge memory states just like source code. -
19
news-please
Python tool for crawling and extracting structured data from news site
...Developers can use the software either as a standalone command line application or integrate it into their own Python applications through its library interface. Extracted article data can be stored in different formats and systems, including JSON files or database-backed storage solutions. -
20
eXist-db
eXist Native XML Database and Application Platform
eXist-db is an open-source, native XML database and application platform that provides a powerful environment for storing, querying, and managing XML documents. It is designed for complex data management needs, offering XQuery, XSLT, and RESTful web services for interacting with structured data. -
21
memsearch
A Markdown-first memory system, a standalone library for any AI agent
memsearch is a markdown-first memory system designed to provide long-term memory capabilities for AI agents through structured storage and semantic retrieval. It enables agents to store, organize, and retrieve information using embeddings and hybrid search techniques, ensuring that relevant context is always available. The system supports advanced features such as reranking and progressive disclosure, which help prioritize the most useful information for a given query. ... -
22
PHP FFmpeg - Video Streaming
Package media content for online streaming(DASH and HLS) using FFmpeg
...The library supports multiple video representations, allowing seamless playback across varying network conditions. It also includes encryption capabilities for DRM, making it suitable for secure media delivery. Developers can integrate cloud storage services to load and store media assets efficiently. The project emphasizes scalability and automation, enabling both on-demand and live streaming workflows. Its architecture simplifies complex transcoding pipelines into structured, programmable steps. -
23
Apache HBase
Get random, realtime read/write access to your Big Data
...This project's goal is the hosting of very large tables, billions of rows X millions of columns, atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable. A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options. Support for exporting metrics via the Hadoop metrics subsystem to files or Ganglia; or via JMX. ... -
24
SortPhotos
SortPhotos is a Python script that organizes photos and videos
SortPhotos is a Python-based command-line utility that organizes photos and videos into structured directories based on their date and time metadata. It can sort files by year, month, day, or any custom format using EXIF and other metadata tags, making it easy to transform messy collections into neatly arranged photo libraries. The tool works with both images and videos, automatically renames files if desired, and can filter which metadata groups or tags to prioritize when determining file... -
25
TanStack DB
A reactive client store for building super fast apps
TanStack DB (beta) is a lightweight, embedded database-like library designed to manage structured data directly in client or server-side JavaScript environments, offering stateful data stores that work seamlessly with the TanStack ecosystem. Blazing‑fast query engine for sub‑millisecond live queries, joins & aggregates. Fine‑grained reactivity to minimize component re‑rendering. Robust transaction primitives for optimistic mutations with sync & lifecycle support. Normalized data model that...