Search Results for "structured storage" - Page 2
Sort By:
Showing 107 open source projects for "structured storage"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Wiseflow
Enhance any agent's browser use skill
Wiseflow is an open-source information extraction and knowledge discovery system designed to collect, filter, and organize valuable information from large volumes of online content. The platform continuously monitors specified sources such as websites, social platforms, and other digital channels to identify relevant data according to user-defined interests or topics. By combining web crawling, content parsing, and large language model analysis, the system extracts concise insights from raw... -
2
YourInfo
Real-time browser fingerprinting demo with cross-browser tracking
YourInfo is a personal information management tool designed to let users securely store, structure, and retrieve their key data — such as contacts, credentials, personal notes, and preferences — while also enabling AI-assisted queries or reminders using that data. The platform prioritizes privacy by focusing on local storage or user-controlled databases, ensuring sensitive data stays under the user’s control rather than in third-party servers. Users can define types of information, tag... -
3
lmdb-js
Simple, efficient, ultra-fast, scalable data store wrapper for LMDB
This is an ultra-fast NodeJS, Bun, and Deno interface to LMDB; probably the fastest and most efficient key-value/database interface that exists for storage and retrieval of structured JS data (objects, arrays, etc.) in a true persisted, scalable, ACID compliant database. It provides a simple interface for interacting with LMDB, as a key-value db, which makes it easy to fully leverage the power, crash-proof design, and efficiency of LMDB using intuitive JavaScript, and is designed to scale across multiple processes or threads. ... -
4
CKAN
CKAN is an open-source DMS for powering data hubs
CKAN is the world’s leading open-source data portal platform. CKAN makes it easy to publish, share and work with data. It's a data management system that provides a powerful platform for cataloging, storing and accessing datasets with a rich front-end, full API (for both data and catalog), visualization tools and more.CKAN is used by national and regional government organizations throughout the European Union, the Americas, Asia, and Oceania to power a variety of official and community data... -
Earn up to 16% annual interest with Nexo.Generate interest, access liquidity without selling, and execute trades seamlessly. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
Dozzle
Realtime log viewer for containers. Supports Docker, Swarm and K8s
...It supports more advanced analysis through an in-browser SQL query engine for querying logs, which helps when you need structured filtering without exporting data elsewhere. Dozzle also supports multi-user authentication and can integrate with proxy-forward authorization setups for deployments behind gateways. For larger environments, it can monitor multiple hosts via an agent mode and supports orchestrators like Docker Swarm and Kubernetes. -
6
Deep Research
Use any LLMs (Large Language Models) for Deep Research
Deep Research is a local-first research agent that orchestrates multiple LLMs to generate in-depth reports in minutes. It combines “thinking” and “task” model roles with live internet access to plan, search, read, and synthesize findings into structured outputs. The project emphasizes privacy: processing and storage happen locally, avoiding server-side retention of your queries and notes. A simple web UI lets you enter topics and configure models, while the backend streams progress as sources are fetched and arguments are weighed. It offers MCP server support and SSE APIs, so IDEs and agent clients can drive the same workflow programmatically. ... -
7
Apache Drill
Apache Drill is a distributed MPP query layer for self describing data
Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. It was inspired in part by Google's Dremel. Get faster insights without the overhead (data loading, schema creation and maintenance, transformations, etc.) Analyze the multi-structured and nested data in non-relational datastores directly without transforming or restricting the data. Leverage your existing SQL skillsets and BI tools including Tableau, Qlikview, MicroStrategy, Spotfire, Excel and more. ... -
8
Google Cloud Platform Python Samples
Code samples used on cloud.google
Google Cloud Platform Python Samples repository is a large, curated collection of Python code examples that demonstrate how to use a wide range of Google Cloud services in real-world scenarios. It serves as a practical companion to official documentation, providing runnable snippets that illustrate how to authenticate, configure environments, and interact with APIs across products such as storage, AI services, and data processing tools. The repository is organized into product-specific... -
9
AI-Media2Doc
AI tool converting video/audio into structured documents instantly
AI-Media2Doc is a web-based application that uses large language models to convert video and audio content into structured, readable documents in a single workflow. It is designed to transform multimedia inputs into formats such as knowledge notes, summaries, mind maps, and social-style articles, making content easier to review and reuse. AI-Media2Doc emphasizes privacy by processing media locally in the browser using WebAssembly-based ffmpeg, ensuring that original video files are not... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
DotnetSpider
Lightweight .NET framework for fast web crawling and data scraping
DotnetSpider is a web crawling and data extraction framework built on the .NET Standard platform. It is designed to help developers create efficient and scalable crawlers for collecting structured data from websites. It provides a high-level API that simplifies the process of defining spiders, managing requests, and extracting content from web pages. Developers can create custom spiders by extending base classes and configuring pipelines that handle downloading, parsing, and storing collected data. DotnetSpider is modular, allowing different components such as request schedulers, downloaders, and storage systems to work together in a flexible workflow. ... -
11
WitNote
WitNote is a local-first AI writing companion for macOS and Windows
...For users who prefer to stay in command-line or keyboard-driven environments, WitNote offers efficient shortcuts that keep interactions nimble and fluid without forcing users into menus. Optional plug-ins or extensions expand its capabilities to include calendar integrations, reminders, or integration with external storage backends like Git repositories. -
12
Claude Context
Code search MCP for Claude Code
...It focuses on improving response quality by ensuring that models have access to the most relevant data when generating outputs. The system integrates with vector databases and retrieval systems, enabling efficient storage and retrieval of contextual information. It supports workflows such as retrieval-augmented generation, where external knowledge is dynamically incorporated into model responses. The project emphasizes scalability, allowing it to handle large datasets and complex queries efficiently. It also provides tools for organizing and managing context, making it easier to maintain structured knowledge bases. ... -
13
MemoryOS
MemoryOS is designed to provide a memory operating system
MemoryOS is an open-source framework designed to provide a structured memory management system for AI agents and large language model applications. The project addresses one of the major limitations of modern language models: their inability to maintain long-term context beyond the limits of their prompt window. MemoryOS introduces a hierarchical memory architecture inspired by operating system memory management principles, allowing agents to store, update, retrieve, and generate information... -
14
Prompt Master
A Claude skill that writes the accurate prompts for any AI tool
Prompt Master is a repository focused on organizing, managing, and optimizing prompts for AI systems, particularly large language models. It provides a structured way to store and reuse prompts, making it easier to maintain consistency and improve performance across different applications. The project emphasizes clarity and organization, allowing users to categorize prompts by use case, domain, or functionality. It also supports experimentation, enabling users to refine prompts and compare... -
15
Omi
AI that sees your screen and listens to conversations
The Omi project is an open-source AI wearable ecosystem developed by Based Hardware that combines hardware, software, and cloud infrastructure to create a persistent “second brain” for capturing and processing real-world interactions. It is designed as a system that continuously listens to conversations and monitors screen activity, converting this input into structured data such as transcripts, summaries, and actionable insights in real time. The platform operates across multiple environments, including wearable devices, mobile apps, and desktop applications, ensuring seamless integration into a user’s daily workflow. At its core, omi uses a pipeline of speech-to-text systems, large language models, and memory storage services to transform raw audio and context into meaningful outputs like tasks and reminders. ... -
16
Google Node.js Datastore
Node.js client for Google Cloud Datastore
Google’s Node.js Datastore client is a library for interacting with Google Cloud Datastore, a fully managed NoSQL database. It enables developers to store and query structured data in a scalable and serverless manner. The library provides an easy-to-use API for integrating Datastore into Node.js applications. -
17
Instaloader
Download pictures (or videos) along with their captions
Instaloader is a mature open-source utility for downloading and archiving Instagram content along with rich metadata. It enables users to retrieve posts, stories, reels, highlights, profile pictures, and associated information such as captions, comments, timestamps, and geotags. The tool supports both public and permitted private content when proper authentication is provided, making it useful for research, digital archiving, and social media analysis. Instaloader can be run as a simple... -
18
camofox-browser
Headless browser automation server for AI agents to visit sites
camofox-browser is a headless browser automation server built specifically for AI agents that need to interact with websites that often block standard automation stacks. It wraps Camoufox, a Firefox fork that performs fingerprint spoofing at the C++ level, which means many browser characteristics are altered before page scripts can inspect them, rather than relying on JavaScript-layer stealth patches. The project is designed around a REST API, making it easier for agents and external tools... -
19
System Design
Learn how to design systems and prepare for system design interviews
This project is an open, course-style repository designed to help you learn system design from fundamentals through advanced, interview-ready thinking. It organizes core networking and distributed-systems concepts into a structured path, so you can build intuition before jumping into “design X” exercises. It covers the building blocks that show up in real architectures, such as DNS, load balancing, caching, CDNs, proxies, scalability and availability tradeoffs, and storage patterns, then connects those pieces to larger system goals. The materials are geared toward clarity and repeatability, making it useful both for self-study and for quick review before interviews. ... -
20
Apache Druid
A high performance real-time analytics database
...Druid streams data from message buses such as Kafka, and Amazon Kinesis, and batch load files from data lakes such as HDFS, and Amazon S3. Druid supports most popular file formats for structured and semi-structured data. Druid has been benchmarked to greatly outperform legacy solutions. Druid combines novel storage ideas, indexing structures, and both exact and approximate queries to return most results in under a second. Druid unlocks new types of queries and workflows for clickstream, APM, supply chain, network telemetry, digital marketing, risk/fraud, and many other types of data. ... -
21
Smart Excalidraw
A smart, powerful, and beautiful excalidraw drawing tool
Smart Excalidraw Next is an AI-powered diagramming tool that allows users to generate professional-quality visual diagrams directly from natural language descriptions, combining generative AI with the flexibility of the Excalidraw canvas. It leverages large language models to interpret user input and automatically produce structured diagrams such as flowcharts, architecture diagrams, ER diagrams, and mind maps with logical layouts and clean visual organization. One of its key innovations is... -
22
MemPalace
The highest-scoring AI memory system ever benchmarked
MemPalace is an open-source AI memory system designed to solve one of the most persistent limitations of large language models: the loss of context between sessions. Instead of relying on summarization or selective extraction like most memory tools, it takes a radically different approach by storing conversations in their entirety and making them retrievable through structured organization and semantic search. The system is inspired by the classical “memory palace” mnemonic technique,... -
23
MineContext
MineContext is your proactive context-aware AI partner
MineContext is an open-source, proactive AI assistant designed to capture, understand, and leverage a user’s digital context in order to provide meaningful insights, summaries, and productivity support. The system continuously collects contextual data from sources such as screenshots and user activity, then processes and organizes this information into structured knowledge that can be reused later. Unlike traditional chat-based assistants, MineContext operates in the background and delivers proactive outputs such as daily summaries, task suggestions, and contextual reminders without requiring explicit prompts. It is built around a context engineering framework that manages the full lifecycle of data, including capture, processing, storage, retrieval, and consumption. ... -
24
Scrapy
A fast, high-level web crawling and web scraping framework
Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring... -
25
Pal
A personal context-agent that learns how you work
Pal is an open-source AI personal agent built within the Agno ecosystem that functions as an intelligent digital assistant designed to learn from user activity over time. The system acts as an AI-powered “second brain” capable of capturing, organizing, and retrieving personal knowledge such as notes, bookmarks, research findings, people, and meeting information. Instead of acting as a simple chatbot, Pal continuously builds a structured database of a user’s knowledge and context so it can...