Search Results for "structured storage" - Page 2
Sort By:
Showing 111 open source projects for "structured storage"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Compliant and Reliable File Transfers Backed by Top Security CertificationsStop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.
-
1
SortPhotos
SortPhotos is a Python script that organizes photos and videos
SortPhotos is a Python-based command-line utility that organizes photos and videos into structured directories based on their date and time metadata. It can sort files by year, month, day, or any custom format using EXIF and other metadata tags, making it easy to transform messy collections into neatly arranged photo libraries. The tool works with both images and videos, automatically renames files if desired, and can filter which metadata groups or tags to prioritize when determining file... -
2
Deep Research
Use any LLMs (Large Language Models) for Deep Research
Deep Research is a local-first research agent that orchestrates multiple LLMs to generate in-depth reports in minutes. It combines “thinking” and “task” model roles with live internet access to plan, search, read, and synthesize findings into structured outputs. The project emphasizes privacy: processing and storage happen locally, avoiding server-side retention of your queries and notes. A simple web UI lets you enter topics and configure models, while the backend streams progress as sources are fetched and arguments are weighed. It offers MCP server support and SSE APIs, so IDEs and agent clients can drive the same workflow programmatically. ... -
3
Cloud Native Landscape
The Cloud Native Interactive Landscape filters
Cloud Native Landscape is an open-source project that serves as a comprehensive visual map and database of the cloud-native ecosystem, cataloging hundreds of tools, platforms, and services across categories such as orchestration, observability, networking, and storage. Rather than being a traditional software application, it is a curated dataset and visualization system that helps developers and organizations navigate the rapidly evolving cloud-native space. The project organizes technologies into structured categories, making it easier to understand relationships and identify tools relevant to specific use cases. ... -
4
Apache Drill
Apache Drill is a distributed MPP query layer for self describing data
Apache Drill is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. It was inspired in part by Google's Dremel. Get faster insights without the overhead (data loading, schema creation and maintenance, transformations, etc.) Analyze the multi-structured and nested data in non-relational datastores directly without transforming or restricting the data. Leverage your existing SQL skillsets and BI tools including Tableau, Qlikview, MicroStrategy, Spotfire, Excel and more. ... -
Atera - an All-in-one platform for IT managementYour IT essentials, integrated & elevated. Take your IT management from automated to autonomous, download Atera's agent to start your free trial!
-
5
CKAN
CKAN is an open-source DMS for powering data hubs
CKAN is the world’s leading open-source data portal platform. CKAN makes it easy to publish, share and work with data. It's a data management system that provides a powerful platform for cataloging, storing and accessing datasets with a rich front-end, full API (for both data and catalog), visualization tools and more.CKAN is used by national and regional government organizations throughout the European Union, the Americas, Asia, and Oceania to power a variety of official and community data... -
6
Google Cloud Platform Python Samples
Code samples used on cloud.google
Google Cloud Platform Python Samples repository is a large, curated collection of Python code examples that demonstrate how to use a wide range of Google Cloud services in real-world scenarios. It serves as a practical companion to official documentation, providing runnable snippets that illustrate how to authenticate, configure environments, and interact with APIs across products such as storage, AI services, and data processing tools. The repository is organized into product-specific... -
7
Dozzle
Realtime log viewer for containers. Supports Docker, Swarm and K8s
...It supports more advanced analysis through an in-browser SQL query engine for querying logs, which helps when you need structured filtering without exporting data elsewhere. Dozzle also supports multi-user authentication and can integrate with proxy-forward authorization setups for deployments behind gateways. For larger environments, it can monitor multiple hosts via an agent mode and supports orchestrators like Docker Swarm and Kubernetes. -
8
Claude Context
Code search MCP for Claude Code
...It focuses on improving response quality by ensuring that models have access to the most relevant data when generating outputs. The system integrates with vector databases and retrieval systems, enabling efficient storage and retrieval of contextual information. It supports workflows such as retrieval-augmented generation, where external knowledge is dynamically incorporated into model responses. The project emphasizes scalability, allowing it to handle large datasets and complex queries efficiently. It also provides tools for organizing and managing context, making it easier to maintain structured knowledge bases. ... -
9
lmdb-js
Simple, efficient, ultra-fast, scalable data store wrapper for LMDB
This is an ultra-fast NodeJS, Bun, and Deno interface to LMDB; probably the fastest and most efficient key-value/database interface that exists for storage and retrieval of structured JS data (objects, arrays, etc.) in a true persisted, scalable, ACID compliant database. It provides a simple interface for interacting with LMDB, as a key-value db, which makes it easy to fully leverage the power, crash-proof design, and efficiency of LMDB using intuitive JavaScript, and is designed to scale across multiple processes or threads. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
MemoryOS
MemoryOS is designed to provide a memory operating system
MemoryOS is an open-source framework designed to provide a structured memory management system for AI agents and large language model applications. The project addresses one of the major limitations of modern language models: their inability to maintain long-term context beyond the limits of their prompt window. MemoryOS introduces a hierarchical memory architecture inspired by operating system memory management principles, allowing agents to store, update, retrieve, and generate information... -
11
Apache Druid
A high performance real-time analytics database
...Druid streams data from message buses such as Kafka, and Amazon Kinesis, and batch load files from data lakes such as HDFS, and Amazon S3. Druid supports most popular file formats for structured and semi-structured data. Druid has been benchmarked to greatly outperform legacy solutions. Druid combines novel storage ideas, indexing structures, and both exact and approximate queries to return most results in under a second. Druid unlocks new types of queries and workflows for clickstream, APM, supply chain, network telemetry, digital marketing, risk/fraud, and many other types of data. ... -
12
Wiseflow
Enhance any agent's browser use skill
Wiseflow is an open-source information extraction and knowledge discovery system designed to collect, filter, and organize valuable information from large volumes of online content. The platform continuously monitors specified sources such as websites, social platforms, and other digital channels to identify relevant data according to user-defined interests or topics. By combining web crawling, content parsing, and large language model analysis, the system extracts concise insights from raw... -
13
DotnetSpider
Lightweight .NET framework for fast web crawling and data scraping
DotnetSpider is a web crawling and data extraction framework built on the .NET Standard platform. It is designed to help developers create efficient and scalable crawlers for collecting structured data from websites. It provides a high-level API that simplifies the process of defining spiders, managing requests, and extracting content from web pages. Developers can create custom spiders by extending base classes and configuring pipelines that handle downloading, parsing, and storing collected data. DotnetSpider is modular, allowing different components such as request schedulers, downloaders, and storage systems to work together in a flexible workflow. ... -
14
camofox-browser
Headless browser automation server for AI agents to visit sites
camofox-browser is a headless browser automation server built specifically for AI agents that need to interact with websites that often block standard automation stacks. It wraps Camoufox, a Firefox fork that performs fingerprint spoofing at the C++ level, which means many browser characteristics are altered before page scripts can inspect them, rather than relying on JavaScript-layer stealth patches. The project is designed around a REST API, making it easier for agents and external tools... -
15
AI-Media2Doc
AI tool converting video/audio into structured documents instantly
AI-Media2Doc is a web-based application that uses large language models to convert video and audio content into structured, readable documents in a single workflow. It is designed to transform multimedia inputs into formats such as knowledge notes, summaries, mind maps, and social-style articles, making content easier to review and reuse. AI-Media2Doc emphasizes privacy by processing media locally in the browser using WebAssembly-based ffmpeg, ensuring that original video files are not... -
16
Instaloader
Download pictures (or videos) along with their captions
Instaloader is a mature open-source utility for downloading and archiving Instagram content along with rich metadata. It enables users to retrieve posts, stories, reels, highlights, profile pictures, and associated information such as captions, comments, timestamps, and geotags. The tool supports both public and permitted private content when proper authentication is provided, making it useful for research, digital archiving, and social media analysis. Instaloader can be run as a simple... -
17
Smart Excalidraw
A smart, powerful, and beautiful excalidraw drawing tool
Smart Excalidraw Next is an AI-powered diagramming tool that allows users to generate professional-quality visual diagrams directly from natural language descriptions, combining generative AI with the flexibility of the Excalidraw canvas. It leverages large language models to interpret user input and automatically produce structured diagrams such as flowcharts, architecture diagrams, ER diagrams, and mind maps with logical layouts and clean visual organization. One of its key innovations is... -
18
Google Node.js Datastore
Node.js client for Google Cloud Datastore
Google’s Node.js Datastore client is a library for interacting with Google Cloud Datastore, a fully managed NoSQL database. It enables developers to store and query structured data in a scalable and serverless manner. The library provides an easy-to-use API for integrating Datastore into Node.js applications. -
19
Scrapy
A fast, high-level web crawling and web scraping framework
Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring... -
20
Pal
A personal context-agent that learns how you work
Pal is an open-source AI personal agent built within the Agno ecosystem that functions as an intelligent digital assistant designed to learn from user activity over time. The system acts as an AI-powered “second brain” capable of capturing, organizing, and retrieving personal knowledge such as notes, bookmarks, research findings, people, and meeting information. Instead of acting as a simple chatbot, Pal continuously builds a structured database of a user’s knowledge and context so it can... -
21
System Design
Learn how to design systems and prepare for system design interviews
This project is an open, course-style repository designed to help you learn system design from fundamentals through advanced, interview-ready thinking. It organizes core networking and distributed-systems concepts into a structured path, so you can build intuition before jumping into “design X” exercises. It covers the building blocks that show up in real architectures, such as DNS, load balancing, caching, CDNs, proxies, scalability and availability tradeoffs, and storage patterns, then connects those pieces to larger system goals. The materials are geared toward clarity and repeatability, making it useful both for self-study and for quick review before interviews. ... -
22
Prompt Master
A Claude skill that writes the accurate prompts for any AI tool
Prompt Master is a repository focused on organizing, managing, and optimizing prompts for AI systems, particularly large language models. It provides a structured way to store and reuse prompts, making it easier to maintain consistency and improve performance across different applications. The project emphasizes clarity and organization, allowing users to categorize prompts by use case, domain, or functionality. It also supports experimentation, enabling users to refine prompts and compare... -
23
Acontext
Context data platform for building observable, self-learning AI agents
...The platform observes agent tasks and user feedback in real time, offering robust observability into workflows and helping teams understand how agents perform over time. Acontext also supports agent self-learning by distilling structured skills and experiences from previously completed tasks, which can later be reused or searched to improve future performance. It includes tools to interact with session data, background agents that monitor progress, and a dashboard that visualizes success rates, artifacts, and learned skills. By combining persistent storage, observability, and learning capabilities, Acontext aims to make AI agents more scalable, reliable, and capable. -
24
Hollama
A minimal LLM chat app that runs entirely in your browser
Hollama is a lightweight open-source chat application designed to run entirely within the browser while interacting with large language model servers. The project provides a minimal but powerful user interface for communicating with local or remote LLMs, including servers powered by Ollama or OpenAI-compatible APIs. Because the application runs as a static web interface, it does not require complex backend infrastructure and can be easily deployed or self-hosted. Hollama supports both... -
25
Changelog.com
Changelog makes world-class developer pods
This is the open-source codebase for Changelog, a popular podcast and media site for software developers. Built with Elixir and the Phoenix framework, it serves as a real-world example of a production-grade Phoenix application. The app powers the site’s content publishing, episode distribution, and user interactions, including subscriptions and comments. It emphasizes maintainability and transparency, with clear code structure, tests, and CI/CD workflows. Because the repository is open,...