Search Results for "storage"
Sort By:
Showing 691 open source projects for "storage"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
1
huey
A little task queue for python
huey is a lightweight task queue for Python applications. It gives developers a clean API for running background jobs outside the main request or execution flow. The project supports several storage backends, including Redis, Valkey, Redict, SQLite, the file system, and in-memory storage. It can execute tasks with processes, threads, or greenlets, which makes it adaptable to different workloads. Huey also supports scheduled tasks, recurring tasks, retries, task priorities, result storage, expiration, locking, rate limits, timeouts, pipelines, groups, and chords. ... -
2
command-storage
A command-line tool designed to store CLI commands for quick access
...Think of it as a simple notes app specifically tailored for storing commands using customizable keys. The package is available on PyPi:https://pypi.org/project/command-storage/ For more information, please check out the GitHub repository: https://github.com/ashu-tosh-kumar/command-storage -
3
LEANN
Local RAG engine for private multimodal knowledge search on devices
LEANN is an open source system designed to enable retrieval-augmented generation (RAG) and semantic search across personal data while running entirely on local devices. It focuses on dramatically reducing the storage overhead typically required for vector search and embedding indexes, enabling efficient large-scale knowledge retrieval on consumer hardware. LEANN introduces a storage-efficient approximate nearest neighbor index combined with on-the-fly embedding recomputation to avoid storing large embedding vectors. By recomputing embeddings during queries and using compact graph-based indexing structures, LEANN can maintain high search accuracy while minimizing disk usage. ... -
4
DVC
Data Version Control | Git for Data & Models
...It is designed to handle large files, data sets, machine learning models, and metrics as well as code. Version control machine learning models, data sets and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents. Version control machine learning models, data sets, and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents. ... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
5
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
Diskover Community Edition is an open source file system indexing and storage analytics platform designed to help organizations understand and manage large volumes of file data. It crawls file systems and indexes metadata using Elasticsearch, enabling fast search, analysis, and organization of files stored across different storage systems. It allows administrators and users to explore file structures, monitor storage usage, and gain insights into how data is distributed across infrastructure. ... -
6
smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
smart_open is a Python library for streaming very large files from local or remote storage through a familiar file-like interface. It acts as an extended replacement for Python's built-in open function. Supported backends include Amazon S3, Google Cloud Storage, Azure Blob Storage, HDFS, WebHDFS, HTTP, HTTPS, SFTP, and local filesystems. Data can be read or written without first downloading an entire remote object to disk. -
7
PyGlossary
A tool for converting dictionary files aka glossaries
A tool for converting dictionary files aka glossaries. The primary purpose is to be able to use our offline glossaries in any Open Source dictionary we like on any OS/device. There are countless formats, and my time is limited, so I implement formats that seem more useful for myself, or for Open Source community. Also diversity of languages is taken into account. Pull requests are welcome. -
8
django-dbbackup
Management commands to help backup and restore your project database
django-dbbackup is a Django management command extension for backing up and restoring databases and media files. It supports multiple storage backends including local file systems, Amazon S3, and Dropbox. Ideal for automated backup strategies, it simplifies the integration of backup logic into Django projects. -
9
PGHoard
PostgreSQL® backup and restore service
pghoard is a PostgreSQL backup and restore tool that provides encrypted, compressed, and cloud-optimized backups. Developed by Aiven, it supports streaming WAL archiving and full base backups to various cloud storage backends. pghoard is designed for reliability and fast disaster recovery in cloud-native PostgreSQL deployments. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
OpenCore Legacy Patcher
Experience macOS just like before
A Python-based project revolving around Acidanthera's OpenCorePkg and Lilu for both running and unlocking features in macOS on supported and unsupported Macs. Our project's main goal is to breathe new life into Macs no longer supported by Apple, allowing for the installation and usage of macOS Big Sur and newer on machines as old as 2007. -
11
gdown
Google Drive public file downloader when curl/wget fails
gdown is a Python downloader designed for public Google Drive files and folders that ordinary curl or wget commands may not retrieve correctly. It handles Drive confirmation pages and extracts file identifiers from several common share-link formats. Users can download individual files, recursively copy folders, choose output paths, or inspect resolved names as JSON. Google Docs, Sheets, and Slides can be exported to formats such as DOCX, XLSX, PPTX, PDF, and CSV. Interrupted transfers can... -
12
Windrecorder
Windrecorder is a memory search app by records everything
Windrecorder is an open-source personal memory search engine that continuously records on-screen activity in a highly optimized and storage-efficient format. It captures screen content locally and builds a searchable database using OCR and image understanding, allowing users to rewind and rediscover anything they have previously seen. The system indexes only meaningful visual changes, extracting text, browser data, and contextual information to improve search accuracy and reduce storage overhead. ... -
13
Back In Time
An easy-to-use backup tool for GNU Linux using rsync in the back
...It uses rsync to take manual or scheduled snapshots and stores them locally or remotely through SSH. Each snapshot is in its own folder with copies of the original files, but unchanged files are hard-linked between snapshots to save storage space. It was inspired by FlyBack. -
14
Barman
Backup and Recovery Manager for PostgreSQL
Barman (Backup and Recovery Manager) is an enterprise-grade tool for managing backups and disaster recovery of PostgreSQL databases. It supports both full and incremental backups, Point-In-Time Recovery (PITR), and remote backup via SSH. Barman is widely used by DBAs to ensure secure, reliable, and consistent backups in production environments. -
15
pandas-datareader
Extract data from a wide range of Internet sources
Up-to-date remote data access for pandas. Works for multiple versions of pandas. Install using pip and then import and use one of the data readers. This example reads 5-years of 10-year constant maturity yields on U.S. government bonds. Stable documentation is available on github.io. A second copy of the stable documentation is hosted on read the docs for more details. -
16
Borgmatic
Simple, configuration-driven backup software for servers
borgmatic is a simple, configuration-driven backup automation tool built to work with BorgBackup. It simplifies the creation, pruning, and verification of encrypted, deduplicated backups through a single YAML configuration file. Designed for both servers and desktops, borgmatic is ideal for users who want reliable, scriptable backup workflows with minimal setup and strong security. -
17
MineContext
MineContext is your proactive context-aware AI partner
...Unlike traditional chat-based assistants, MineContext operates in the background and delivers proactive outputs such as daily summaries, task suggestions, and contextual reminders without requiring explicit prompts. It is built around a context engineering framework that manages the full lifecycle of data, including capture, processing, storage, retrieval, and consumption. The platform emphasizes privacy through a local-first architecture, allowing users to keep their data stored and processed on their own device rather than relying on external cloud services. -
18
Vorta Backup Client
Desktop Backup Client for Borg Backup
Vorta is a backup client for macOS and Linux desktops. It integrates the mighty Borg Backup with your favorite desktop environment to protect your data from disk failure, ransomware and theft. -
19
MCP Server OpenDAL
Model Context Protocol Server for Apache OpenDAL™
Model Context Protocol Server for Apache OpenDAL™ is an MCP server implementation that provides access to various storage services via Apache OpenDAL. It enables seamless interactions with multiple storage backends through a unified interface. -
20
Pixeltable
Data Infrastructure providing an approach to multimodal AI workloads
Pixeltable is an open-source Python data infrastructure framework designed to support the development of multimodal AI applications. The system provides a declarative interface for managing the entire lifecycle of AI data pipelines, including storage, transformation, indexing, retrieval, and orchestration of datasets. Unlike traditional architectures that require multiple tools such as databases, vector stores, and workflow orchestrators, Pixeltable unifies these functions within a table-based abstraction. Developers define data transformations and AI operations using computed columns on tables, allowing pipelines to evolve incrementally as new data or models are added. ... -
21
Meli-Action
Download files from direct links, YouTube, Telegram, Google Play
Meli-Action is a GitHub Actions-based downloading and web archiving project designed for heavily restricted internet environments. It uses GitHub-hosted workflow runners to fetch content from direct links, YouTube, Telegram, Google Play, SoundCloud, and web pages. Downloaded files are committed into the user’s repository so they can be retrieved later through normal GitHub access. The project includes workflows for different content sources, plus a Python script that can render and save web... -
22
neural-style in TensorFlow
Neural style in TensorFlow
neural-style in TensorFlow is a TensorFlow implementation of neural style transfer. It creates a new image by combining the content of one image with the artistic style of one or more style images. The project uses TensorFlow automatic differentiation and the Adam optimizer rather than the original L-BFGS approach. Users can run it from the command line by providing a content image, style image inputs, and an output path. It supports checkpoint outputs, iteration control, style blending, and... -
23
Bunkr Downloader
Yet bunkrr album downloader
...It includes features for managing albums as a persistent library, enabling users to add, remove, or sync albums over time without re-downloading existing files. bonkrr also categorizes downloaded content into different media types such as images, videos, and archives, improving organization and usability. The use of SQLite for local storage ensures efficient tracking of downloads and metadata synchronization. Overall, bonkrr is a practical utility for users who want to maintain organized offline collections of media from online album sources. -
24
SimpDL
A tool to scrape images from SimpCity
...It enables users to download images, videos, and other media associated with specific creators or accounts, often through authenticated sessions. The project emphasizes a straightforward workflow where users provide login credentials or tokens, and the tool handles the retrieval and storage of content automatically. It is designed to reduce the complexity of manual downloading while still offering flexibility in how content is saved and organized. SimpDL typically supports batch downloads, allowing users to archive entire profiles or content collections efficiently. The tool is often used for offline access or backup purposes, especially for platforms where content may be time-limited. -
25
cloud_enum
Multi-cloud OSINT tool for discovering public cloud resources
...It works by taking user-provided keywords and generating variations through mutation wordlists, then testing these combinations against common cloud service naming patterns. cloud_enum performs both HTTP probing and DNS lookups to identify resources such as storage buckets, cloud applications, and databases that may be exposed or accessible. cloud_enum uses concurrent processing to speed up scanning, enabling efficient enumeration of large numbers of possible resource names. It can identify both publicly accessible and protected resources, helping security researchers understand the external cloud footprint of an organization.
