Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.
Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
Try for free
Automated RMM Tools | RMM Software
Proactively monitor, manage, and support client networks with ConnectWise Automate
Out-of-the-box scripts. Around-the-clock monitoring. Unmatched automation capabilities. Start doing more with less and exceed service delivery expectations.
larra provides some simple interfaces for archive access.
The main feature is that it uses the same interface for directories and archives, which allows archive-in-archive access (like .tar.gz).
For file access a seekable stream interface is used.
gzx is a C library and a command line tool for fully GZIP-compliant file compression with fast random access read support. gzx includes a FUSE (filesystem in userspace) client that allows to access the compressed files with arbitrary applications.
The RAZip bitstream format was designed to provide a faster
random access to compressed data than what is currently
possible using the GZIP format. During the desing phase,
some other features were added, like encryption and error correction.