Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.
Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
Try for free
Atera all-in-one platform IT management software with AI agents
Ideal for internal IT departments or managed service providers (MSPs)
Atera’s AI agents don’t just assist, they act. From detection to resolution, they handle incidents and requests instantly, taking your IT management from automated to autonomous.
Rsync Vault Manager (rvm) is an archiving manager that uses rsync to create and maintain archives on one or more directories on seperate logical partitions (vaults).
FrincBackup means free incremental backup. It is developed for backing up a x TB NAS with storage devices in a logical volume to multiple removable storage devices, such as 500 GB USB hard drives. Files are backuped as files (not as an archive) and are readable without the need of a tool and without the need of FrincBackup itself (allthough there is a restore mode for better handling).
Written in bash, is a very simple backup tool designed for backup a system on disks attached locally (tipically USB disks).
Based on DAR (https://sourceforge.net/projects/dar/), it suppports continously backup (using LVM snapshots and incremental backups).
Once installed there are only two configuration files:
- /etc/bkdar.conf where you define _how_ the backup is perfmored
- /etc/cron.d/bkdar where you define _when_ the backup is performed
All my USB Contents is a media cataloging tool to index media contents
...You can perform searches by entering the song title, artist, filename and the program tells you on which device the file is. Moreover categorizing the various files and folders you can put everything according to logical group
Complete storage and backup system with web administration that integrates many useful tools. Support logical volumes, snapshots, CIFS and NFS shares, tape drives, libraries, VTL's, iSCSI devices, etc. Manage users and roles, and easy restore.
Media Organizer is nice utility aimed to work with data archives (diskettes, CDs, ZIPs, DVDs, other content archives). MO provides two levels of view and services: physical media level and logical block level.