Deploy pre-built tools that crawl websites, extract structured data, and feed your applications. Reliable web data without maintaining scrapers.
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
Explore 10,000+ tools
DAT Freight and Analytics - DAT
DAT Freight and Analytics operates DAT One truckload freight marketplace
DAT Freight & Analytics operates DAT One, North America’s largest truckload freight marketplace; DAT iQ, the industry’s leading freight data analytics service; and Trucker Tools, the leader in load visibility. Shippers, transportation brokers, carriers, news organizations, and industry analysts rely on DAT for market trends and data insights, informed by nearly 700,000 daily load posts and a database exceeding $1 trillion in freight market transactions. Founded in 1978, DAT is a business unit of Roper Technologies (Nasdaq: ROP), a constituent of the Nasdaq 100, S&P 500, and Fortune 1000. Headquartered in Beaverton, Ore., DAT continues to set the standard for innovation in the trucking and logistics industry.
`archivemail' is a tool written in python for archiving and compressing old email in mailboxes.
It can move messages that are older that the specified number of days to a mbox-format mailbox
compressed with gzip, or optionally just delete old email.
Cyclone is an easy to use, one- or two-way synchronization tool. It use a clean command-line interface. It aims to be compact (less than 10 Ko) and cross-platform (as it is coded in standard python).
Old version of https://github.com/hepix-virtualisation/vmimagemanager
This is the old version of vmimagemanager and is kept for historical interest. For a more useful and uptodate application please look here.
https://github.com/hepix-virtualisation/vmimagemanager
vmimagemanager.py is a commandline libvirt client and virtual machine image management python script. It is intended for backing up snapshotting. It supports libvirt, mount (re)store images, booting virtual machines. Its simple and fast to use.
Axe Credit Portal - ACP- is axefinance’s future-proof AI-driven solution to digitalize the loan process from KYC to servicing, available as a locally hosted or cloud-based software.
Banks, lending institutions
Founded in 2004, axefinance is a global market-leading software provider focused on credit risk automation for lenders looking to provide an efficient, competitive, and seamless omnichannel financing journey for all client segments (FI, Retail, Commercial, and Corporate.)
FileUniq identifies duplicate files, and optionally removes them or replaces them with hard or soft links. It is designed to work well with heavily hard-linked cp -al / rsync backups. For more information please see http://fileuniq.sourceforge.net
Console program that allows you to backup your personal twitter account. Should run regulary as a cron job. Uses the Twitter API, therefore should run for compatible services like Identi.ca also. Later, some reporting functionality will be added.
mysql_innodb_backup is just an 'automation' and 'simplification' of existing MySQL server command tools. It can be called with one line to backup or restore InnoDB or MyISAM databases without interrupting operations.
Easy Backup is a simple backup application written in Python that can backup selected files and save them into tar files. It also backs up the ownership and permissions of the file.
A first-of-its-kind homeownership solution that puts YOU at the center of the coveted lifetime consumer relationship.
BoldTrail, the #1 rated real estate platform, is built to power your entire brokerage with next-generation technology your agents will use and love. Showcase your unique brand with customizable websites for your company, offices, and every agent. Maximize lead capture with a modern, portal-like consumer search experience and intelligent behavior tracking. Hyper-local area pages, home valuation pages and options for rich lifestyle data keep customers searching with your brokerage as the local experts. The most robust lead gen tools on the market help your brokerage, teams & agents effectively drive new business - no matter their budget. Empower your agents to generate free leads instantly with our simple to use landing pages & IDX squeeze pages. Drive more leads with higher quality and lower cost through in-house tools built within the platform. Diversify lead sources with our automated social media posting, integrated Google and Facebook advertising, custom text codes and more.
ImapArchiver is a tool which can be used to save the all imap account into a local directory/archive. The ideal objective is to used it with cron to automatically make a back up of your imap account
Gbacker is a program to backup and restore files using a Gmail mail account.
It uses the Gmail account as a remote file server.
In contrast to other similar solutions like gdrive, gmailsync etc
gbacker is fully compliant with the Gmail terms of use.
Nhopkg is a lightweight and powerfull package manager system for unix like operating systems. Nhopkg can install, remove, update, search and manage software packages (.nho).
A simple keylogger written in python. It is primarily designed for backup purposes, but can be used as a stealth keylogger, too. It does not raise any trust issues, since it is a set of [relatively] short python scripts that you can easily examine.
cfv is a utility to both test and create .sfv(Simple File Verify), .csv, .crc, md5sum, bsd md5, sha1sum, and .torrent files. cfv also includes test-only .par and .par2 support. These are commonly used to ensure the correct retrieval or storage of data
Chestnut package manager is a utility to handle executables and resource files in a transparent, platform independent and relocatable way. Its concept is similar to Apple bundles and Java archives.
Backtory is a slim backup/restore software for unix-like operating systems, designed for stand-alone internet servers. It features differential backups, remote storage using various protocols as well as encryption/signing of backup archives.
pywincedb is a Python module to access native Windows CE databases and set of tools to manipulate them (conversion to/from XML, migration). Keywords: Python, WindowsCE, WinCE.
rnb - Really Nice Backup - Commandline tool for backing up your files to a removabe drive.
This program is not under active development.
Known bugs in the current version:
- Automatic mounting of the backup drive does not work. This can be worked around by mounting the drive before running the program.
- Installation fails in some newer distributions.
A set of tools to build your own customed Linux distribution with more managability than raw LFS(Linux From Scratch). Include source package manager, file system backup and realtime mirror apps, and some assistant data structure writen in Python, etc...
A special backup program for the SOHO sector. It implements a full-backup strategy, a mix between the backup schemes of GFS and Tower of Hanoi. It is meant for backing up onto DVDs or simular media normally via cron. Reports are sent via mail.
Create email archives getting IMAP mailfolders or POP3 mailboxes. Search emails by sender/receiver/subject/body among already existing backup files (i.e. on dvd) in plain or compressed format. Tested on Linux-x86, Linux-PPC and Windows-XP platforms.
Pybu is a backup script written in python that is intended for single machine backups e.g. dedicated servers. Planned main features include: incremental backups, ftp upload, and gpg encryption.