With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Cloud tools for web scraping and data extraction
Deploy pre-built tools that crawl websites, extract structured data, and feed your applications. Reliable web data without maintaining scrapers.
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
HarvestMan is a fully functional, multithreaded webcrawler cum offline-browser. It is highly customizable and supports as much as 55 plus options for controlling and customizing offline browsing. It is written entirely in the Python programming language.
Checks given webpages for backlinks and scans for image links and keywords.
Uses DOM-based methods to scan for backlinks, which are more sophisticated than simple text scanning (one example: they ignore commented out source code).
Strawberry allows you to store, manage, classify and consult your preferred links. As a web application (running with Mother framework), you can access your bookmarks from everywhere if runned on a server.
It's a modern take on desktop management that can be scaled as per organizational needs.
Desktop Central is a unified endpoint management (UEM) solution that helps in managing servers, laptops, desktops, smartphones, and tablets from a central location.
Protection by an optimized hosts file. Over 29300 DNS entires against Tracking, Adware, Spyware, Viruses, Popups and Redirecting. For more security and privacy. Points the insecure domains to the localhost that they don't get resolved by DNS Servers
Cross platform GUI managing bookmarks and shortcuts in a portable way. Support import/export, search, encryption, hierarchical tags, USB key installation, various environments integration, OS-dependent shortcuts, plugins extensibility.
free2share (f2s) is a new way of sharing your files that combines the power of peer2peer and speed of http, splitting and hiding your files in various images to be uploaded to free image servers.
=DOES NOT WORK ANYMORE AS DSA HAS PUT CAPTCHA= DSA Practical Driving Test Monitor helps you find any available practical driving test slot within specified date range. Runs on Linux/Mac/Windows and automates your manual task of finding the test slot.
OrangeHRM provides a world-class HRIS experience and offers everything you and your team need to be that HR hero you know that you are.
Give your HR team the tools they need to streamline administrative tasks, support employees, and make informed decisions with the OrangeHRM free and open source HR software.
Morebot is a test tool which crawls/spiders a designated web site. Morebot is a thin layer on top of httpunit, and is especially suitable for testing web applications which have login authentication via a web page (form) or via HTTP basic authentication.
WebWatcher - a Web-page Update Monitor This program will help you keep an eye on interesting Web-pages. You register a list of URLs you want to monitor, and WebWatcher checks for changes whenever you ask it to, or at given intervals. WebWatcher bases
CekTKP Create many short URLs (tinyurl.com, bit.ly and many more) from one website. You can also EXTRACT or retrieve the original URL that already shortened. It's useful to preview where exactly you will be redirected before you click that short URL.
Provides multi-language 404 error page and can rewrite URL. Can do timed redirect or wait for click. Supports the following languages: English, Spanish, German, French, Italian, Dutch, Greek and Portugese.
The Backlinkchecker is used to analyze how many inbound links there are for your website. Its developed in PHP, JavaScript and MySQL. It uses the great Javascript lib extjs and the php lib snoopy.php.
FoxBAT was made in an attempt to see if Naïve Bayesian filtering commonly used for spam filtering could be employed in the World Wide Web context. The application consists of a Firefox extension (.XPI package) and a Perl server script.
The purpose of this project is to gauge website page loading speed as aspect of client through web management system, Leech. Leech says, "Leech bot reachs hosts via URL Information and sucks http responses!"
Checkbot is a tool to verify links on a set of HTML pages. Checkbot can check a single document, or a set of documents on one or more servers. Checkbot creates a report which summarizes all links which caused some kind of warning or error.
SpongeStats est un outil développé en PHP/MySQL/AJAX pour visualiser les statistiques de fréquentation et analyser le référencement d'un site Internet. SpongeStats is a analysis tools for your web site developped in PHP/MySQL/AJAX.
MWQL is an extension to MediaWiki, providing (end) users with a language for structural queries, so that they can build dynamic pages as seen in the Special pages of Wikipedia.
Ruya is a Python-based breadth-first, level-, delayed, event-based-crawler for crawling English, Japanese websites. It is targeted solely towards developers who want crawling functionality in their projects using API, and crawl control.