Deploy pre-built tools that crawl websites, extract structured data, and feed your applications. Reliable web data without maintaining scrapers.
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
Explore 10,000+ tools
Free and Open Source HR Software
OrangeHRM provides a world-class HRIS experience and offers everything you and your team need to be that HR hero you know that you are.
Give your HR team the tools they need to streamline administrative tasks, support employees, and make informed decisions with the OrangeHRM free and open source HR software.
Provides multi-language 404 error page and can rewrite URL. Can do timed redirect or wait for click. Supports the following languages: English, Spanish, German, French, Italian, Dutch, Greek and Portugese.
A bash shell script which utilizes wGet to download rapidshare URLS from a "Download Basket" in Linux distros
- Has configuration support (sets up wGet cookies, download directory, download basket)
- Checks for files that have already been downloaded
Environment Control and Life Support System TCP/SSL/HTTPS Web Server Connection Monitor.Status Connection Evaluation and Monitoring Program of TCP family Servers. OpenSSL connection handling, XML Configuration and XSL Rendering.
Axe Credit Portal - ACP- is axefinance’s future-proof AI-driven solution to digitalize the loan process from KYC to servicing, available as a locally hosted or cloud-based software.
Banks, lending institutions
Founded in 2004, axefinance is a global market-leading software provider focused on credit risk automation for lenders looking to provide an efficient, competitive, and seamless omnichannel financing journey for all client segments (FI, Retail, Commercial, and Corporate.)
The Backlinkchecker is used to analyze how many inbound links there are for your website. Its developed in PHP, JavaScript and MySQL. It uses the great Javascript lib extjs and the php lib snoopy.php.
FoxBAT was made in an attempt to see if Naïve Bayesian filtering commonly used for spam filtering could be employed in the World Wide Web context. The application consists of a Firefox extension (.XPI package) and a Perl server script.
The purpose of this project is to gauge website page loading speed as aspect of client through web management system, Leech. Leech says, "Leech bot reachs hosts via URL Information and sucks http responses!"
All-in-one security tool helps you prevent ransomware and breaches.
SIEM + Detection and Response for IT Teams
Blumira’s detection and response platform enables faster resolution of threats to help you stop ransomware attacks and prevent data breaches. We surface real threats, providing meaningful findings so you know what to prioritize. With our 3-step rapid response, you can automatically block known threats, use our playbooks for easy remediation, or contact our security team for additional guidance. Our responsive security team helps with onboarding, triage and ongoing consultations to continuously help your organization improve your security coverage.
Checkbot is a tool to verify links on a set of HTML pages. Checkbot can check a single document, or a set of documents on one or more servers. Checkbot creates a report which summarizes all links which caused some kind of warning or error.
SpongeStats est un outil développé en PHP/MySQL/AJAX pour visualiser les statistiques de fréquentation et analyser le référencement d'un site Internet. SpongeStats is a analysis tools for your web site developped in PHP/MySQL/AJAX.
MWQL is an extension to MediaWiki, providing (end) users with a language for structural queries, so that they can build dynamic pages as seen in the Special pages of Wikipedia.
This project is designed to optimize search engine results by managing your web server sitemaps. The software combines both command line processes and a web user interface with a highly configurable architecture.
Ruya is a Python-based breadth-first, level-, delayed, event-based-crawler for crawling English, Japanese websites. It is targeted solely towards developers who want crawling functionality in their projects using API, and crawl control.
This is simple link checker. It can crawl any site and help to find broken links. It also having download CSV report option.The CSV file includes url ,parent page url and status of page [broken or ok]. It is be very useful for search engine optimization.
NOCm stands for `NSUers Online Community Monitor`. It's task is to monitor NOC (`NSUers Online Community`) continuously and notify as soon as there is a new post in NOC.
The OpenWebsuite.org contains the powerful HTML-Editor (X)HTML-Format and the Site analysing tool WebAnalyse. It includes a project management, css editor, link-check (for whole domains) and much more. It was released under the GNU GPL to find helper.
Bookmark-Manager is an advanced bookmark management utility for Windows supporting importing/exporting and merging of Internet Explorer favorites, Opera hotlists, Mozilla, Netscape, and Firefox bookmarks, XBEL, and HTML lists.
Get notified when specific parts of web/ftp pages have been modified.
Usefull to get new release of softwares, updates of files or pages...
Made with perl scripts. Need a sql database. (inspired from dodchecker (c)dodfr)
Aracnis is a Java based framework for building distributed web spiders. These spiders can be used to accomplish a variety of tasks, for example, screen-scraping and link integrity checking.