With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Cloud tools for web scraping and data extraction
Deploy pre-built tools that crawl websites, extract structured data, and feed your applications. Reliable web data without maintaining scrapers.
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
Memephage is an automated web log (blog). It passively gathers and summarizes links from various places. Currently: IRC, social MUDs, e-mail, and web browsers. Uses the POE multitasking and networking framework for Perl.
Checks links in HTML files. Checks almost any tag attributes known to contain references to other resources. Supports multithreading. Written in Java. Frontends for Console and AWT available, Swing in development.
Axe Credit Portal - ACP- is axefinance’s future-proof AI-driven solution to digitalize the loan process from KYC to servicing, available as a locally hosted or cloud-based software.
Banks, lending institutions
Founded in 2004, axefinance is a global market-leading software provider focused on credit risk automation for lenders looking to provide an efficient, competitive, and seamless omnichannel financing journey for all client segments (FI, Retail, Commercial, and Corporate.)
A Java implementation of a flexible and extensible web spider engine.
Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..
W3mon is a tool that can be used to monitor a set of web sites.
By continually polling such web sites (say, once per hour), the
respective webmasters can be notified by e-mail whenever an outage
occurs.
Protect your bandwith and increase traffic to your vBulliten web site.
This project is to keep the location of files a secret that are on FTP of a vBulliten forums website. Avoid using the vB attachments database and hide file locations.
Our new software release will dramatically improve your medspa business performance while enhancing the customer experience
AestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.
LCat is a php/mysql cataloging system for hyperlinks, intended for use on websites. It is build around a set of objects providing the basic functionality and complemented with a set of scripts and templates to perform communication with the user.
Orome is a tool for automating System or Acceptance tests (also Unit test though this is not the focus) for web-based systems. Orome takes a set of static HTML pages defining a walkthrough of (part of) the systems and tests it against the running system.
The VEinS project aims at visually representing the hierarchy of any website. Such a view gives a good perspective of the website and helps in identifying areas that need change. Automatic link checking is also a part of the software.
aWebVisit analyses web logfiles for visit information like: entry/transit/exit points, internal links followed, length of visit and time spent.
aWebVisit-Map then allows you to examine the links followed by your visitors to and from each web page...
This Linklist uses a MySQL backend. It can handle mutiple Linklists in only 3 tables. Every Linklist has also Categories and Moderator functions. The Admin page has rich amount of features including easy un-/install. The design is clear but cool.
RoboWeb is set of tools to automate the creation of test suites for any kind of web sites and web applications.
RoboWeb uses a proxy recorder to capture user actions as she navigates a site, which later can be reproduced automatically. Site responses
JoBo is a web site mirroring tool. It has a graphical UI but there is a also command line version. Supports robot exclusion protocol (but this can be disabled)
TightURL takes a very long URL as input, and returns a very short URL.
Example (long URL)
http://service.domain.net/de/cgi/g.fcgi/startpage?site=greetings&CUS-GHTOO=43
Exampe (short URL)
http://www.yourdomain.com/174733788
Monitoring tool with support to Websites, RSS, Webservices and Databases. Has notifications by email and RSS and you can access metrics like availability, latency and load time by a web-based GUI. Runs standalone with an embedded HTTP server.
phpSitemapNG is a free Google Sitemaps generator written in PHP, but also generates RSS-based, txt-based and HTML-based sitemap files. It will spider your website and can also index the filesystem.
A personal link exchange manager for sml to med websites- enables the creation of html formatted link display blocks (vertical or horizontal)-saved to txt files-then included anywhere on webpages for "Adsense" style display-for recip or paid links