With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Context for your AI agents
Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.
Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
JLinkCheck is an Ant Task written in Java for checking links in websites. It is not just checking one single page, but crawling a whole site like a spider, generating a report in XML and (X)HTML. JReptator will be its succesor with many more features
Toke is a webmining toolkit for web exploring, indexing and searching for Java. Toke allows to you crawl public or private web sites, in order to create web estatistics, web Pajek graphs, Lucene indexs and word frequency files for data clustering.
Sperowider Website Archiving Suite is a set of Java applications, the primary purpose of which is to spider dynamic websites, and to create static distributable archives with a full text search index usable by an associated Java applet.
Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.
Atera all-in-one platform IT management software with AI agents
Ideal for internal IT departments or managed service providers (MSPs)
Atera’s AI agents don’t just assist, they act. From detection to resolution, they handle incidents and requests instantly, taking your IT management from automated to autonomous.
Programmable web client utilising HttpUnit with input & output files in XML. Eccles includes the ability to create a GUI to control/monitor the processing, and can be used for website testing as well as automating web transactions.
Bugkilla is a set of java tools for the functional test of J2EE Web Applications.
Specification and execution of tests will be automated for web front end and business logic layer.
One goal is to integrate with existing frameworks and tools.
SiteEngine is a Servlet based web subsystem purposed to simplify of managing of site content (but it is not a Content Management System, it is just a lib).
Java Applet Redirection JAR is a usefull script written in javascript that redirects the user if he doesnt have the JRE installed on its system to an other webpage not using applet.
Checks links in HTML files. Checks almost any tag attributes known to contain references to other resources. Supports multithreading. Written in Java. Frontends for Console and AWT available, Swing in development.
Monitor Central is comprised of 2 applications; 1)MetaValidator - a diagnositic and corrective tool for web pages that includes a spell checker, section 508 validator, meta tag validator, etc... 2) MonitorCentral - which does the same general diagnosti
XmlTestSuite helps with the testing of complex web applications.
<ul>
<li>Tests are written in XML
<li>Supports test driven development
<li>Separate page structure, data from test steps
<li>Test HTML, databases, javascript, xpath
</ul>Uses HttpUnit
A Java implementation of a flexible and extensible web spider engine.
Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..
Orome is a tool for automating System or Acceptance tests (also Unit test though this is not the focus) for web-based systems. Orome takes a set of static HTML pages defining a walkthrough of (part of) the systems and tests it against the running system.
WEBsent is a web service test and performance tool. It offers the user, via a client site hypertext browser, some tools and tests to check the performance and validity of his/her web server. WEBsent is designed to monitor webpages, content accessibility
This project is a JAVA-based version of Ringers. A fully-functional JAVA-enabled version of Ringers which allows for cross-platform/OS implementation of the Ringers software. This version includes its own NavBar based another project.
The VEinS project aims at visually representing the hierarchy of any website. Such a view gives a good perspective of the website and helps in identifying areas that need change. Automatic link checking is also a part of the software.
JoBo is a web site mirroring tool. It has a graphical UI but there is a also command line version. Supports robot exclusion protocol (but this can be disabled)