With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Context for your AI agents
Crawl websites, sync to vector databases, and power RAG applications. Pre-built integrations for LLM pipelines and AI assistants.
Build data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
With as little code as possible, this micro-app creates shortened URLs, stores them in MongoDB using the Flask framework.
Currently in use on https://findmate.app and http://urltools.io/
HOWEVER:
This should not really be used in a high-volume production environment and should really be used for educational purposes only. I assume no liability for mis-use of this app, use it at your own risk. There are potentially security issues, so be forewarned that this is just for TESTING only.
Web Man controls the large-scale aspects of your website. You can install navigation bars, check links, and do other web site operations. Web Man is an open source partial work-alike for Microsoft Front Page (TM) or Web Expression (TM).
Beginning with release Alpha 009, the download button downloads an installer script. Put the script where you want Web Man to run, become root, and execute the script with Perl.
Link Doctor is a Link Exchange Manager, Reciprocal Link Checker software that periodically checks your reciprocal links and notices you on missing reciprocal links. Fetaures 3-way link exchange, SEO friendly pages, spam filter.
Get first 10 results in Google in WP widget, multi-language support
Automatically check the first 10 websites in Google SERP (search engine results pages) for a given keyword and language, displaying the Bing rank too.
Stellissimo SERP is a wordpress plugin that reads and save locally the first 10 results from Google and Bing SERPSs, a little cache-system to avoid problems with search engines (too many queries). The results table appears in a customizable widget.
This Google and Bing SERP checker was created for http://www.programmi-tv.eu/ and shared to...
Atera all-in-one platform IT management software with AI agents
Ideal for internal IT departments or managed service providers (MSPs)
Atera’s AI agents don’t just assist, they act. From detection to resolution, they handle incidents and requests instantly, taking your IT management from automated to autonomous.
Semi-automated exploration of all page links inside a web application. Produces a map (i.e. a graph) of all links between pages, including relationships on HTTP request parameters and form input fields.
Strawberry allows you to store, manage, classify and consult your preferred links. As a web application (running with Mother framework), you can access your bookmarks from everywhere if runned on a server.
Cross platform GUI managing bookmarks and shortcuts in a portable way. Support import/export, search, encryption, hierarchical tags, USB key installation, various environments integration, OS-dependent shortcuts, plugins extensibility.
AnCaraS is a tool to analyze and characterize web sites. It offers an informetric characterization, a topologic description and an interactive graphs view and manipulation.
A bash shell script which utilizes wGet to download rapidshare URLS from a "Download Basket" in Linux distros
- Has configuration support (sets up wGet cookies, download directory, download basket)
- Checks for files that have already been downloaded
The purpose of this project is to gauge website page loading speed as aspect of client through web management system, Leech. Leech says, "Leech bot reachs hosts via URL Information and sucks http responses!"
MWQL is an extension to MediaWiki, providing (end) users with a language for structural queries, so that they can build dynamic pages as seen in the Special pages of Wikipedia.
This is simple link checker. It can crawl any site and help to find broken links. It also having download CSV report option.The CSV file includes url ,parent page url and status of page [broken or ok]. It is be very useful for search engine optimization.
Bookmark-Manager is an advanced bookmark management utility for Windows supporting importing/exporting and merging of Internet Explorer favorites, Opera hotlists, Mozilla, Netscape, and Firefox bookmarks, XBEL, and HTML lists.
Linx URL filter is a console filter used to retrieve and filter the text contents of web pages. Linx URL filter uses plugins to extract information like tags, links, mail addresses and scripts
Yngvi allows Apache Webmasters to determine filesystem locations that are accessible through the server -- including those which have not been explicitly published. It's good for finding inadvertent exposures or unintended configuration inheritances.
JLinkCheck is an Ant Task written in Java for checking links in websites. It is not just checking one single page, but crawling a whole site like a spider, generating a report in XML and (X)HTML. JReptator will be its succesor with many more features
Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.
Automatic link management program. Has three functions: List links in database in html format, add links to database using browser and optionaly check for bad links (by cron job). This eliminates the need for the "Report bad link" on too many web sites
Bugkilla is a set of java tools for the functional test of J2EE Web Applications.
Specification and execution of tests will be automated for web front end and business logic layer.
One goal is to integrate with existing frameworks and tools.
The "WebNavigationFramework" (WNF) is a Environment to create or build
Websites and/or Webappls it knows Sessions for SingleSignOn and functions
for expanding.Nav.-nodes are User-, Date- and/or Locationspecific and hierarchically.