Deploy pre-built tools that crawl websites, extract structured data, and feed your applications. Reliable web data without maintaining scrapers.
Automate web data collection with cloud tools that handle anti-bot measures, browser rendering, and data transformation out of the box. Extract content from any website, push to vector databases for RAG workflows, or pipe directly into your apps via API. Schedule runs, set up webhooks, and connect to your existing stack. Free tier available, then scale as you need to.
Explore 10,000+ tools
Atera all-in-one platform IT management software with AI agents
Ideal for internal IT departments or managed service providers (MSPs)
Atera’s AI agents don’t just assist, they act. From detection to resolution, they handle incidents and requests instantly, taking your IT management from automated to autonomous.
Mara CMS is a file based content management system.
Mara offers the kind of helpful features you would expect to find in the big commercial products, but in a more concise form. This makes it remarkably easy to use, even for the inexperienced content creator.
Features include direct editing of the actual webpage so you see your changes as you type, drag and drop photo and video content addition, easy YouTube video linking, a photo gallery that can also double as a presentation or...
The DotNetWikiBot Framework was developed so that it can offer a helping hand with many complicated and routine tasks of wiki site development and maintenance. DotNetWikiBot Framework is a cross-platform full-featured client API, that allows you to build programs and web robots easily to manage information on MediaWiki-powered sites. DotNetWikiBot Framework can also be used for learning C# and .NET.
[ Please read https://sourceforge.net/p/darkbot/news/2014/01/darkbots-revitalization/ ]
Darkbot is a portable IRC chat robot written in the C language that can be taught responses to user inquiries, and even have conversations with them. Darkbot was originally created by Jason Hamilton as an aid for help channels on Intenet Relay Chat.
vStats is a php/mysql based website counter. It collects statistics about the visitors' (user or robot) browser, os and the country they are from. vStats keeps also track of the time and date of the visit and the referred website.
Status update 2011-11-01: Major redesign is ongoing with IPv6 support, more efficient code and more statistics. Stay tuned for the first alpha.
AWBot is an easy to use tool to test a web site.:
AWbot connects to your web site and make URL requests like any other visitors.
AWBot is not a web indexing robot but a web client tool that emulate some visitors browsing on your site to test its reliab
Eggdrop is the most advanced IRC robot available. It has been under development since December 1993, and unlike most other bots, it is still regularly updated.
Eggdrop is the most advanced IRC robot available. It has been under development since December 1993, and unlike most other bots, it is still regularly updated.
Axe Credit Portal - ACP- is axefinance’s future-proof AI-driven solution to digitalize the loan process from KYC to servicing, available as a locally hosted or cloud-based software.
Banks, lending institutions
Founded in 2004, axefinance is a global market-leading software provider focused on credit risk automation for lenders looking to provide an efficient, competitive, and seamless omnichannel financing journey for all client segments (FI, Retail, Commercial, and Corporate.)
Catalyst based application intended to be a robot fitting tool, character planner, mining yield planner and eventually also a killboard/corporation management tool for Perpetuum Online. This is the base project, without any non-free data.
pySpykeeWeb is a simple web server written in Python for controlling a Spykee robot. Currently the program supports robot movement, dock, undock, battery level reporting commands, and video streaming.
This is a Robot simulation game that allows you to write a robot in any language you might want. The robot communicates with the game using the internet and up to 32 robots can be run at a time. WARNING: The current version is not complete!
Using this plugin-based framework, you can instantly start working on the *brain* of your bot (irc bot, chatterbot, robot, ...). With support for db, irc, logging and programming-language independent plugins, users can easily enhance the functionality.
An open source search engine based on AspSeek. Implementable in any environment. It consists of an indexing robot, search daemon and search frontend (CGI program).
Projects by the University of Missouri, Rolla Robotics Team. Includes: software for raceing off road autonomously(pending), FIRST Robotics Tools, Software from our website, and other tools.
ASPseek is a full-featured medium-to-large scale SQL-based Internet search engine. It consists of an indexing robot, search daemon and search frontend (CGI program). These programs are written in C++ using the STL library.
...This simple utility to help those wanting to hide their email address from being harvested. Simple to install and use. Platform independant for almost any site. Designed to help webmasters reduce robot harvesting for spam.
PyRA2 is a set of Python packages (libraries) and documentation providing
access to the file formats of Robot Arena 2 (RA2), a game by Gabriel
Interactive (published by Infogrames).
The BoardGame Tool offers an easy, XML driven interface to implementing boardgames on the computer, with automatic network play, artificial intelligence and robot possibilities. Game rules are encoded in easy-to-learn embedded Python.
JobyX is an ICS (Internet Chess Server) robot framework that provides basic robot functionality, including commands, lists, variables, avariables, and (in the new JobyX 2) full-blown Java-like exception handling. Commands, etc, are provided by modules.
We want to develop simple apache module, mod_die_spam which provides infinitive homepages and fake emails to confuse email gathering robot which is running by spammers.
Let spammers die.
WebSPHINX is a web crawler (robot, spider) Java class library, originally developed by Robert Miller of Carnegie Mellon University. Multithreaded, tollerant HTML parsing, URL filtering and page classification, pattern matching, mirroring, and more.
Rockbot is a C irc robot initally based on comstud's Combot. It has gone a long way though. Its version 5 release was widely known in 1996-7 as one of the better (and eaisier to setup) bots. Version 6 goal is to compete with eggdrops, which the author di
JoBo is a web site mirroring tool. It has a graphical UI but there is a also command line version. Supports robot exclusion protocol (but this can be disabled)