phoneutria

A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.

Features

link checking
load-testing
website downloading

Project Activity

See All Activity >

License

GNU General Public License version 3.0 (GPLv3)

Follow phoneutria

phoneutria Web Site

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Rate This Project

User Reviews

Be the first to post a review of phoneutria!

Additional Project Details

Languages

English

Intended Audience

Advanced End Users, Developers, Quality Engineers, System Administrators

User Interface

Command-line

Programming Language

Java

Related Categories

Java Load Testing Tool, Java Web Scrapers

Registered

2009-12-16

Similar Business Software

Crawl4AI

Crawl4AI is an open source web crawler and scraper designed for large language models, AI agents, and data pipelines. It generates clean Markdown suitable for retrieval-augmented generation (RAG) pipelines or direct ingestion into LLMs, performs structured extraction using CSS, XPath, or...

See Software
UseScraper

UseScraper is a powerful web crawler and scraper API designed for speed and efficiency. By entering any website URL, users can retrieve page content in seconds. For those needing comprehensive data extraction, the Crawler can fetch sitemaps or perform link crawling, processing thousands of pages...

See Software
AnyPicker

AnyPicker is a powerful yet easy-to-use web scraper for the Chrome browser. Scrape the entire website using only your mouse, no coding skills are required, and no tedious configuration is needed; it’s that simple and easy. AnyPicker can be operated with just mouse clicks. AnyPicker automatically...

See Software
PYPROXY

Market-leading proxy solution provides tens of millions of IP resources. Commercial residential and ISP proxy network includes 90M+ IPs around the world. Exclusive high-performance server requests access to real residential addresses. Abundant bandwidth support business demands. Real-time speed...

See Software
ScrapingAnt

ScrapingAnt is an enterprise‑grade web scraping API that delivers mission‑critical speed, reliability, and advanced scraping capabilities through a single, easy‑to‑integrate RESTful interface. It combines scalable headless Chrome page rendering with unlimited parallel requests, all powered by a...

See Software
NetNut

Get ready to experience unmatched control and insights with our user-friendly dashboard tailored to your needs. Monitor and adjust your proxies with just a few clicks. Track your usage and performance with detailed statistics. Our team is devoted to providing customers with proxy solutions...

See Software