NightCrawler

NightCrawler is a multithreaded web spider which uses MIME types to download files.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow NightCrawler

NightCrawler Web Site

Other Useful Business Software

Simple, Secure Domain Registration

Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.

Rate This Project

User Reviews

Be the first to post a review of NightCrawler!

Additional Project Details

Intended Audience

End Users/Desktop

User Interface

Java Swing

Programming Language

Java

Related Categories

Java Web Scrapers

Registered

2006-11-06

Similar Business Software

Oxylabs

Oxylabs is a market leader in web intelligence with enterprise-grade, ethical, and compliant solutions. Its proxy infrastructure spans one of the largest global networks, offering residential, ISP, mobile, datacenter, and dedicated datacenter proxies, along with Web Unblocker – an AI-driven...

See Software
NetNut

Get ready to experience unmatched control and insights with our user-friendly dashboard tailored to your needs. Monitor and adjust your proxies with just a few clicks. Track your usage and performance with detailed statistics. Our team is devoted to providing customers with proxy solutions...

See Software
Axiom.ai

Save time, and use browser bots to automate website actions and repetitive tasks on any website or web app. It's simple to install and free to try, no credit card is required. Once installed, pin Axiom to the Chrome Toolbar, and click on the icon to open and close. Every bot can be customized to...

See Software
PYPROXY

Market-leading proxy solution provides tens of millions of IP resources. Commercial residential and ISP proxy network includes 90M+ IPs around the world. Exclusive high-performance server requests access to real residential addresses. Abundant bandwidth support business demands. Real-time speed...

See Software
SpiderMount

SpiderMount is a job wrapping and web data scraping service by Aspen Technology Labs, Inc., a privately held company registered in Colorado, USA. Sales and support staff are located in ATL’s Aspen, CO office and the development and configuration team works from ATL’s Kyiv, Ukraine office....

See Software
Thunderbit

Thunderbit is an AI Web Scraper that replaces tedious copy-paste tasks for GTM teams. As a Chrome extension, it enables you to scrape any website and export data into tables using natural language. Collect text, links, emails, images, and more—all in just two clicks. Features - Scrape Any...

See Software