A VB Web crawler that is currently under construction with the goal to be able to crawl and index the net most likely by distributed computing (via network).
License
GNU General Public License version 2.0 (GPLv2)Follow The VB Web Crawler
Other Useful Business Software
Save Up to 91% on Cloud Compute With Spot VMs
Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of The VB Web Crawler!