web spider program, developed by VC++ 6.0. can crawl internet and retrieve plenty of information with very high speed. With you can download network resources, such as html/xml files, audio/vedio binaries and binary documentations to local hard disks.
Following characteristic are designed with web spider:
High performance of crawling and downloading
Wide scope of target network resources and configurable
Multi-threads-enable downloading mechanism and asynchronous DNS querying
Crawling with depth-priority algorithm
Configurable crawling target: single site, sites in company or whole Internet
Be the first to post a review of web-spider!