Easy Spider is a distributed Perl Web Crawler Project from 2006. It features code from crawling webpages, distributing it to a server and generating xml files from it. The client site can be any computer (Windows or Linux) and the Server stores all data.

Websites that use EasySpider and Perl/PHP Backends:
https://www.artikelschreiber.com/en/

Webcrawlers are mostly the first thing to start programming at if you start your programming career. It is fun to look at some code that is few years ago and to see how one has improved himself.

(c) Sebastian Enger 2005-2015

Features

  • Client/Server Distributed Crawling
  • Perl Programming Language
  • Config File Support
  • PDF,DOC,XLS,PPT Extraction Support

Project Samples

Project Activity

See All Activity >

Follow Easyspider - Distributed Web Crawler

Easyspider - Distributed Web Crawler Web Site

Other Useful Business Software

Develop killer analytical applications Develop killer analytical applications Icon
Develop killer analytical applications Icon

Try the Yellowfin analytics platform, built for developers.

Yellowfin provides developers with the tools to easily build stunning analytical applications. Connect and blend multiple data sources and deploy onto any environment at scale, with access to hundreds of web services to integrate as you need. Yellowfin offers industry leading capabilities that are trusted by thousands of organizations globally. Try Yellowfin for free to see how easily you can develop killer analytical applications.

Rate This Project

Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

User Reviews

There are no 1 star reviews.

Additional Project Details

Languages

English, German

Intended Audience

Telecommunications Industry, System Administrators, Developers

User Interface

Console/Terminal, Command-line

Programming Language

Perl

Database Environment

Flat-file

Registered

2014-05-09