Yoshibot Web Spider / News: Recent posts

I thought this might be useful to you to help define the project goals...

This is a web spider that is written in PERL. The
basic "frame" for it is already created, you specify a link, and it connects to
that webhost, gets the HTML for that page, extracts all the links, and then
does the same for all those links, etc.

Since the basics are handled, I'm going for many features. Anything we (or our
users) think is useful or interesting will be added. Some ideas I've been
toying with are:... read more