Menu

#10 Add functionality to add/force specific URL's

open
nobody
5
2014-02-02
2012-05-25
brundleseth
No

(With reference to https://sourceforge.net/projects/phpcrawl/forums/forum/307696/topic/5300676\)

It would be excellent if it was possible to add specific URL's to the cue. An example scenario is that I need to log on to a site on www.domain.com/login.php but really wanted to crawl domain.com/gallery or similiar; this way I would not need to crawl everything before coming to the actual part of the site which I wanted to crawl.

It would also make sense if I just wanted to crawl specific parts of a site - ie. yellow pages for restaurants and retail or whatever :-)

Discussion

Anonymous
Anonymous

Add attachments
Cancel





Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.