Menu

#1 crawl up to a certain deep

open
nobody
None
5
2012-03-23
2012-03-23
seba garcia
No

It would be great if you can crawl up until a certain directory deep.
Something like -d 2, would find
http;//www.x.com/
http;//www.x.com/index.html
http;//www.x.com/test/
http;//www.x.com/test/test.html

But not

http;//www.x.com/test/other/
http;//www.x.com/test/other/gua.html

Discussion


Log in to post a comment.

Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.