#14 robots.txt-Support

open
nobody
None
5
2007-08-28
2007-08-28
Anonymous
No

It would be nice if Snoopy is able to check the robots.txt and follow it depending on the inserted User-Agent.

Discussion