|
From: Bastian G. <chu...@go...> - 2011-05-25 12:35:57
|
Hi Bastian, I just wanted to check out linkchecker for a new site which has strict acceptance rules inside robots.txt (with just one user agent exception created specifically for me). Therefore I could not flawlessly let linkchecker do its work as the program thought it wasn't allowed to follow the pages. Can you tell me please how to pass off linkchecker as a different user agent? What about creating a new option for this case? Cheers, Bastian |