From: Janine S. <ja...@fu...> - 2004-05-28 17:48:04
|
I am indexing content that normally requires a login and password to get to, and we decided some time ago that the most expedient way of letting htdig in was to look at the user agent. This worked ok in 3.1.6, where the user-agent string in the request was "htdig/3.1.6 (ja...@fu...)". However, in 3.2b5, the string is just "htdig" and I can't figure out how to change it to make it less generic. I've set the maintainer attribute in the conf file but it doesn't seem to be being used as advertised. I also tried setting robotstxt_name but that didn't change the user-agent either. Suggestions? thanks, janine |
From: olinux <ol...@ya...> - 2004-05-28 22:57:48
|
http://www.htdig.org/attrs.html#user_agent Josh --- Janine Sisk <ja...@fu...> wrote: > I am indexing content that normally requires a login > and password to > get to, and we decided some time ago that the most > expedient way of > letting htdig in was to look at the user agent. > This worked ok in > 3.1.6, where the user-agent string in the request > was "htdig/3.1.6 > (ja...@fu...)". However, in 3.2b5, the string > is just "htdig" > and I can't figure out how to change it to make it > less generic. I've > set the maintainer attribute in the conf file but it > doesn't seem to be > being used as advertised. I also tried setting > robotstxt_name but that > didn't change the user-agent either. > > Suggestions? > > thanks, > > janine __________________________________ Do you Yahoo!? Friends. Fun. Try the all-new Yahoo! Messenger. http://messenger.yahoo.com/ |