From: Marco H. <mar...@ec...> - 2005-03-08 08:24:20
|
J=FCrgen, =20 I believe you can add rules to a .htaccess file for certain user agents (though I have no experience with .htaccess files, but I googled for = like 5 minutes and found loads of info on this topic). HtDig allows us to set a user-agent string in the config file (user_agent: = website_digger_example). You can set anything here and then update your htaccess file with that user-agent. Block everything other than the user-agent specified and I = think you=92re good to go.=20 =20 The only experience I have with the user-agent directive in the config = file, is that we use it to fully index a website that has restricted area=92s (member pages).=20 =20 Hope this helps. =20 Regards, =20 Marco _____ =20 From: htd...@li... [mailto:htd...@li...] On Behalf Of jue...@mo... Sent: maandag 7 maart 2005 13:17 To: htd...@li... Subject: [htdig] htdig vs. .htaccess =3D> Options -Indexes =20 I have a problem with .htaccess=20 I want to allow htdig to index all directories in /home/wdkom/... but I don't want to allow users to view this directories via www=20 If I add Options -Indexes in .htaccess, rundig is not able to index the files.=20 What must be done to fix this requirement?=20 kind regards _________________________________________________________________________= ___ _________________________________________________________________________= __ Ing. J=FCrgen Mario Kargl Entwicklung Internet Solutions MOTIONDATA Software GmbH K=E4rntner Stra=DFe 518 A-8054 Graz-Seiersberg Tel.: +43-316/255 599-0 Fax: +43-316/255 599-5 Email: jue...@mo... Internet: www.motiondata-internet.at |