From: Maksymilian K. <ma...@mi...> - 2002-08-16 17:28:58
|
What is wrong with this? Why it is doing this : Making HTTP request on http://0/robots.txt/ Unable to find the host: 0/robots.txt (port 80) [root@nextweb htdig]# rundig -vvv ht://dig Start Time: Fri Aug 16 19:22:18 2002 1:1:http://www.ahisa.com.au New server: , 0 - Persistent connections: enabled - HEAD before GET: disabled - Timeout: 30 - Connection space: 0 - Max Documents: -1 - TCP retries: 1 - TCP wait time: 5 Trying to retrieve robots.txt file Making HTTP request on http://0/robots.txt/ Unable to find the host: 0/robots.txt (port 80) Request time: 0 secs pushed pick: , # servers = 1 > with a traditional HTTP connection ht://dig End Time: Fri Aug 16 19:22:18 2002 htpurge: Database is empty! Preamble text: Postamble text: Note: This message will be sent again if you do not change or take away the notification of the above mentioned HTML page. Find out more about the notification service at http://www.htdig.org/meta.html Cheers! ht://Dig Notification Service [root@nextweb htdig]# The idea of mine search engine is to find private high schools which are doing Steven Covey - 7habbits course. So I have a few lists of high schools websites (I have links to that sites) from many countries and I'd like to find a word 'covey'. Google can't do that becouse It does not go through links. |
From: Jim C. <gre...@yg...> - 2002-08-16 22:33:51
|
You probably want to start by double checking your config file. I didn't have any problem starting a dig of http://www.ahisa.com.au using two different 3.2.0b4 snapshots. If there are no obvious problems with the config file, you might try checking it with something like 'cat -v' to look for non-printing characters. If that fails to uncover any problems, you might consider trying a different snapshot. Jim Maksymilian Kusmierek's bits of Fri, 16 Aug 2002 translated to: >What is wrong with this? >Why it is doing this : >Making HTTP request on http://0/robots.txt/ >Unable to find the host: 0/robots.txt (port 80) > >[root@nextweb htdig]# rundig -vvv >ht://dig Start Time: Fri Aug 16 19:22:18 2002 > 1:1:http://www.ahisa.com.au >New server: , 0 > - Persistent connections: enabled > - HEAD before GET: disabled > - Timeout: 30 > - Connection space: 0 > - Max Documents: -1 > - TCP retries: 1 > - TCP wait time: 5 >Trying to retrieve robots.txt file >Making HTTP request on http://0/robots.txt/ >Unable to find the host: 0/robots.txt (port 80) |