I created an HTML file with this tag in it:
<META NAME="htdig-noindex">
When I ran rundig, it says:
# ./rundig -vv
New server: [removed]
pick: [removed] # servers = 1
0:0:0:http://[removed]/:
META ROBOT: Noindex
A tag: pos = 2, position = ="/cgi-bin/emphome">
size = 216
pick: [removed], # servers = 1
htmerge: Sorting...
htmerge: doc #0 has been superceeded.
DB2 problem...: missing or empty key value specified
Deleted, noindex: 0/http://[removed]/
So I changed the line to read:
<META NAME="htdig-noindex" CONTENT="foo">
but still the same problem. Commenting that one
line out fixes the problem, but of course then the
file is indexed. What am I doing wrong?
# uname -a
Linux [removed] 2.2.16-3smp #1 SMP Fri Sep 1 13:10:43
PDT 2000 i686 unknown
I compiled the sources from 3.1.5
Logged In: YES
user_id=149687
There's at least 3 things you're doing wrong:
1. You're asking questions about configuration problems
on a database that's intended for tracking actual bugs in
the software.
2. You didn't leave a contact address, so we have to assume
you'll eventually check back here for a followup to your
question.
3. You're telling htdig not to index your start_url, so of
course it
won't be able to find anything else to index either. It ends
up
deleting the only entry it managed to put in the docdb (the
start_url), which leads to the "missing or empty key" error.
If you
want htdig to ignore the text in your first document, but
follow
links, use a different tag. See FAQ 4.15.