Re: [htdig-dev] Big Problem on Mac OS X - ref->DocTime() always returns 0

[Stefan S. <tal...@in...>]

On 17.9.2002 20:21 Uhr, Geoff Hutchison <ghu...@ws...> wrote:

> At least at the moment, I cannot reproduce this, which is why I have not
> responded sooner. So let me at least ask a few questions which might help:
> 
> 1) Do you see actual, formatted dates in htsearch results? (These
> obviously need to do the same access.)

No, but I guess this is due to my templates being set so they don't display
any:
<strong><a href="$&(URL)">$&(TITLE)</a></strong> $(STARSLEFT)<br>
<ul>$(EXCERPT)</ul>

I'll try adding dates there and see what happens.

> 2) Where do you determine that ref->DocTime() is returning 0?
> I ask, in part because htdump is going to access this as well:
>           fprintf(fl, "\tm:%d", (int) ref->DocTime());
I added a traceprint to Retreiver.cc inside the Retriever::parse_url(URLRef
&urlRef) routine like so:

--- snip ---
if (ref)
    {
        //
        // We already have an entry for this document in our database.
        // This means we can get the document ID and last modification
        // time from there.
        //
        current_id = ref->DocID();
        date = ref->DocTime();
        if (debug > 2)
          {
            cout << "\nDOC MATCHED DB!!! \n" << endl;
            cout << "DocTime Date is: " << date << endl;
          }
--- snap ---


> 3) Are you sure the server is returning a Last-Modified header for files?
Yes, I snooped the wire ;-)

> 4) Does the server properly handle the If-Modified-Since header?
> (To see that this header is sent, check in Document.cc line 525 or so for
> the output sent by htdig.)
It's apache 1.3.26, so I guess it should. But I think htdig only sends the
if-Modified since header if it finds a date for an url in the current
database and as I assume that doesn't happen, so the If-Modified-Since
header never makes it's way out.

Here's an example url from my htdump file to prove a date is in there:

0       u:http://www.CENSORED.com/YADDA.html    t:CENSORED        a:0
m:873819058     s:280   H:  CENSORED         h:      l:1031854616
L:0     b:1     c:0     g:0     e:      n:      S:      d:      A:

--
<http://www.StefanSeiz.com>
Spamto: <bi...@im...>