#1 link checker seems to really suck

[Krishna E. Bera]

Wouldn't allow http://www.cmaq.net/ to be registered...

Broken URL: http://webreference.com/graphics/
RealFrom: 209.252.82.177
PostedFrom: http://google.yahoo.com/bin/query?p=%223d+dingbats%22&hc=0&hs=0
BrowserType: Mozilla/4.7 [en] (Win98; U)

Broken URL: http://www.devshed.com/Server_Side/PHP/
RealFrom: 209.163.149.40
PostedFrom: http://www.google.com/search?q=php+flock+example&hl=en&lr=&safe=off
BrowserType: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)

Odd the google references..

[Krishna E. Bera]

Logged In: YES
user_id=144953

It seems to be a matter of timing. FOpen() has a timeout
length that we don't control. Will add some more tolerant
code.

Haven't looked at the google thing yet.

[Krishna E. Bera]

Logged In: YES
user_id=144953

It now gives better diagnostics for why a link is not
working, and waits longer for the link to open.

[Krishna E. Bera]

Logged In: YES
user_id=144953

Still to do:

1) complete the code for pure url validation in urlCheck().

2) handle http redirects better: currently urlCheck() says
the link is broken even if the redirect goes to a working
page.

3) explain weird google references (maybe referrer?)