Checkbot gives 403 error but we see code 200

Help
2008-03-26
2013-04-25
  • Forest Monsen
    Forest Monsen
    2008-03-26

    We like checkbot -- it's a big help. We're confused why, in our output page at http://anakin.etradmin.org/checkbot/index-nationalserviceresources.org.html , checkbot receives a 403 error when requesting some pages, that when requested directly, are answered with a code 200:

    $ wget -S --delete-after http://www.dhss.delaware.gov/dhss/dssc/volresctr.html
    --10:00:52--  http://www.dhss.delaware.gov/dhss/dssc/volresctr.html
               => `volresctr.html'
    Resolving www.dhss.delaware.gov... 167.21.108.19
    Connecting to www.dhss.delaware.gov|167.21.108.19|:80... connected.
    HTTP request sent, awaiting response...
      HTTP/1.1 200 OK
      Connection: keep-alive
      Date: Wed, 26 Mar 2008 16:56:40 GMT
      Server: Microsoft-IIS/6.0
      X-Powered-By: ASP.NET
      Content-Length: 17280
      Content-Type: text/html
    Length: 17,280 (17K) [text/html]

    100%[====================================>] 17,280        64.59K

    $ wget -S --delete-after http://www.csl.umd.edu/
    --10:14:06--  http://www.csl.umd.edu/
               => `index.html'
    Resolving www.csl.umd.edu... 128.8.200.121
    Connecting to www.csl.umd.edu|128.8.200.121|:80... connected.
    HTTP request sent, awaiting response...
      HTTP/1.1 200 OK
      Connection: keep-alive
      Date: Wed, 26 Mar 2008 17:09:55 GMT
      Server: Microsoft-IIS/6.0
      X-Powered-By: ASP.NET
      Content-Length: 10224
      ETag: "3aba57b7c83c81:47b"
      Last-Modified: Tue, 11 Mar 2008 13:33:25 GMT
      Content-Type: text/html
    Length: 10,224 (10.0K) [text/html]

    100%[====================================>] 10,224        37.67K/s            

    10:14:07 (37.61 KB/s) - `index.html' saved [10224/10224]

    Removing index.html.

    ###
    The only similarity I can find in the four links I've followed is that these are IIS servers.