Crawling HTTPS links

Help
2006-01-05
2013-04-24
  • David Marsh

    David Marsh - 2006-01-05

    How can I either configure or develop code to enable HTTPS crawling ?

     
    • David Marsh

      David Marsh - 2006-01-06

      I've created a patch that involves updating the SiteDAOImpl class to not use full urls in its hash map. I removed the protocol for http/https links so the crawler thinks they are the same link, before they were being treated as ap seperate site. I would be happy to submit the change and contribute in general. Contact me if you want more info.

      David Marsh
      dmarsh26@hotmail.com

       

Log in to post a comment.