If a document that contains a base href such as <base href="http://mysite.com/test/" />
With links such as <a href="test/test-things">Things to test</a>
The makeFullQualifiedURL function does not build out the URL correctly.
Refer to modified files for fix.
I added made the main program loop lookup the base href and in the makeFullQualifiedURL it detects if the baseHref exists and builds the URL as required.
The crawler now traverses a site with base hrefs :)