Methabot Web Crawler News
Brought to you by:
sdac
Time for a bugfix release. This release fixes lots of build-time errors related to SpiderMonkey on various systems.
Changes:
* Configure could not find jsapi.h on some systems, this should be fixed now.
* Configuration files are now able to modify crawler and filetype flags, added the options 'external' and 'external_peek'
* Bugfix, Methabot would sometimes crash when cleaning up empty URLs after multiple HTTP HEAD
* Fixed a crash that occurred when running synchronously.
* Build system include fix when jsconfig.h could not be found.