Name | Modified | Size | Downloads / Week |
---|---|---|---|
Parent folder | |||
README.md | 2017-05-13 | 587 Bytes | |
v0.6.37.tar.gz | 2017-05-13 | 195.4 kB | |
v0.6.37.zip | 2017-05-13 | 279.0 kB | |
Totals: 3 Items | 475.0 kB | 0 |
Added
- Add --spider-transport and --grab-transport options to crawl script
- Add SOCKS5 proxy support in urllib3 transport
Fixed
- Fix [#237]: urllib3 transport fails without pycurl installed
- Fix bug: incorrect spider request logging when cache is enabled
- Fix bug: crawl script fails while trying to process a lock key
- Fix bug: urllib3 transport fails while trying to throw GrabConnectionError exception
- Fix bug: Spider add_task method fails while trying to log invalid URL error
Removed
- Remove obsoleted hammer_mode and hammer_timeout config options