| 39 |
GitHub Commit |
open |
2017-12-07
|
2017-12-07
|
|
| 38 |
How to print the average of cookies |
open |
2017-04-21
|
2017-04-21
|
|
| 37 |
put link priorities also on linktext as well |
open |
2017-01-20
|
2017-01-20
|
|
| 36 |
Put this on Github or i do it! |
open |
2016-05-26
|
2016-05-30
|
|
| 35 |
Restrict the crawl on either foo.com or www.foo.com |
open |
2015-09-27
|
2015-09-27
|
|
| 34 |
Restrict the link finding on some URLs |
open |
2015-09-27
|
2015-09-27
|
|
| 33 |
create a official git repo |
open |
2015-08-20
|
2016-04-07
|
|
| 32 |
Add composer support |
open |
2015-07-29
|
2015-08-07
|
|
| 31 |
evaluate client-side scripts e.g. x-dot-templates |
open |
2015-07-23
|
2015-12-07
|
|
| 27 |
Allow ignored parameters |
open |
2014-11-25
|
2014-11-25
|
|
| 26 |
Persist URL cache into a database |
open |
2014-05-25
|
2014-11-17
|
|
| 25 |
Make it possible to set negative priorities using addLinkPriority |
open |
2014-04-07
|
2014-11-17
|
|
| 24 |
Request-retry/retries after failed requests |
open |
2014-01-09
|
2014-01-09
|
|
| 23 |
Get number of remaining links to crawl from the URL-cache |
open |
2014-01-02
|
2015-08-20
|
|
| 21 |
Add link to the urlcache depending on the handleDocument() |
open |
2013-08-30
|
2013-08-30
|
|
| 20 |
Allow redirect by single iframe / frameset on page |
open |
2013-05-29
|
2013-05-29
|
|
| 16 |
prepareRequest callback |
open |
2013-01-21
|
2016-09-10
|
|
| 15 |
diffrent ip.address |
open |
2013-01-20
|
2013-01-20
|
|
| 13 |
Charset info in PHPCrawlDocumentInfo-class |
open |
2012-12-07
|
2014-11-25
|
|
| 12 |
Prevent crawling same URL with different query-parts twice |
open |
2012-11-20
|
2017-06-17
|
|
| 10 |
Add functionality to add/force specific URL's |
open |
2012-05-25
|
2014-02-02
|
|
| 8 |
use the sitemap if available |
open |
2012-04-23
|
2016-05-11
|
|
| 3 |
add_cookie method |
open |
2007-07-25
|
2016-07-06
|
|
