I find that the most important thing that a crawler can do and PHPCrawl do not explain, is how to grab specific file type.
If i want to get .mp4 .mp3 .jgp .pdf files ect...
How can i do that?
Last edit: Gino Côté 2016-09-09
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I find that the most important thing that a crawler can do and PHPCrawl do not explain, is how to grab specific file type.
If i want to get .mp4 .mp3 .jgp .pdf files ect...
How can i do that?
Last edit: Gino Côté 2016-09-09
Your probably looking for the mime types.
$crawler->addContentTypeReceiveRule("#video/mp4#");
$crawler->addContentTypeReceiveRule("#audio/mpeg3#");
Untested, so you'll need to try it.