When adding a addURLFilterRule() for .css or .js any .min.js and .min.css files are ignored. Even when adding .min.css or .min.js files to the filter rule they are still crawled causing issues.
Just can't confirm this, after some tests addURLFilterRule() works as expected in all cases.
I.e:
If you set $crawler->addURLFilterRule("#.(css|js)[\?$]# i"), ALL URLs edning with ".css" or ".js" get ignored by the crawler, so "xxx.min.js" for example too.
I'm closing this for now.
If someone still has problemss with addURLFilterRule(), please report back.
THANKS!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "bugs Discussion" comments posted by this user
Mark all as spam, and block user from posting to "Bugs"
Hi!
Do you have an actual example (your complete filter-rules and the site you are crawling)?
Hi!
Again: ANy examples (URL) on this?
Not able to reproduce this without any concrete example.
Just can't confirm this, after some tests addURLFilterRule() works as expected in all cases.
I.e:
If you set $crawler->addURLFilterRule("#.(css|js)[\?$]# i"), ALL URLs edning with ".css" or ".js" get ignored by the crawler, so "xxx.min.js" for example too.
I'm closing this for now.
If someone still has problemss with addURLFilterRule(), please report back.
THANKS!