Menu

#91 .js files pass if they have a query

closed-works-for-me
nobody
None
5
2015-09-06
2015-08-18
Anonymous
No

This URL will be crawled even though .JS files are excluded:
www.site.com/wp-includes/js/hoverIntent.min.js?ver=1.8.1

Discussion

  • Anonymous

    Anonymous - 2015-08-18

    this goes for .css and any other file as well...

     
  • Uwe Hunfeld

    Uwe Hunfeld - 2015-08-26

    Hi!

    Could you please post your setup?
    How did you exclude .js and .css files?

    Maybe just an error in your exclude-regex?

     
  • Uwe Hunfeld

    Uwe Hunfeld - 2015-09-06

    Bug not confirmend, with the right regular expression passed to addURLFilterRule() .js and .css URLs containing a query will get ignored by the crawler:

    $crawler->addURLFilterRule("#.(css|js)[\?$]# i");

    Please report back if i misunderstood something here.

    For now im closing this.

    Thanks!

     
  • Uwe Hunfeld

    Uwe Hunfeld - 2015-09-06
    • status: open --> closed-works-for-me
     

Anonymous
Anonymous

Add attachments
Cancel





MongoDB Logo MongoDB