Menu

Can PHPCrawl do this: search for keyword in URL?

Help
Anonymous
2016-06-19
2016-07-20
  • Anonymous

    Anonymous - 2016-06-19

    Can PHPCrawl be used to perform the following crawl:

    User needs to search a list of URL such as: www.firstdomain.com and www.seconddomain.com

    etc. etc. for URLs that have a specific keyword such as in the following example:

    www.firstdomain.com/looking-for-this-keyword
    www.seconddomain.com/looking-for-this-keyword

    The keyword is always the same among all the domains searched and may have other words before and after it, but if the keyword is present in the URL, capture the URL and save, otherwise, go onto the next URL in the list.

    thank you!

     
  • Anonymous

    Anonymous - 2016-07-20

    I think this function could help you: http://phpcrawl.cuab.de/classreferences/PHPCrawlerDocumentInfo/property_detail_tpl_property_url.htm
    You can find in that URL anything you want and then save the url in your code.
    If you only want to continue if that keyword is in your url, then you could have a look on "addURLFilterRule"

     

Anonymous
Anonymous

Add attachments
Cancel





Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.