Menu

#31 evaluate client-side scripts e.g. x-dot-templates

open
nobody
None
5
2015-12-07
2015-07-23
Anonymous
No

The sites I crawl often use javascript-templates to list links (e.g. x-dot-templates). These links are not recognized by phpcrawler (probably because the scripts are x-ecuted on the client machine). It would be nice to be able to capture these links also.

Discussion

  • Uwe Hunfeld

    Uwe Hunfeld - 2015-08-27

    Hi!

    Could you please post some example-pages?

    Thanks!

     
  • Anonymous

    Anonymous - 2015-10-05

    Try http://www.sro.ch/desktopdefault.aspx/tabid-209. The links on this page are embedded in javascript functions.
    Or http://cms.publisherconnect.ch/fileadmin/user/firmenwithelabel/solrclients/srrws - the links on this page are generated by an x-dot-template.
    I have found a workaround for the x-dot-templates by loading the page into a webbrowser control and then saving the html to a temporary page which is then crawled. It functions but it's pretty ugly ;o) .
    Thanks in advance for your efforts.

     
  • Anonymous

    Anonymous - 2015-10-10

    Try http://www.sro.ch/Stellen.aspx. The links on this page are embedded in javascript functions.
    Or http://cms.publisherconnect.ch/fileadmin/user/firmenwithelabel/solrclients/srrws - the links on this page are generated by an x-dot-template.
    I have found a workaround for the x-dot-templates by loading the page into a webbrowser control and then saving the html to a temporary page which is then crawled. It functions but it's pretty ugly ;o) .
    Thanks in advance for your efforts.

     

Anonymous
Anonymous

Add attachments
Cancel





Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.