Menu ▾ ▴

#31 evaluate client-side scripts e.g. x-dot-templates

open
nobody
None
5
2015-12-07
2015-07-23
Anonymous
No

The sites I crawl often use javascript-templates to list links (e.g. x-dot-templates). These links are not recognized by phpcrawler (probably because the scripts are x-ecuted on the client machine). It would be nice to be able to capture these links also.

Discussion

  • Uwe Hunfeld

    Uwe Hunfeld - 2015-08-27

    Hi!

    Could you please post some example-pages?

    Thanks!

     
  • Comment has been marked as spam. 
    Undo

    View and moderate all "feature-requests Discussion" comments posted by this user

    Mark all as spam, and block user from posting to "Feature Requests"

    Anonymous

    Anonymous - 2015-10-05

    Try http://www.sro.ch/desktopdefault.aspx/tabid-209. The links on this page are embedded in javascript functions.
    Or http://cms.publisherconnect.ch/fileadmin/user/firmenwithelabel/solrclients/srrws - the links on this page are generated by an x-dot-template.
    I have found a workaround for the x-dot-templates by loading the page into a webbrowser control and then saving the html to a temporary page which is then crawled. It functions but it's pretty ugly ;o) .
    Thanks in advance for your efforts.

     
  • Comment has been marked as spam. 
    Undo

    View and moderate all "feature-requests Discussion" comments posted by this user

    Mark all as spam, and block user from posting to "Feature Requests"

    Anonymous

    Anonymous - 2015-10-10

    Try http://www.sro.ch/Stellen.aspx. The links on this page are embedded in javascript functions.
    Or http://cms.publisherconnect.ch/fileadmin/user/firmenwithelabel/solrclients/srrws - the links on this page are generated by an x-dot-template.
    I have found a workaround for the x-dot-templates by loading the page into a webbrowser control and then saving the html to a temporary page which is then crawled. It functions but it's pretty ugly ;o) .
    Thanks in advance for your efforts.

     

Anonymous
Anonymous

Add attachments
Cancel