Menu

Not crawling all content because of dynamic loaded content via ajax

Help
Anonymous
2019-01-06
2019-01-06
  • Anonymous

    Anonymous - 2019-01-06

    Some pages do load content dynamicly via ajax for performance reasons. So when i open a Page like this https://www.zalando.at/damenbekleidung-hosen-shorts/ it shows a huge amount of products. But the crawler sees only 6 products!

    When you show the source code there are also only 6 products, the other one are loaded dynamic via js.

     
  • Anonymous

    Anonymous - 2019-01-06

    If the page is loaded via javascript, you will NOT be able to do anything with it in PHP, other than fetch the url it's loaded from. Curl is not a browser and only fetches/pushes things for you. it's up to YOU to interpret the data that comes back, and that includes anything dynamic like JS.

     
  • Anonymous

    Anonymous - 2019-01-06

    Okey thanks. Lets work with the given data, but Google has crawler that can handle that! Otherwise thate would be cloaking and not allowed by Google.

     

Anonymous
Anonymous

Add attachments
Cancel