I am trying to crawl a site that has three sections that are set to display:none and are made visible via jquery. Whey the are not displayed and I check the source code of the document the information is available. However, when I crawl this site it leaves this information out. Any ideas on how to include the full source code of a document regardless of what is not displayed?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
I am trying to crawl a site that has three sections that are set to display:none and are made visible via jquery. Whey the are not displayed and I check the source code of the document the information is available. However, when I crawl this site it leaves this information out. Any ideas on how to include the full source code of a document regardless of what is not displayed?
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi!
By default phpcrawl does NOT exclude anything, and "display:none" shouldn't matter.
Could you maybe post the site your arw talkig abiut? Then i can run a quick test.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
www.awkwardconcepts.com
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Solved. Simple mistake, I was crawling for html tags and wasn't crawling for ul which is where the information was. Thanks!
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Nice to hear!