I get this error when i start the crawler. can you tell me please what i can do ? thanks :
PHP Fatal error: Allowed memory size of 276824064 bytes exhausted (tried to allocate 213123733 bytes) in /home/hudson/include/lib/Crawler/libs/PHPCrawlerHTTPRequest.class.php on line 651
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
I get this error when i start the crawler. can you tell me please what i can do ? thanks :
PHP Fatal error: Allowed memory size of 276824064 bytes exhausted (tried to allocate 213123733 bytes) in /home/hudson/include/lib/Crawler/libs/PHPCrawlerHTTPRequest.class.php on line 651
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi!
Did you try to use the internal SQLite-cache instead of the in-memory-cache?
Please see here:
http://phpcrawl.cuab.de/spidering_huge_websites.html