Hi!
I would like to use your library to make a broken link checker. But when I try to get all links for http://nvvk.eu/, my result is 625 links to check. But deadlinkchecker.com found 1747 links for that website.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi!
I would like to use your library to make a broken link checker. But when I try to get all links for http://nvvk.eu/, my result is 625 links to check. But deadlinkchecker.com found 1747 links for that website.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
Hi!
Do you have a example for a URL phpcrawl didn't find and deadlinkchecker did?
Myabe deadlinkchecker is looking for image-links and css and js URLs too and you excluded them in phpcrawl?
Just guessing.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
I don't exclude images, if you mean $crawler->addURLFilterRule(). My app definitely checks images.
What about external URLs?
How do you check the links?
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
I get $DocInfo->links_found for every page and collect all links in a global array.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
OK, sounds right, strange.
I'll give it a test tomorrow (or the day after).
Again: Do you know any URL deadlinkchecker finds on that page and phpcrawl doesn't?
Without it gets difficult.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
When I run /test_interface/index.php, I get all URLs requested.
When I run example.php, I get a part of URLs.
I tried to understand what settings are different, but no success.
Any ideas?
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
For example, test interface finds this link http://www.nvvk.eu/schuld-hulpverlening/ledenoverzicht/lid/27, but example.php doesn't.
I believe I do something wrong with settings, but I can't find the mistake by myself.
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
It seems solved.
Great library. Thank you very much!
Ok, great.
What was the problem?
View and moderate all "Help" comments posted by this user
Mark all as spam, and block user from posting to "Forum"
It's very simple. I just removed traffic limit.
Thanks again.
Last edit: Anonymous 2015-03-27