Uwe Hunfeld
-
2014-02-28
- status: open --> closed-duplicate
A user reported that the crawler doesn't follow (some) subdomains if follow-mode is set to 1.
Example:
Root-URL: www.foo.com, follow-mode 1.
Links to e.g. www.hamburg.foo.com don't get followed.
Also see this original forum-post:
https://sourceforge.net/p/phpcrawl/discussion/307696/thread/85b8d294/
Anonymous