Is it possible to make the spider visit only certain TLDs like only '.com' URLs or just 'biz' URLs? I see that using the included regexp module I can only exclude from indexing but not from visiting.
Please help!
If necessary, is it possible to develop this feature? I'm not a programmer and I don't know how to do it! I can pay if necessary...
Thanks.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hello,
Is it possible to make the spider visit only certain TLDs like only '.com' URLs or just 'biz' URLs? I see that using the included regexp module I can only exclude from indexing but not from visiting.
Please help!
If necessary, is it possible to develop this feature? I'm not a programmer and I don't know how to do it! I can pay if necessary...
Thanks.