God I'm happy I've found this class - I've been fart-assing around with my own crawler for a few days now and getting nowhere fast, getting tripped up by frames, javascript and all sorts of other nasties. Now I can just use this. Many thanks for the extra sleep!! :D
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
God I'm happy I've found this class - I've been fart-assing around with my own crawler for a few days now and getting nowhere fast, getting tripped up by frames, javascript and all sorts of other nasties. Now I can just use this. Many thanks for the extra sleep!! :D