I found parser can not work for some html pages, i.e. the pages which links have " as part of link text.
Please try this, http://search.yahoo.com/search?ei=UTF-8&n=100&fl=1&vl=lang_en&meta=vl%3Dlang_en&_adv_prop=web&p=mit&fr=FP-tab-web-t&b=301
Can not extract all links from the url.
Any help is appreciated!
Thanks
foxwei
More information.
It has nothing to do with ".
I copy the html to a local file and all links (around 400) were extracted.
But still if I directly extract from URL, only 143 are extracted.
Any help is welcomed.
Foxwei
Log in to post a comment.
I found parser can not work for some html pages, i.e. the pages which links have " as part of link text.
Please try this,
http://search.yahoo.com/search?ei=UTF-8&n=100&fl=1&vl=lang_en&meta=vl%3Dlang_en&_adv_prop=web&p=mit&fr=FP-tab-web-t&b=301
Can not extract all links from the url.
Any help is appreciated!
Thanks
foxwei
More information.
It has nothing to do with ".
I copy the html to a local file and all links (around 400) were extracted.
But still if I directly extract from URL, only 143 are extracted.
Any help is welcomed.
Foxwei