Re: [Htmlparser-developer] Extract links...

[Derrick O. <Der...@ro...>]

JJ, Somik,

I looked at it briefly, and saw that the fetch is returning 403 - access 
prohibited.
In the past, when I've experienced this, there is usually some header 
field on the connection that needs to be set, like Accept-Language, 
Referer or User-Agent.
I don't think this can be solved in a general way.  I believe it needs 
to be specified differently for different servers and queries.
See testPost() in HTMLParserTest.java for how to set header fields on 
the connection.
Some experimentation will be required.

Derrick


Somik Raha wrote:

>>Question: How I can extract links of a page as:
>>
>>http://www.google.com/search?q=universe
>>    
>>
>
>Don't know why this is happening- Derrick ? 
>
>Regards,
>Somik
>
>
>  
>