htmlparser-developer

[Htmlparser-developer] Extract links...

[agente007 <e-a...@ex...>]

Hi,

Question: How I can extract links of a page as:

http://www.google.com/search?q=universe


The parser can't read that URL!

JJ

_______________________________________________
Join Excite! - http://www.excite.com
The most personalized portal on the Web!

Re: [Htmlparser-developer] Extract links...

[Somik R. <so...@ya...>]

> Question: How I can extract links of a page as:
> 
> http://www.google.com/search?q=universe

Don't know why this is happening- Derrick ? 

Regards,
Somik

Re: [Htmlparser-developer] Extract links...

[Derrick O. <Der...@ro...>]

JJ, Somik,

I looked at it briefly, and saw that the fetch is returning 403 - access 
prohibited.
In the past, when I've experienced this, there is usually some header 
field on the connection that needs to be set, like Accept-Language, 
Referer or User-Agent.
I don't think this can be solved in a general way.  I believe it needs 
to be specified differently for different servers and queries.
See testPost() in HTMLParserTest.java for how to set header fields on 
the connection.
Some experimentation will be required.

Derrick


Somik Raha wrote:

>>Question: How I can extract links of a page as:
>>
>>http://www.google.com/search?q=universe
>>    
>>
>
>Don't know why this is happening- Derrick ? 
>
>Regards,
>Somik
>
>
>  
>