htmlparser-user

[Htmlparser-user] extract links

[Sodergren, M.G. <mg...@le...>]

Hello again,
I think I have figured out how to do it. Its as follows:
- I have written two programs called WebPage (which is a static utility =
class that provides operations for downloading web pages) and =
WebPageViewer (contains utilities to download and display HTML pages). =
So if i run WebPageViewer i just enter my search at the top (which makes =
the yahoo search url with my search) and it displays the yahoo search =
page for this search because the beginning URL is the standard yahoo =
search url. So can i not some how get the htmlparser (just the extract =
link programs) to work with my WebPage Viewer so that i enter a search =
like before but this time the HTML page shown in my window is just the =
extracted links? Can I do this? If so how? This would mean that I dont =
need a servlet or something else. I have attached my two programs so you =
can have a look at them and run them if you want. They are quite basic =
and really i want them to contain a text field where i can enter my =
search without the basic yahoo search url been shown and then have a =
search button i can press to perform the search instead of pressing =
enter.=20
Thanks,
Mats

Re: [Htmlparser-user] extract links

[Somik R. <so...@ya...>]

Mats wrote :
> So can i not some how get the htmlparser (just the extract link programs)
to work with my WebPage Viewer so that i enter a > search like before but
this time the HTML page shown in my window is just the extracted links? Can
I do this? If so how?

Yes you can do this.
Look at the program MailRipper.java in the com.kizna.html.parserapplications
package. This program will print only the email addresses on a page (which
are also link tags). Its even simpler to simply filter out all the tags
except the link tags.

Try this :
HTMLParser parser = new HTMLParser("http://myurl.com");
HTMLNode node;
for (Enumeration e = parser.elements();e.hasMoreElements();) {
    node = (HTMLNode)e.nextElement();   // Get the next html node
    if (node instanceof HTMLLinkTag) {
        // Yes - this is a web link. Now you can downcast and do what you
want with it
        HTMLLinkTag linkTag = (HTMLLinkTag)node;
        System.out.println("link to "+linkTag.getLink()+", link text =
"+linkTag.getLinkText());
    }
}

This should give you what you want.

Regards,
Somik


_________________________________________________________
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com