Home / Browse / HTML Parser / Mail / Archive

Donate

HTML Parser

Email Archive: htmlparser-user (read-only)

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 16:10

I didn't use registerScanners().

Attached is part of the code:

			Parser parser = new Parser(destination);
			parser.addScanner(new LinkScanner(""));
			Node [] links =
parser.extractAllNodesThatAre(LinkTag.class);



 --- Somik Raha <somik@...> wrote: > They're not
missing, they're in the table tag. Don't
> use registerScanners().
> Instead, register only the link scanner.
> 
> Regards,
> Somik
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Wednesday, September 17, 2003 7:51 PM
> Subject: [general] [Htmlparser-user] More details
> 
> 
> > It looks all links in the unordered list are
> missing,
> > where the unordered list is in a table.
> >
> >
>
______________________________________________________________________
> > Post your free ad now! http://personals.yahoo.ca
> >
> >
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> >
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Thread View

Thread	Author	Date
[Htmlparser-user] Building New Tags to Output	Mark Ault <mark.ault@ca...>

Re: [Htmlparser-user] Building New Tags to Output

From: Derrick Oswald <DerrickOswald@Ro...> - 2003-09-17 22:12

There's no easy way. The LinkTagTest code does a lot of these constructs:

        LinkTag link;

        link = new LinkTag(
            new TagData(0,0,"",""),
            new CompositeTagData(null,null,null),
            new LinkData("irc://server/channel","","",false,false)
        );

You'll have to figure out the construtors for the arguments.
I saw this problem, and for the new lexer package I've added a zero args 
constrcutor for TagNode.

Derrick

Mark Ault wrote:

> I suspect this is a pretty basic question but I couldn't find anything 
> in the archives or the doc.
>
> I am building a tool used to 'fix up' the html generated by MS Word 
> with the ultimate destination being a JavaHelp file.  Among other 
> things, one of the things I want to do is remove the embedded style 
> sheet and insert a <link> tag to an external style sheet.
>
> The approach I am using is to initially parse the document into a 
> NodeList and then I iterate over the list with a NodeVisitor for each 
> of the various things I want to do to the document.  This approach has 
> generally worked great.  I can find the <head> tag using this 
> technique and then look at the children and remove the embedded style 
> sheet without a problem.  However, I am have difficulty determining 
> how to manufacture a <link> tag as a Tag object relatively easily.  If 
> I could do this I could then add it as a child to the head.  Finally, 
> after I have done all of my cleanup I could iterate over all of the 
> nodes one last time to create the new html.  Any thoughts on how to 
> generate the <link> tag?
>
> Thanks for the help

[Htmlparser-user] Anyone tried to parse a page from Yahoo?

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 02:43

I tried to use htmlparser to get all <a> nodes on
Google page. It looks very good. However, when I use
it Yahoo pages. The result is not really good. Most of
the link <a>'s are missing. Any comment?

Xue-Feng 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

[Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 02:51

It looks all links in the unordered list are missing,
where the unordered list is in a table.

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-18 16:04

They're not missing, they're in the table tag. Don't use registerScanners().
Instead, register only the link scanner.

Regards,
Somik
----- Original Message ----- 
From: "Xue-Feng Yang" <just4look@...>
To: <htmlparser-user@...>
Sent: Wednesday, September 17, 2003 7:51 PM
Subject: [general] [Htmlparser-user] More details


> It looks all links in the unordered list are missing,
> where the unordered list is in a table.
>
> ______________________________________________________________________
> Post your free ad now! http://personals.yahoo.ca
>
>
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Re: [general] Re: [Htmlparser-user] Building New Tags to Output

From: Somik Raha <somik@ya...> - 2003-09-18 16:08

>Any thoughts on how to generate the <link> tag?

suggestions:
1. check the javadoc for LinkTag
2. put in a creation method for creating a link tag of your requirement.


Regards,
Somik

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 16:10

I didn't use registerScanners().

Attached is part of the code:

			Parser parser = new Parser(destination);
			parser.addScanner(new LinkScanner(""));
			Node [] links =
parser.extractAllNodesThatAre(LinkTag.class);



 --- Somik Raha <somik@...> wrote: > They're not
missing, they're in the table tag. Don't
> use registerScanners().
> Instead, register only the link scanner.
> 
> Regards,
> Somik
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Wednesday, September 17, 2003 7:51 PM
> Subject: [general] [Htmlparser-user] More details
> 
> 
> > It looks all links in the unordered list are
> missing,
> > where the unordered list is in a table.
> >
> >
>
______________________________________________________________________
> > Post your free ad now! http://personals.yahoo.ca
> >
> >
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> >
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-18 16:13

Can you give a better report - specifying:
1. relevant html segment
2. what objects you end up with, and what you were expecting
3. if possible, a failing testcase demonstrating this scenario

Regards, 
Somik

----- Original Message ----- 
From: "Xue-Feng Yang" <just4look@...>
To: <htmlparser-user@...>
Sent: Thursday, September 18, 2003 9:09 AM
Subject: Re: [general] [Htmlparser-user] More details


> I didn't use registerScanners().
> 
> Attached is part of the code:
> 
> Parser parser = new Parser(destination);
> parser.addScanner(new LinkScanner(""));
> Node [] links =
> parser.extractAllNodesThatAre(LinkTag.class);
> 
> 
> 
>  --- Somik Raha <somik@...> wrote: > They're not
> missing, they're in the table tag. Don't
> > use registerScanners().
> > Instead, register only the link scanner.
> > 
> > Regards,
> > Somik
> > ----- Original Message ----- 
> > From: "Xue-Feng Yang" <just4look@...>
> > To: <htmlparser-user@...>
> > Sent: Wednesday, September 17, 2003 7:51 PM
> > Subject: [general] [Htmlparser-user] More details
> > 
> > 
> > > It looks all links in the unordered list are
> > missing,
> > > where the unordered list is in a table.
> > >
> > >
> >
> ______________________________________________________________________
> > > Post your free ad now! http://personals.yahoo.ca
> > >
> > >
> > >
> >
> -------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > >
> > 
> > 
> > 
> >
> -------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user 
> 
> ______________________________________________________________________ 
> Post your free ad now! http://personals.yahoo.ca
> 
> 
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 16:15

OK, I will do that tonight.

 --- Somik Raha <somik@...> wrote: > Can you
give a better report - specifying:
> 1. relevant html segment
> 2. what objects you end up with, and what you were
> expecting
> 3. if possible, a failing testcase demonstrating
> this scenario
> 
> Regards, 
> Somik
> 
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Thursday, September 18, 2003 9:09 AM
> Subject: Re: [general] [Htmlparser-user] More
> details
> 
> 
> > I didn't use registerScanners().
> > 
> > Attached is part of the code:
> > 
> > Parser parser = new Parser(destination);
> > parser.addScanner(new LinkScanner(""));
> > Node [] links =
> > parser.extractAllNodesThatAre(LinkTag.class);
> > 
> > 
> > 
> >  --- Somik Raha <somik@...> wrote: > They're
> not
> > missing, they're in the table tag. Don't
> > > use registerScanners().
> > > Instead, register only the link scanner.
> > > 
> > > Regards,
> > > Somik
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > Subject: [general] [Htmlparser-user] More
> details
> > > 
> > > 
> > > > It looks all links in the unordered list are
> > > missing,
> > > > where the unordered list is in a table.
> > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > Post your free ad now!
> http://personals.yahoo.ca
> > > >
> > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > >
> _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > >
> > > 
> > > 
> > > 
> > >
> >
>
-------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> > 
> >
>
______________________________________________________________________
> 
> > Post your free ad now! http://personals.yahoo.ca
> > 
> > 
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 22:02

You are right. It is not the problem of tables and
lists. The link is there, but not complete.

Some of the links are coded as
<a href="http://domain.com"><b>Name</b></a>

So the text of the link is missing since "Name" is in
the tag b. My code only count the link with text. That
is the reason some links were missing.

Is there a way I can find the text in links even if
the text is under some decoration tag?

Thank you very much,

Xue-Feng

 --- Somik Raha <somik@...> wrote: > Can you
give a better report - specifying:
> 1. relevant html segment
> 2. what objects you end up with, and what you were
> expecting
> 3. if possible, a failing testcase demonstrating
> this scenario
> 
> Regards, 
> Somik
> 
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Thursday, September 18, 2003 9:09 AM
> Subject: Re: [general] [Htmlparser-user] More
> details
> 
> 
> > I didn't use registerScanners().
> > 
> > Attached is part of the code:
> > 
> > Parser parser = new Parser(destination);
> > parser.addScanner(new LinkScanner(""));
> > Node [] links =
> > parser.extractAllNodesThatAre(LinkTag.class);
> > 
> > 
> > 
> >  --- Somik Raha <somik@...> wrote: > They're
> not
> > missing, they're in the table tag. Don't
> > > use registerScanners().
> > > Instead, register only the link scanner.
> > > 
> > > Regards,
> > > Somik
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > Subject: [general] [Htmlparser-user] More
> details
> > > 
> > > 
> > > > It looks all links in the unordered list are
> > > missing,
> > > > where the unordered list is in a table.
> > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > Post your free ad now!
> http://personals.yahoo.ca
> > > >
> > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > >
> _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > >
> > > 
> > > 
> > > 
> > >
> >
>
-------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> > 
> >
>
______________________________________________________________________
> 
> > Post your free ad now! http://personals.yahoo.ca
> > 
> > 
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-18 22:05

did you try linkTag.toPlainTextString()?

Regards,
Somik
----- Original Message ----- 
From: "Xue-Feng Yang" <just4look@...>
To: <htmlparser-user@...>
Sent: Thursday, September 18, 2003 3:01 PM
Subject: Re: [general] [Htmlparser-user] More details


> You are right. It is not the problem of tables and
> lists. The link is there, but not complete.
> 
> Some of the links are coded as
> <a href="http://domain.com"><b>Name</b></a>
> 
> So the text of the link is missing since "Name" is in
> the tag b. My code only count the link with text. That
> is the reason some links were missing.
> 
> Is there a way I can find the text in links even if
> the text is under some decoration tag?
> 
> Thank you very much,
> 
> Xue-Feng
> 
>  --- Somik Raha <somik@...> wrote: > Can you
> give a better report - specifying:
> > 1. relevant html segment
> > 2. what objects you end up with, and what you were
> > expecting
> > 3. if possible, a failing testcase demonstrating
> > this scenario
> > 
> > Regards, 
> > Somik
> > 
> > ----- Original Message ----- 
> > From: "Xue-Feng Yang" <just4look@...>
> > To: <htmlparser-user@...>
> > Sent: Thursday, September 18, 2003 9:09 AM
> > Subject: Re: [general] [Htmlparser-user] More
> > details
> > 
> > 
> > > I didn't use registerScanners().
> > > 
> > > Attached is part of the code:
> > > 
> > > Parser parser = new Parser(destination);
> > > parser.addScanner(new LinkScanner(""));
> > > Node [] links =
> > > parser.extractAllNodesThatAre(LinkTag.class);
> > > 
> > > 
> > > 
> > >  --- Somik Raha <somik@...> wrote: > They're
> > not
> > > missing, they're in the table tag. Don't
> > > > use registerScanners().
> > > > Instead, register only the link scanner.
> > > > 
> > > > Regards,
> > > > Somik
> > > > ----- Original Message ----- 
> > > > From: "Xue-Feng Yang" <just4look@...>
> > > > To: <htmlparser-user@...>
> > > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > > Subject: [general] [Htmlparser-user] More
> > details
> > > > 
> > > > 
> > > > > It looks all links in the unordered list are
> > > > missing,
> > > > > where the unordered list is in a table.
> > > > >
> > > > >
> > > >
> > >
> >
> ______________________________________________________________________
> > > > > Post your free ad now!
> > http://personals.yahoo.ca
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > Welcome to geek heaven.
> > > > > http://thinkgeek.com/sf
> > > > >
> > _______________________________________________
> > > > > Htmlparser-user mailing list
> > > > > Htmlparser-user@...
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > >
> > > > 
> > > > 
> > > > 
> > > >
> > >
> >
> -------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > > _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > 
> > > 
> > >
> >
> ______________________________________________________________________
> > 
> > > Post your free ad now! http://personals.yahoo.ca
> > > 
> > > 
> > >
> >
> -------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > 
> > 
> > 
> >
> -------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user 
> 
> ______________________________________________________________________ 
> Post your free ad now! http://personals.yahoo.ca
> 
> 
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 22:09

Yes.

 --- Somik Raha <somik@...> wrote: > did you try
linkTag.toPlainTextString()?
> 
> Regards,
> Somik
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Thursday, September 18, 2003 3:01 PM
> Subject: Re: [general] [Htmlparser-user] More
> details
> 
> 
> > You are right. It is not the problem of tables and
> > lists. The link is there, but not complete.
> > 
> > Some of the links are coded as
> > <a href="http://domain.com"><b>Name</b></a>
> > 
> > So the text of the link is missing since "Name" is
> in
> > the tag b. My code only count the link with text.
> That
> > is the reason some links were missing.
> > 
> > Is there a way I can find the text in links even
> if
> > the text is under some decoration tag?
> > 
> > Thank you very much,
> > 
> > Xue-Feng
> > 
> >  --- Somik Raha <somik@...> wrote: > Can you
> > give a better report - specifying:
> > > 1. relevant html segment
> > > 2. what objects you end up with, and what you
> were
> > > expecting
> > > 3. if possible, a failing testcase demonstrating
> > > this scenario
> > > 
> > > Regards, 
> > > Somik
> > > 
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Thursday, September 18, 2003 9:09 AM
> > > Subject: Re: [general] [Htmlparser-user] More
> > > details
> > > 
> > > 
> > > > I didn't use registerScanners().
> > > > 
> > > > Attached is part of the code:
> > > > 
> > > > Parser parser = new Parser(destination);
> > > > parser.addScanner(new LinkScanner(""));
> > > > Node [] links =
> > > > parser.extractAllNodesThatAre(LinkTag.class);
> > > > 
> > > > 
> > > > 
> > > >  --- Somik Raha <somik@...> wrote: >
> They're
> > > not
> > > > missing, they're in the table tag. Don't
> > > > > use registerScanners().
> > > > > Instead, register only the link scanner.
> > > > > 
> > > > > Regards,
> > > > > Somik
> > > > > ----- Original Message ----- 
> > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > To: <htmlparser-user@...>
> > > > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > > > Subject: [general] [Htmlparser-user] More
> > > details
> > > > > 
> > > > > 
> > > > > > It looks all links in the unordered list
> are
> > > > > missing,
> > > > > > where the unordered list is in a table.
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > > > Post your free ad now!
> > > http://personals.yahoo.ca
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > This sf.net email is sponsored
> by:ThinkGeek
> > > > > > Welcome to geek heaven.
> > > > > > http://thinkgeek.com/sf
> > > > > >
> > > _______________________________________________
> > > > > > Htmlparser-user mailing list
> > > > > > Htmlparser-user@...
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > >
> > > > > 
> > > > > 
> > > > > 
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > Welcome to geek heaven.
> > > > > http://thinkgeek.com/sf
> > > > >
> _______________________________________________
> > > > > Htmlparser-user mailing list
> > > > > Htmlparser-user@...
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > 
> > > > 
> > > >
> > >
> >
>
______________________________________________________________________
> > > 
> > > > Post your free ad now!
> http://personals.yahoo.ca
> > > > 
> > > > 
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > >
> _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > 
> > > 
> > > 
> > >
> >
>
-------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> > 
> >
>
______________________________________________________________________
> 
> > Post your free ad now! http://personals.yahoo.ca
> > 
> > 
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-18 22:14

Both getLinkText() and toPlainTextString() give the
same out in this particular page. 

Here is the test code:

	public static void main(String[] args) throws
Exception{
		String
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
		Parser parser = new Parser(destination);
		parser.addScanner(new LinkScanner(""));
		Node [] links =
parser.extractAllNodesThatAre(LinkTag.class);
		String linkString=null;
		String textString=null;
		for (int i=0;i<links.length;i++) {
			LinkTag linkTag = (LinkTag)links[i];			
			linkString=linkTag.getLink();
			textString=linkTag.toPlainTextString();
			System.out.println("linkString="+linkString);
			System.out.println("textString="+textString);
		}		
	}




 --- Somik Raha <somik@...> wrote: > did you try
linkTag.toPlainTextString()?
> 
> Regards,
> Somik
> ----- Original Message ----- 
> From: "Xue-Feng Yang" <just4look@...>
> To: <htmlparser-user@...>
> Sent: Thursday, September 18, 2003 3:01 PM
> Subject: Re: [general] [Htmlparser-user] More
> details
> 
> 
> > You are right. It is not the problem of tables and
> > lists. The link is there, but not complete.
> > 
> > Some of the links are coded as
> > <a href="http://domain.com"><b>Name</b></a>
> > 
> > So the text of the link is missing since "Name" is
> in
> > the tag b. My code only count the link with text.
> That
> > is the reason some links were missing.
> > 
> > Is there a way I can find the text in links even
> if
> > the text is under some decoration tag?
> > 
> > Thank you very much,
> > 
> > Xue-Feng
> > 
> >  --- Somik Raha <somik@...> wrote: > Can you
> > give a better report - specifying:
> > > 1. relevant html segment
> > > 2. what objects you end up with, and what you
> were
> > > expecting
> > > 3. if possible, a failing testcase demonstrating
> > > this scenario
> > > 
> > > Regards, 
> > > Somik
> > > 
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Thursday, September 18, 2003 9:09 AM
> > > Subject: Re: [general] [Htmlparser-user] More
> > > details
> > > 
> > > 
> > > > I didn't use registerScanners().
> > > > 
> > > > Attached is part of the code:
> > > > 
> > > > Parser parser = new Parser(destination);
> > > > parser.addScanner(new LinkScanner(""));
> > > > Node [] links =
> > > > parser.extractAllNodesThatAre(LinkTag.class);
> > > > 
> > > > 
> > > > 
> > > >  --- Somik Raha <somik@...> wrote: >
> They're
> > > not
> > > > missing, they're in the table tag. Don't
> > > > > use registerScanners().
> > > > > Instead, register only the link scanner.
> > > > > 
> > > > > Regards,
> > > > > Somik
> > > > > ----- Original Message ----- 
> > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > To: <htmlparser-user@...>
> > > > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > > > Subject: [general] [Htmlparser-user] More
> > > details
> > > > > 
> > > > > 
> > > > > > It looks all links in the unordered list
> are
> > > > > missing,
> > > > > > where the unordered list is in a table.
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > > > Post your free ad now!
> > > http://personals.yahoo.ca
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > This sf.net email is sponsored
> by:ThinkGeek
> > > > > > Welcome to geek heaven.
> > > > > > http://thinkgeek.com/sf
> > > > > >
> > > _______________________________________________
> > > > > > Htmlparser-user mailing list
> > > > > > Htmlparser-user@...
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > >
> > > > > 
> > > > > 
> > > > > 
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > Welcome to geek heaven.
> > > > > http://thinkgeek.com/sf
> > > > >
> _______________________________________________
> > > > > Htmlparser-user mailing list
> > > > > Htmlparser-user@...
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > 
> > > > 
> > > >
> > >
> >
>
______________________________________________________________________
> > > 
> > > > Post your free ad now!
> http://personals.yahoo.ca
> > > > 
> > > > 
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > >
> _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > 
> > > 
> > > 
> > >
> >
>
-------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> > 
> >
>
______________________________________________________________________
> 
> > Post your free ad now! http://personals.yahoo.ca
> > 
> > 
> >
>
-------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htmlparser-user@...
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-18 22:18

how about showing us the ouput?
----- Original Message ----- 
From: "Xue-Feng Yang" <just4look@...>
To: <htmlparser-user@...>
Sent: Thursday, September 18, 2003 3:14 PM
Subject: Re: [general] [Htmlparser-user] More details


> Both getLinkText() and toPlainTextString() give the
> same out in this particular page.
>
> Here is the test code:
>
> public static void main(String[] args) throws
> Exception{
> String
>
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Te
rritories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
> Parser parser = new Parser(destination);
> parser.addScanner(new LinkScanner(""));
> Node [] links =
> parser.extractAllNodesThatAre(LinkTag.class);
> String linkString=null;
> String textString=null;
> for (int i=0;i<links.length;i++) {
> LinkTag linkTag = (LinkTag)links[i];
> linkString=linkTag.getLink();
> textString=linkTag.toPlainTextString();
> System.out.println("linkString="+linkString);
> System.out.println("textString="+textString);
> }
> }
>
>
>
>
>  --- Somik Raha <somik@...> wrote: > did you try
> linkTag.toPlainTextString()?
> >
> > Regards,
> > Somik
> > ----- Original Message ----- 
> > From: "Xue-Feng Yang" <just4look@...>
> > To: <htmlparser-user@...>
> > Sent: Thursday, September 18, 2003 3:01 PM
> > Subject: Re: [general] [Htmlparser-user] More
> > details
> >
> >
> > > You are right. It is not the problem of tables and
> > > lists. The link is there, but not complete.
> > >
> > > Some of the links are coded as
> > > <a href="http://domain.com"><b>Name</b></a>
> > >
> > > So the text of the link is missing since "Name" is
> > in
> > > the tag b. My code only count the link with text.
> > That
> > > is the reason some links were missing.
> > >
> > > Is there a way I can find the text in links even
> > if
> > > the text is under some decoration tag?
> > >
> > > Thank you very much,
> > >
> > > Xue-Feng
> > >
> > >  --- Somik Raha <somik@...> wrote: > Can you
> > > give a better report - specifying:
> > > > 1. relevant html segment
> > > > 2. what objects you end up with, and what you
> > were
> > > > expecting
> > > > 3. if possible, a failing testcase demonstrating
> > > > this scenario
> > > >
> > > > Regards,
> > > > Somik
> > > >
> > > > ----- Original Message ----- 
> > > > From: "Xue-Feng Yang" <just4look@...>
> > > > To: <htmlparser-user@...>
> > > > Sent: Thursday, September 18, 2003 9:09 AM
> > > > Subject: Re: [general] [Htmlparser-user] More
> > > > details
> > > >
> > > >
> > > > > I didn't use registerScanners().
> > > > >
> > > > > Attached is part of the code:
> > > > >
> > > > > Parser parser = new Parser(destination);
> > > > > parser.addScanner(new LinkScanner(""));
> > > > > Node [] links =
> > > > > parser.extractAllNodesThatAre(LinkTag.class);
> > > > >
> > > > >
> > > > >
> > > > >  --- Somik Raha <somik@...> wrote: >
> > They're
> > > > not
> > > > > missing, they're in the table tag. Don't
> > > > > > use registerScanners().
> > > > > > Instead, register only the link scanner.
> > > > > >
> > > > > > Regards,
> > > > > > Somik
> > > > > > ----- Original Message ----- 
> > > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > > To: <htmlparser-user@...>
> > > > > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > > > > Subject: [general] [Htmlparser-user] More
> > > > details
> > > > > >
> > > > > >
> > > > > > > It looks all links in the unordered list
> > are
> > > > > > missing,
> > > > > > > where the unordered list is in a table.
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> ______________________________________________________________________
> > > > > > > Post your free ad now!
> > > > http://personals.yahoo.ca
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > > > This sf.net email is sponsored
> > by:ThinkGeek
> > > > > > > Welcome to geek heaven.
> > > > > > > http://thinkgeek.com/sf
> > > > > > >
> > > > _______________________________________________
> > > > > > > Htmlparser-user mailing list
> > > > > > > Htmlparser-user@...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > > Welcome to geek heaven.
> > > > > > http://thinkgeek.com/sf
> > > > > >
> > _______________________________________________
> > > > > > Htmlparser-user mailing list
> > > > > > Htmlparser-user@...
> > > > > >
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > >
> > > > >
> > > > >
> > > >
> > >
> >
> ______________________________________________________________________
> > > >
> > > > > Post your free ad now!
> > http://personals.yahoo.ca
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > Welcome to geek heaven.
> > > > > http://thinkgeek.com/sf
> > > > >
> > _______________________________________________
> > > > > Htmlparser-user mailing list
> > > > > Htmlparser-user@...
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > >
> > > >
> > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > > _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> >
> > >
> > >
> >
> ______________________________________________________________________
> >
> > > Post your free ad now! http://personals.yahoo.ca
> > >
> > >
> > >
> >
> -------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> >
> >
> >
> -------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> >
> === message truncated ===
>
> ______________________________________________________________________
> Post your free ad now! http://personals.yahoo.ca
>
>
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-19 20:22

Could you show us the output?

Regards,
Somik

On Thu, 2003-09-18 at 15:14, Xue-Feng Yang wrote:
> Both getLinkText() and toPlainTextString() give the
> same out in this particular page. 
> 
> Here is the test code:
> 
> 	public static void main(String[] args) throws
> Exception{
> 		String
> destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
> 		Parser parser = new Parser(destination);
> 		parser.addScanner(new LinkScanner(""));
> 		Node [] links =
> parser.extractAllNodesThatAre(LinkTag.class);
> 		String linkString=null;
> 		String textString=null;
> 		for (int i=0;i<links.length;i++) {
> 			LinkTag linkTag = (LinkTag)links[i];			
> 			linkString=linkTag.getLink();
> 			textString=linkTag.toPlainTextString();
> 			System.out.println("linkString="+linkString);
> 			System.out.println("textString="+textString);
> 		}		
> 	}
> 
> 
> 
> 
>  --- Somik Raha <somik@...> wrote: > did you try
> linkTag.toPlainTextString()?
> > 
> > Regards,
> > Somik
> > ----- Original Message ----- 
> > From: "Xue-Feng Yang" <just4look@...>
> > To: <htmlparser-user@...>
> > Sent: Thursday, September 18, 2003 3:01 PM
> > Subject: Re: [general] [Htmlparser-user] More
> > details
> > 
> > 
> > > You are right. It is not the problem of tables and
> > > lists. The link is there, but not complete.
> > > 
> > > Some of the links are coded as
> > > <a href="http://domain.com"><b>Name</b></a>
> > > 
> > > So the text of the link is missing since "Name" is
> > in
> > > the tag b. My code only count the link with text.
> > That
> > > is the reason some links were missing.
> > > 
> > > Is there a way I can find the text in links even
> > if
> > > the text is under some decoration tag?
> > > 
> > > Thank you very much,
> > > 
> > > Xue-Feng
> > > 
> > >  --- Somik Raha <somik@...> wrote: > Can you
> > > give a better report - specifying:
> > > > 1. relevant html segment
> > > > 2. what objects you end up with, and what you
> > were
> > > > expecting
> > > > 3. if possible, a failing testcase demonstrating
> > > > this scenario
> > > > 
> > > > Regards, 
> > > > Somik
> > > > 
> > > > ----- Original Message ----- 
> > > > From: "Xue-Feng Yang" <just4look@...>
> > > > To: <htmlparser-user@...>
> > > > Sent: Thursday, September 18, 2003 9:09 AM
> > > > Subject: Re: [general] [Htmlparser-user] More
> > > > details
> > > > 
> > > > 
> > > > > I didn't use registerScanners().
> > > > > 
> > > > > Attached is part of the code:
> > > > > 
> > > > > Parser parser = new Parser(destination);
> > > > > parser.addScanner(new LinkScanner(""));
> > > > > Node [] links =
> > > > > parser.extractAllNodesThatAre(LinkTag.class);
> > > > > 
> > > > > 
> > > > > 
> > > > >  --- Somik Raha <somik@...> wrote: >
> > They're
> > > > not
> > > > > missing, they're in the table tag. Don't
> > > > > > use registerScanners().
> > > > > > Instead, register only the link scanner.
> > > > > > 
> > > > > > Regards,
> > > > > > Somik
> > > > > > ----- Original Message ----- 
> > > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > > To: <htmlparser-user@...>
> > > > > > Sent: Wednesday, September 17, 2003 7:51 PM
> > > > > > Subject: [general] [Htmlparser-user] More
> > > > details
> > > > > > 
> > > > > > 
> > > > > > > It looks all links in the unordered list
> > are
> > > > > > missing,
> > > > > > > where the unordered list is in a table.
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> ______________________________________________________________________
> > > > > > > Post your free ad now!
> > > > http://personals.yahoo.ca
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > > > This sf.net email is sponsored
> > by:ThinkGeek
> > > > > > > Welcome to geek heaven.
> > > > > > > http://thinkgeek.com/sf
> > > > > > >
> > > > _______________________________________________
> > > > > > > Htmlparser-user mailing list
> > > > > > > Htmlparser-user@...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > > >
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > >
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > > Welcome to geek heaven.
> > > > > > http://thinkgeek.com/sf
> > > > > >
> > _______________________________________________
> > > > > > Htmlparser-user mailing list
> > > > > > Htmlparser-user@...
> > > > > >
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > 
> > > > > 
> > > > >
> > > >
> > >
> >
> ______________________________________________________________________
> > > > 
> > > > > Post your free ad now!
> > http://personals.yahoo.ca
> > > > > 
> > > > > 
> > > > >
> > > >
> > >
> >
> -------------------------------------------------------
> > > > > This sf.net email is sponsored by:ThinkGeek
> > > > > Welcome to geek heaven.
> > > > > http://thinkgeek.com/sf
> > > > >
> > _______________________________________________
> > > > > Htmlparser-user mailing list
> > > > > Htmlparser-user@...
> > > > >
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > 
> > > > 
> > > > 
> > > >
> > >
> >
> -------------------------------------------------------
> > > > This sf.net email is sponsored by:ThinkGeek
> > > > Welcome to geek heaven.
> > > > http://thinkgeek.com/sf
> > > > _______________________________________________
> > > > Htmlparser-user mailing list
> > > > Htmlparser-user@...
> > > >
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > 
> > > 
> > >
> >
> ______________________________________________________________________
> > 
> > > Post your free ad now! http://personals.yahoo.ca
> > > 
> > > 
> > >
> >
> -------------------------------------------------------
> > > This sf.net email is sponsored by:ThinkGeek
> > > Welcome to geek heaven.
> > > http://thinkgeek.com/sf
> > > _______________________________________________
> > > Htmlparser-user mailing list
> > > Htmlparser-user@...
> > >
> >
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > 
> > 
> >
> -------------------------------------------------------
> > This sf.net email is sponsored by:ThinkGeek
> > Welcome to geek heaven.
> > http://thinkgeek.com/sf
> > 
> === message truncated === 
> 
> ______________________________________________________________________ 
> Post your free ad now! http://personals.yahoo.ca
> 
> 
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user

Re: [Htmlparser-user] Building New Tags to Output

From: Mark Ault <mark.ault@ca...> - 2003-09-19 20:26

Thought I would post what I ended up using as my solution.  Both just to 
document it and to seek if anyone just plain thinks it is a bad idea.

I found in one of the test cases places where HTML string fragments were 
defined in the code and then parsed.  So, what I ended up doing is 
building the link tag that I wanted (looked something like <LINK 
HREF="/mystylsheet.css" REL="stylesheet" TYPE="text/css"> and then 
parsing that using the Parser.createParser(String) method.  This just 
seemed more obvious what what going on than trying to figure out how to 
construct a tag on your own.  I then find the <LINK> tag and add it as a 
child to the <HEAD> tag in the document I am modifying.

BTW - I find the reference to the <A> tag as a LinkTag little misleading 
since there is an actual <LINK> tag.  I know the <A> tag is commonly 
referred to as a link but....  I probably wouldn't have thought about it 
if I had not been interested in inserting a <LINK> tag.

Great library.  Keep up the good work!

Derrick Oswald wrote:

> There's no easy way. The LinkTagTest code does a lot of these constructs:
>
>        LinkTag link;
>
>        link = new LinkTag(
>            new TagData(0,0,"",""),
>            new CompositeTagData(null,null,null),
>            new LinkData("irc://server/channel","","",false,false)
>        );
>
> You'll have to figure out the construtors for the arguments.
> I saw this problem, and for the new lexer package I've added a zero 
> args constrcutor for TagNode.
>
> Derrick
>
> Mark Ault wrote:
>
>> I suspect this is a pretty basic question but I couldn't find 
>> anything in the archives or the doc.
>>
>> I am building a tool used to 'fix up' the html generated by MS Word 
>> with the ultimate destination being a JavaHelp file.  Among other 
>> things, one of the things I want to do is remove the embedded style 
>> sheet and insert a <link> tag to an external style sheet.
>>
>> The approach I am using is to initially parse the document into a 
>> NodeList and then I iterate over the list with a NodeVisitor for each 
>> of the various things I want to do to the document.  This approach 
>> has generally worked great.  I can find the <head> tag using this 
>> technique and then look at the children and remove the embedded style 
>> sheet without a problem.  However, I am have difficulty determining 
>> how to manufacture a <link> tag as a Tag object relatively easily.  
>> If I could do this I could then add it as a child to the head.  
>> Finally, after I have done all of my cleanup I could iterate over all 
>> of the nodes one last time to create the new html.  Any thoughts on 
>> how to generate the <link> tag?
>>
>> Thanks for the help
>
>
>
>
>
>
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>

Re: [personal] Re: [Htmlparser-user] Building New Tags to Output

From: Somik Raha <somik@ya...> - 2003-09-20 06:40

On Fri, 2003-09-19 at 08:15, Mark Ault wrote:
> Thought I would post what I ended up using as my solution.  Both just to 
> document it and to seek if anyone just plain thinks it is a bad idea.
> 
> I found in one of the test cases places where HTML string fragments were 
> defined in the code and then parsed.  So, what I ended up doing is 
> building the link tag that I wanted (looked something like <LINK 
> HREF="/mystylsheet.css" REL="stylesheet" TYPE="text/css"> and then 
> parsing that using the Parser.createParser(String) method.  This just 
> seemed more obvious what what going on than trying to figure out how to 
> construct a tag on your own.  I then find the <LINK> tag and add it as a 
> child to the <HEAD> tag in the document I am modifying.

I have used that approach in the past. I've also built a link tag and it
is a little more painful. Some creation methods could always help..
maybe thats a feature request for the next release..

Regards,
Somik

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-20 12:54

I thought I had posted the result already. Here is the
copy of last message:

Here are part of the output:

linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Cities
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Business_and_Shopping
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Community
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Entertainment_and_Arts
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Health
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/News_and_Media
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Real_Estate
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Recreation_and_Sports
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Travel_and_Transportation
textString=



 

 --- Somik Raha <somik@...> wrote: > Could you
show us the output?
> 
> Regards,
> Somik
> 
> On Thu, 2003-09-18 at 15:14, Xue-Feng Yang wrote:
> > Both getLinkText() and toPlainTextString() give
> the
> > same out in this particular page. 
> > 
> > Here is the test code:
> > 
> > 	public static void main(String[] args) throws
> > Exception{
> > 		String
> >
>
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
> > 		Parser parser = new Parser(destination);
> > 		parser.addScanner(new LinkScanner(""));
> > 		Node [] links =
> > parser.extractAllNodesThatAre(LinkTag.class);
> > 		String linkString=null;
> > 		String textString=null;
> > 		for (int i=0;i<links.length;i++) {
> > 			LinkTag linkTag = (LinkTag)links[i];			
> > 			linkString=linkTag.getLink();
> > 			textString=linkTag.toPlainTextString();
> > 			System.out.println("linkString="+linkString);
> > 			System.out.println("textString="+textString);
> > 		}		
> > 	}
> > 
> > 
> > 
> > 
> >  --- Somik Raha <somik@...> wrote: > did you
> try
> > linkTag.toPlainTextString()?
> > > 
> > > Regards,
> > > Somik
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Thursday, September 18, 2003 3:01 PM
> > > Subject: Re: [general] [Htmlparser-user] More
> > > details
> > > 
> > > 
> > > > You are right. It is not the problem of tables
> and
> > > > lists. The link is there, but not complete.
> > > > 
> > > > Some of the links are coded as
> > > > <a href="http://domain.com"><b>Name</b></a>
> > > > 
> > > > So the text of the link is missing since
> "Name" is
> > > in
> > > > the tag b. My code only count the link with
> text.
> > > That
> > > > is the reason some links were missing.
> > > > 
> > > > Is there a way I can find the text in links
> even
> > > if
> > > > the text is under some decoration tag?
> > > > 
> > > > Thank you very much,
> > > > 
> > > > Xue-Feng
> > > > 
> > > >  --- Somik Raha <somik@...> wrote: > Can
> you
> > > > give a better report - specifying:
> > > > > 1. relevant html segment
> > > > > 2. what objects you end up with, and what
> you
> > > were
> > > > > expecting
> > > > > 3. if possible, a failing testcase
> demonstrating
> > > > > this scenario
> > > > > 
> > > > > Regards, 
> > > > > Somik
> > > > > 
> > > > > ----- Original Message ----- 
> > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > To: <htmlparser-user@...>
> > > > > Sent: Thursday, September 18, 2003 9:09 AM
> > > > > Subject: Re: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > 
> > > > > 
> > > > > > I didn't use registerScanners().
> > > > > > 
> > > > > > Attached is part of the code:
> > > > > > 
> > > > > > Parser parser = new Parser(destination);
> > > > > > parser.addScanner(new LinkScanner(""));
> > > > > > Node [] links =
> > > > > >
> parser.extractAllNodesThatAre(LinkTag.class);
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > >  --- Somik Raha <somik@...> wrote: >
> > > They're
> > > > > not
> > > > > > missing, they're in the table tag. Don't
> > > > > > > use registerScanners().
> > > > > > > Instead, register only the link scanner.
> > > > > > > 
> > > > > > > Regards,
> > > > > > > Somik
> > > > > > > ----- Original Message ----- 
> > > > > > > From: "Xue-Feng Yang"
> <just4look@...>
> > > > > > > To:
> <htmlparser-user@...>
> > > > > > > Sent: Wednesday, September 17, 2003 7:51
> PM
> > > > > > > Subject: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > > > 
> > > > > > > 
> > > > > > > > It looks all links in the unordered
> list
> > > are
> > > > > > > missing,
> > > > > > > > where the unordered list is in a
> table.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > > > > > Post your free ad now!
> > > > > http://personals.yahoo.ca
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > > This sf.net email is sponsored
> > > by:ThinkGeek
> > > > > > > > Welcome to geek heaven.
> > > > > > > > http://thinkgeek.com/sf
> > > > > > > >
> > > > >
> _______________________________________________
> > > > > > > > Htmlparser-user mailing list
> > > > > > > > Htmlparser-user@...
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > > > >
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > This sf.net email is sponsored
> by:ThinkGeek
> > > > > > > Welcome to geek heaven.
> > > > > > > http://thinkgeek.com/sf
> > > > > > >
> > > _______________________________________________
> > > > > > > Htmlparser-user mailing list
> > > > > > > Htmlparser-user@...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > 
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-20 13:07

Here is the complete output:

linkString=http://rd.yahoo.com/M=224039.2014232.4456209.1912363/D=yahoo_dir/S=162828:HEAD/A=1522568/R=0/SIG=10mivm4qu/*http://dir.yahoo.com
textString=
linkString=http://us.rd.yahoo.com/dir/yahoo/*http://dir.yahoo.com
textString=Directory Home
linkString=http://us.rd.yahoo.com/dir/yahoo/*http://www.yahoo.com
textString=Yahoo!
linkString=http://us.rd.yahoo.com/dir/help/*http://help.yahoo.com/help/us/dir
textString=Help
linkString=http://rd.yahoo.com/M=244522.3707905.4968085.264/D=yahoo_dir/S=15434867:N/A=1716362/R=0/SIG=124no4dng/*http://ashnin.com/clk/muryutaitakenattogyo?YH=3707905&yhad=1716362
textString=
linkString=http://dir.yahoo.com
textString=Directory
linkString=http://dir.yahoo.com/Regional/
textString=Regional
linkString=http://dir.yahoo.com/Regional/Countries/
textString=Countries
linkString=http://dir.yahoo.com/Regional/Countries/Canada/
textString=Canada
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/
textString=Provinces and Territories
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/
textString=British Columbia
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/
textString=Regional Districts
linkString=PBopenWindow()
textString=
linkString=http://search.yahoo.com/dir/advanced
textString=Advanced Search
linkString=http://us.rd.yahoo.com/dir/suggest/*http://add.yahoo.com/fast/add?15434867
textString=Suggest a Site
linkString=http://us.rd.yahoo.com/dir/email/*http://mtf.news.yahoo.com/mailto?url=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/&title=+Regional+>+Countries+>+Canada+>+Provinces+and+Territories+>+British+Columbia+>+Regional+Districts+>+Alberni-Clayoquot&rf=f&prop=dir
textString=email this category to a friend
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Cities
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Business_and_Shopping
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Community
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Entertainment_and_Arts
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Health
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/News_and_Media
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Real_Estate
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Recreation_and_Sports
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/Travel_and_Transportation
textString=
linkString=http://us.rd.yahoo.com/diriy/?http://ca.finance.yahoo.com/
textString=Y! Canada Finance
linkString=http://us.rd.yahoo.com/diriy/?http://ca.greetings.yahoo.com/
textString=Y! Canada Greetings
linkString=http://us.rd.yahoo.com/diriy/?http://ca.shopping.yahoo.com/
textString=Y! Canada Shopping
linkString=http://us.rd.yahoo.com/diriy/?http://ca.weather.yahoo.com/
textString=Y! Canada Weather
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=162828:FOOT/A=1026011/R=0/SIG=11eak3640/*http://privacy.yahoo.com/privacy/us/ysearch/
textString=Privacy Policy
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=162828:FOOT/A=1026011/R=1/SIG=1136qnvkg/*http://docs.yahoo.com/info/terms/
textString=Terms of Service
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=162828:FOOT/A=1026011/R=2/SIG=11lp7krrc/*http://docs.yahoo.com/info/copyright/copyright.html
textString=Copyright Policy

 --- Somik Raha <somik@...> wrote: > Could you
show us the output?
> 
> Regards,
> Somik
> 
> On Thu, 2003-09-18 at 15:14, Xue-Feng Yang wrote:
> > Both getLinkText() and toPlainTextString() give
> the
> > same out in this particular page. 
> > 
> > Here is the test code:
> > 
> > 	public static void main(String[] args) throws
> > Exception{
> > 		String
> >
>
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
> > 		Parser parser = new Parser(destination);
> > 		parser.addScanner(new LinkScanner(""));
> > 		Node [] links =
> > parser.extractAllNodesThatAre(LinkTag.class);
> > 		String linkString=null;
> > 		String textString=null;
> > 		for (int i=0;i<links.length;i++) {
> > 			LinkTag linkTag = (LinkTag)links[i];			
> > 			linkString=linkTag.getLink();
> > 			textString=linkTag.toPlainTextString();
> > 			System.out.println("linkString="+linkString);
> > 			System.out.println("textString="+textString);
> > 		}		
> > 	}
> > 
> > 
> > 
> > 
> >  --- Somik Raha <somik@...> wrote: > did you
> try
> > linkTag.toPlainTextString()?
> > > 
> > > Regards,
> > > Somik
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Thursday, September 18, 2003 3:01 PM
> > > Subject: Re: [general] [Htmlparser-user] More
> > > details
> > > 
> > > 
> > > > You are right. It is not the problem of tables
> and
> > > > lists. The link is there, but not complete.
> > > > 
> > > > Some of the links are coded as
> > > > <a href="http://domain.com"><b>Name</b></a>
> > > > 
> > > > So the text of the link is missing since
> "Name" is
> > > in
> > > > the tag b. My code only count the link with
> text.
> > > That
> > > > is the reason some links were missing.
> > > > 
> > > > Is there a way I can find the text in links
> even
> > > if
> > > > the text is under some decoration tag?
> > > > 
> > > > Thank you very much,
> > > > 
> > > > Xue-Feng
> > > > 
> > > >  --- Somik Raha <somik@...> wrote: > Can
> you
> > > > give a better report - specifying:
> > > > > 1. relevant html segment
> > > > > 2. what objects you end up with, and what
> you
> > > were
> > > > > expecting
> > > > > 3. if possible, a failing testcase
> demonstrating
> > > > > this scenario
> > > > > 
> > > > > Regards, 
> > > > > Somik
> > > > > 
> > > > > ----- Original Message ----- 
> > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > To: <htmlparser-user@...>
> > > > > Sent: Thursday, September 18, 2003 9:09 AM
> > > > > Subject: Re: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > 
> > > > > 
> > > > > > I didn't use registerScanners().
> > > > > > 
> > > > > > Attached is part of the code:
> > > > > > 
> > > > > > Parser parser = new Parser(destination);
> > > > > > parser.addScanner(new LinkScanner(""));
> > > > > > Node [] links =
> > > > > >
> parser.extractAllNodesThatAre(LinkTag.class);
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > >  --- Somik Raha <somik@...> wrote: >
> > > They're
> > > > > not
> > > > > > missing, they're in the table tag. Don't
> > > > > > > use registerScanners().
> > > > > > > Instead, register only the link scanner.
> > > > > > > 
> > > > > > > Regards,
> > > > > > > Somik
> > > > > > > ----- Original Message ----- 
> > > > > > > From: "Xue-Feng Yang"
> <just4look@...>
> > > > > > > To:
> <htmlparser-user@...>
> > > > > > > Sent: Wednesday, September 17, 2003 7:51
> PM
> > > > > > > Subject: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > > > 
> > > > > > > 
> > > > > > > > It looks all links in the unordered
> list
> > > are
> > > > > > > missing,
> > > > > > > > where the unordered list is in a
> table.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > > > > > Post your free ad now!
> > > > > http://personals.yahoo.ca
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > > This sf.net email is sponsored
> > > by:ThinkGeek
> > > > > > > > Welcome to geek heaven.
> > > > > > > > http://thinkgeek.com/sf
> > > > > > > >
> > > > >
> _______________________________________________
> > > > > > > > Htmlparser-user mailing list
> > > > > > > > Htmlparser-user@...
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > > > >
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > This sf.net email is sponsored
> by:ThinkGeek
> > > > > > > Welcome to geek heaven.
> > > > > > > http://thinkgeek.com/sf
> > > > > > >
> > > _______________________________________________
> > > > > > > Htmlparser-user mailing list
> > > > > > > Htmlparser-user@...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > 
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-24 05:30

On Sat, 2003-09-20 at 06:07, Xue-Feng Yang wrote:
> Here is the complete output:
> 
> linkString=http://rd.yahoo.com/M=224039.2014232.4456209.1912363/D=yahoo_dir/S=162828:HEAD/A=1522568/R=0/SIG=10mivm4qu/*http://dir.yahoo.com
> textString=

The links that I find on this page seem to be of the form:
<a href="..."><img ...></a>

This is not a bug - there is no equivalent text. Add this print
statement to your loop - System.out.println(linkTag.toHtml());

Look at the contents of the html. Can you find any tag that has text
content in the html but does not get picked up?

Bytway, by failing test, I had meant a failing junit testcase
(http://www.junit.org). Its easy to write, just take a look at some of
the tests in LinkScannerTest (org.htmlparser.tests.scannersTests)

Regards,
Somik

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-25 22:01

Hi Somik,

Have you ever seen my output post? I posted three
times.

I think I found more errors from the parser. The
parser actually returns wrong links.

Xue-Feng

 --- Somik Raha <somik@...> wrote: > Could you
show us the output?
> 
> Regards,
> Somik
> 
> On Thu, 2003-09-18 at 15:14, Xue-Feng Yang wrote:
> > Both getLinkText() and toPlainTextString() give
> the
> > same out in this particular page. 
> > 
> > Here is the test code:
> > 
> > 	public static void main(String[] args) throws
> > Exception{
> > 		String
> >
>
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
> > 		Parser parser = new Parser(destination);
> > 		parser.addScanner(new LinkScanner(""));
> > 		Node [] links =
> > parser.extractAllNodesThatAre(LinkTag.class);
> > 		String linkString=null;
> > 		String textString=null;
> > 		for (int i=0;i<links.length;i++) {
> > 			LinkTag linkTag = (LinkTag)links[i];			
> > 			linkString=linkTag.getLink();
> > 			textString=linkTag.toPlainTextString();
> > 			System.out.println("linkString="+linkString);
> > 			System.out.println("textString="+textString);
> > 		}		
> > 	}
> > 
> > 
> > 
> > 
> >  --- Somik Raha <somik@...> wrote: > did you
> try
> > linkTag.toPlainTextString()?
> > > 
> > > Regards,
> > > Somik
> > > ----- Original Message ----- 
> > > From: "Xue-Feng Yang" <just4look@...>
> > > To: <htmlparser-user@...>
> > > Sent: Thursday, September 18, 2003 3:01 PM
> > > Subject: Re: [general] [Htmlparser-user] More
> > > details
> > > 
> > > 
> > > > You are right. It is not the problem of tables
> and
> > > > lists. The link is there, but not complete.
> > > > 
> > > > Some of the links are coded as
> > > > <a href="http://domain.com"><b>Name</b></a>
> > > > 
> > > > So the text of the link is missing since
> "Name" is
> > > in
> > > > the tag b. My code only count the link with
> text.
> > > That
> > > > is the reason some links were missing.
> > > > 
> > > > Is there a way I can find the text in links
> even
> > > if
> > > > the text is under some decoration tag?
> > > > 
> > > > Thank you very much,
> > > > 
> > > > Xue-Feng
> > > > 
> > > >  --- Somik Raha <somik@...> wrote: > Can
> you
> > > > give a better report - specifying:
> > > > > 1. relevant html segment
> > > > > 2. what objects you end up with, and what
> you
> > > were
> > > > > expecting
> > > > > 3. if possible, a failing testcase
> demonstrating
> > > > > this scenario
> > > > > 
> > > > > Regards, 
> > > > > Somik
> > > > > 
> > > > > ----- Original Message ----- 
> > > > > From: "Xue-Feng Yang" <just4look@...>
> > > > > To: <htmlparser-user@...>
> > > > > Sent: Thursday, September 18, 2003 9:09 AM
> > > > > Subject: Re: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > 
> > > > > 
> > > > > > I didn't use registerScanners().
> > > > > > 
> > > > > > Attached is part of the code:
> > > > > > 
> > > > > > Parser parser = new Parser(destination);
> > > > > > parser.addScanner(new LinkScanner(""));
> > > > > > Node [] links =
> > > > > >
> parser.extractAllNodesThatAre(LinkTag.class);
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > >  --- Somik Raha <somik@...> wrote: >
> > > They're
> > > > > not
> > > > > > missing, they're in the table tag. Don't
> > > > > > > use registerScanners().
> > > > > > > Instead, register only the link scanner.
> > > > > > > 
> > > > > > > Regards,
> > > > > > > Somik
> > > > > > > ----- Original Message ----- 
> > > > > > > From: "Xue-Feng Yang"
> <just4look@...>
> > > > > > > To:
> <htmlparser-user@...>
> > > > > > > Sent: Wednesday, September 17, 2003 7:51
> PM
> > > > > > > Subject: [general] [Htmlparser-user]
> More
> > > > > details
> > > > > > > 
> > > > > > > 
> > > > > > > > It looks all links in the unordered
> list
> > > are
> > > > > > > missing,
> > > > > > > > where the unordered list is in a
> table.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
______________________________________________________________________
> > > > > > > > Post your free ad now!
> > > > > http://personals.yahoo.ca
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > > This sf.net email is sponsored
> > > by:ThinkGeek
> > > > > > > > Welcome to geek heaven.
> > > > > > > > http://thinkgeek.com/sf
> > > > > > > >
> > > > >
> _______________________________________________
> > > > > > > > Htmlparser-user mailing list
> > > > > > > > Htmlparser-user@...
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > > > >
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
-------------------------------------------------------
> > > > > > > This sf.net email is sponsored
> by:ThinkGeek
> > > > > > > Welcome to geek heaven.
> > > > > > > http://thinkgeek.com/sf
> > > > > > >
> > > _______________________________________________
> > > > > > > Htmlparser-user mailing list
> > > > > > > Htmlparser-user@...
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> > > > > 
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-27 02:56

--- Xue-Feng Yang <just4look@...> wrote:
> Have you ever seen my output post? I posted three
> times.
> 
> I think I found more errors from the parser. The
> parser actually returns wrong links.

I replied to your mail (dated 2003-09-23).. checked
the program, and couldn't find issues. Maybe you could
narrow down to one snippet of html - of just the tags
that are coming out wrong. That way we'd be able to
replicate the bug.

Here's a suggestion, create the parser on html
directly, like so:

Parser parser = Parser.createParser("<a
href="...">...</a>);
// proceed to parse links.

This could be a useful testcase to demonstrate the
bug. If you can make this a JUnit testcase that fails,
that would be even better - a developer could then
easily jump in and debug.

I must thank you for taking the time to report the
bug. Design of good software is a highly participatory
process, and the users of the software are an
important part of the Project Community. Your
participation is highly appreciated.

Regards,
Somik

__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-27 05:19

I had made a small parser to replace Htmlparser for
our program. I would like to replace back Htmlparser
in future. However, I am not so hurry on this now.

You said 
> I replied to your mail (dated 2003-09-23).. checked
> the program, and couldn't find issues.

I am not clear what you mean "couldn't find issues".
Do you mean that you cannot run my program to find the
problem? or you can run my program and find the
problem but couldn't locate the issue in the
htmlparser code?

On the other hand, I don't know much about the
architecture of htmlparser. It is much easier for me
to write my own parser. So is there someone who can
show me more about htmlparser first?

By the way, in addition to the issue "missing text", I
also found that htmlparser changes the links. Here is
an example: if you run my code, you will see

linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
textString=

However, the link in html is 

Cities/

So it represents

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/

 
Xue-Feng

 --- Somik Raha <somik@...> wrote: > 
> --- Xue-Feng Yang <just4look@...> wrote:
> > Have you ever seen my output post? I posted three
> > times.
> > 
> > I think I found more errors from the parser. The
> > parser actually returns wrong links.
> 
> I replied to your mail (dated 2003-09-23).. checked
> the program, and couldn't find issues. Maybe you
> could
> narrow down to one snippet of html - of just the
> tags
> that are coming out wrong. That way we'd be able to
> replicate the bug.
> 
> Here's a suggestion, create the parser on html
> directly, like so:
> 
> Parser parser = Parser.createParser("<a
> href="...">...</a>);
> // proceed to parse links.
> 
> This could be a useful testcase to demonstrate the
> bug. If you can make this a JUnit testcase that
> fails,
> that would be even better - a developer could then
> easily jump in and debug.
> 
> I must thank you for taking the time to report the
> bug. Design of good software is a highly
> participatory
> process, and the users of the software are an
> important part of the Project Community. Your
> participation is highly appreciated.
> 
> Regards,
> Somik
> 
> __________________________________
> Do you Yahoo!?
> The New Yahoo! Shopping - with improved product
> search
> http://shopping.yahoo.com
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-27 17:52

Hi Xue,

--- Xue-Feng Yang <just4look@...> wrote:
> I had made a small parser to replace Htmlparser for
> our program. I would like to replace back Htmlparser
> in future. However, I am not so hurry on this now.

Sorry about that. I am personally of the opinion that
if a simple text search program works - you should use
it instead of the parser. Go for the parser only when
you will really get business value out of it.

> I am not clear what you mean "couldn't find issues".
> Do you mean that you cannot run my program to find
> the
> problem? or you can run my program and find the
> problem but couldn't locate the issue in the
> htmlparser code?

Neither, but close to the latter. I meant I couldn't
see any problem in the parser. Only if I see a problem
can I proceed to fix it.

> On the other hand, I don't know much about the
> architecture of htmlparser. It is much easier for me
> to write my own parser. So is there someone who can
> show me more about htmlparser first?

I wasn't asking you to delve into the code. Its hard,
and a little crazy.. I was asking you to write a
failing test that involves "using" the parser to do
what you want, and assert that it does it correctly. 
Are you familiar with JUnit? 

The best way to get familiar with the parser is to
look at the docs. Read
http://htmlparser.sourceforge.net/docs/index.php/TestDrivenDevelopment
- writing unit tests is really easy - you should be
able to get started here.

> By the way, in addition to the issue "missing text",
> I also found that htmlparser changes the links. Here
> is an example: if you run my code, you will see
> 
>
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
> textString=
> 
> However, the link in html is 
> 
> Cities/
> 
> So it represents
> 
>
http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/
> 

If you click on the link above, you will find that it
is correct. The parser does append a prefix to each
link - the url from which it was picked up. If you
have a requirement that does not want the prefix to be
added, then that is a functionality change, and needs
to be requested as a feature.

Regards,
Somik

__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-27 18:20

Input is in your message below.


Cheers,

Xue-Feng

 --- Somik Raha <somik@...> wrote: > Hi Xue,
> 
> --- Xue-Feng Yang <just4look@...> wrote:
> > I had made a small parser to replace Htmlparser
> for
> > our program. I would like to replace back
> Htmlparser
> > in future. However, I am not so hurry on this now.
> 
> Sorry about that. I am personally of the opinion
> that
> if a simple text search program works - you should
> use
> it instead of the parser. Go for the parser only
> when
> you will really get business value out of it.

I am an expert on parser and compiler. I wrote pasers
and compilers for commercial purposes. I can build a
htmlparser by myself for sure. However, your open
source htmlparser is on going, why to write a second
one.

More comments below.

> 
> > I am not clear what you mean "couldn't find
> issues".
> > Do you mean that you cannot run my program to find
> > the
> > problem? or you can run my program and find the
> > problem but couldn't locate the issue in the
> > htmlparser code?
> 
> Neither, but close to the latter. I meant I couldn't
> see any problem in the parser. Only if I see a
> problem
> can I proceed to fix it.
> 

So you mean you run my code, and see the print out
correct? Really strange now! 

More comments below.

> > On the other hand, I don't know much about the
> > architecture of htmlparser. It is much easier for
> me
> > to write my own parser. So is there someone who
> can
> > show me more about htmlparser first?
> 
> I wasn't asking you to delve into the code. Its
> hard,
> and a little crazy.. I was asking you to write a
> failing test that involves "using" the parser to do
> what you want, and assert that it does it correctly.
> 
> Are you familiar with JUnit? 
> 

Sure, but why bother it here?

More comments below.

> The best way to get familiar with the parser is to
> look at the docs. Read
>
http://htmlparser.sourceforge.net/docs/index.php/TestDrivenDevelopment
> - writing unit tests is really easy - you should be
> able to get started here.
> 
>  
> > By the way, in addition to the issue "missing
> text",
> > I also found that htmlparser changes the links.
> Here
> > is an example: if you run my code, you will see
> > 
> >
>
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
> > textString=
> > 
> > However, the link in html is 
> > 
> > Cities/
> > 
> > So it represents
> > 
> >
>
http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/
> > 
> 
> If you click on the link above, you will find that
> it
> is correct. The parser does append a prefix to each
> link - the url from which it was picked up. If you
> have a requirement that does not want the prefix to
> be
> added, then that is a functionality change, and
> needs
> to be requested as a feature.

Later one is of course OK. It is corrected by me and
my own parser, but it is not the one returned from
your Htmlparser. Your Htmlparser returns the former
one:

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities

If your computer can reach this one, but not see

Yahoo! - Document Not Found

then your computer must have magic.
 
Comments ended!
> 
> Regards,
> Somik
> 
> __________________________________
> Do you Yahoo!?
> The New Yahoo! Shopping - with improved product
> search
> http://shopping.yahoo.com
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-27 18:36

By the way, it seems to me that you never run the code
I posted here since the output is so clear that your
htmlparser returned so many empty texts. I really
don't believe that your parser is computer dependent.

Xue-Feng 

PS: I post the output and the code here again, so
everyone can try the two problems I posted:

1) return empty text;

2) return a changed and bad link. 

/**********code********************/

	public static void main(String[] args) throws
Exception{
		//String
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Alberni_Clayoquot/";
		String
destination="http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte";
		Parser parser = new Parser(destination);
		parser.addScanner(new LinkScanner(""));
		Node [] links =
parser.extractAllNodesThatAre(LinkTag.class);
		String linkString=null;
		String textString=null;
		for (int i=0;i<links.length;i++) {
			LinkTag linkTag = (LinkTag)links[i];			
			linkString=linkTag.getLink();
		
textString=linkTag.toPlainTextString();//.getLinkText()
			System.out.println("linkString="+linkString);
			System.out.println("textString="+textString);
		}		
	}


/**********output******************/
linkString=http://rd.yahoo.com/M=224039.2014232.4456209.1912363/D=yahoo_dir/S=59737259:HEAD/A=1522568/R=0/SIG=10mivm4qu/*http://dir.yahoo.com
textString=
linkString=http://us.rd.yahoo.com/dir/yahoo/*http://dir.yahoo.com
textString=Directory Home
linkString=http://us.rd.yahoo.com/dir/yahoo/*http://www.yahoo.com
textString=Yahoo!
linkString=http://us.rd.yahoo.com/dir/help/*http://help.yahoo.com/help/us/dir
textString=Help
linkString=http://rd.yahoo.com/M=251812.3856360.5103864.264/D=yahoo_dir/S=15439393:N/A=1754735/R=0/SIG=11tm581qt/*http://www.netflix.com/Default?mqso=60178328&partid=3856360
textString=
linkString=http://dir.yahoo.com
textString=Directory
linkString=http://dir.yahoo.com/Regional/
textString=Regional
linkString=http://dir.yahoo.com/Regional/Countries/
textString=Countries
linkString=http://dir.yahoo.com/Regional/Countries/Canada/
textString=Canada
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/
textString=Provinces and Territories
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/
textString=British Columbia
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/
textString=Regional Districts
linkString=PBopenWindow()
textString=
linkString=http://search.yahoo.com/dir/advanced
textString=Advanced Search
linkString=http://us.rd.yahoo.com/dir/suggest/*http://add.yahoo.com/fast/add?15439393
textString=Suggest a Site
linkString=http://us.rd.yahoo.com/dir/email/*http://mtf.news.yahoo.com/mailto?url=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/&title=+Regional+>+Countries+>+Canada+>+Provinces+and+Territories+>+British+Columbia+>+Regional+Districts+>+Skeena-Queen+Charlotte&rf=f&prop=dir
textString=email this category to a friend
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Islands
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Business_and_Shopping
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Community
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Education
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Entertainment_and_Arts
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/News_and_Media
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Real_Estate
textString=
linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Travel_and_Transportation
textString=
linkString=http://us.rd.yahoo.com/diriy/?http://ca.finance.yahoo.com/
textString=Y! Canada Finance
linkString=http://us.rd.yahoo.com/diriy/?http://ca.greetings.yahoo.com/
textString=Y! Canada Greetings
linkString=http://us.rd.yahoo.com/diriy/?http://ca.shopping.yahoo.com/
textString=Y! Canada Shopping
linkString=http://us.rd.yahoo.com/diriy/?http://ca.weather.yahoo.com/
textString=Y! Canada Weather
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=59737259:FOOT/A=1026011/R=0/SIG=11eak3640/*http://privacy.yahoo.com/privacy/us/ysearch/
textString=Privacy Policy
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=59737259:FOOT/A=1026011/R=1/SIG=1136qnvkg/*http://docs.yahoo.com/info/terms/
textString=Terms of Service
linkString=http://rd.yahoo.com/M=224039.1982747.3464868.1912376/D=yahoo_dir/S=59737259:FOOT/A=1026011/R=2/SIG=11lp7krrc/*http://docs.yahoo.com/info/copyright/copyright.html
textString=Copyright Policy


______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Somik Raha <somik@ya...> - 2003-09-28 02:34

Xue,
--- Xue-Feng Yang <just4look@...> wrote:
> By the way, it seems to me that you never run the
> code
> I posted here since the output is so clear that your
> htmlparser returned so many empty texts. I really
> don't believe that your parser is computer
> dependent.

I did run your program, and I tried it again. I see
your point now. Just so you know, there were a couple
of links which had images and no text. When I saw
those, I thought it was correct behavior not to return
any text (and it is). I didn't have the patience to
try each and every link- the erroneous link is
embedded some way in the output. Sorry about that.

You did mention the the link in question- Cities.

The bug seems to be :
Given a link tag like:
<a href=Cities/><b>Cities</b></a>

the text "Cities" is not returned. 

Unfortunately, I am away from my coding PC for a
while, or I would have written a junit failing test
and sent it to the developers. The reason I suggested
you write a test is explained in the article I sent
earlier. Bug reporting is hardly technical - it is
about communication. 

And precise communication is hard when two people have
different contexts (which they always do). The fault
is mine for not taking the time to try your report
thoroughly, but with a junit test, no explanation (and
frustration on your end) would have been necessary.

Of course, you need not buy into what I'm saying, and
thats fine. Thanks for reporting the bug.

Regards,
Somik

__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-28 02:49

Thanks for your reply. Actually, I repect the open
source people, like you. I also hope Htmlparser
becomes a good open source. 

Xue-Feng

PS:

One more comment below.


 --- Somik Raha <somik@...> wrote: > Xue,
> --- Xue-Feng Yang <just4look@...> wrote:
> > By the way, it seems to me that you never run the
> > code
> > I posted here since the output is so clear that
> your
> > htmlparser returned so many empty texts. I really
> > don't believe that your parser is computer
> > dependent.
> 
> I did run your program, and I tried it again. I see
> your point now. Just so you know, there were a
> couple
> of links which had images and no text. When I saw
> those, I thought it was correct behavior not to
> return
> any text (and it is). I didn't have the patience to
> try each and every link- the erroneous link is
> embedded some way in the output. Sorry about that.
> 
> You did mention the the link in question- Cities.
> 
> The bug seems to be :
> Given a link tag like:
> <a href=Cities/><b>Cities</b></a>
> 
> the text "Cities" is not returned. 
> 

Not only the text is not returned, but also the
returned link is not correct as I mentioned in the
other message. 


> Unfortunately, I am away from my coding PC for a
> while, or I would have written a junit failing test
> and sent it to the developers. The reason I
> suggested
> you write a test is explained in the article I sent
> earlier. Bug reporting is hardly technical - it is
> about communication. 
> 
> And precise communication is hard when two people
> have
> different contexts (which they always do). The fault
> is mine for not taking the time to try your report
> thoroughly, but with a junit test, no explanation
> (and
> frustration on your end) would have been necessary.
> 
> Of course, you need not buy into what I'm saying,
> and
> thats fine. Thanks for reporting the bug.
> 
> Regards,
> Somik
> 
> __________________________________
> Do you Yahoo!?
> The New Yahoo! Shopping - with improved product
> search
> http://shopping.yahoo.com
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Derrick Oswald <DerrickOswald@Ro...> - 2003-09-29 10:53

Xue-Feng,

The URL 'error' you mention is actually just the way the Java URL class 
works. Without a terminating slash, the document base URL is assumed to 
be a resource, which is correctly removed by the algorithm. Here's an 
example:

import java.io.IOException;
import java.net.URL;

public class UrlProblem
{
    public static void main (String[] args) throws IOException
    {
        URL docbase;
        URL relative;
       
        docbase = new URL ("http://cbc.ca/business");
        relative = new URL (docbase, "quotes.html");
        System.out.println (relative.toExternalForm ());
        docbase = new URL ("http://cbc.ca/business/");
        relative = new URL (docbase, "quotes.html");
        System.out.println (relative.toExternalForm ());
// output:
//    http://cbc.ca/quotes.html
//    http://cbc.ca/business/quotes.html
    }
}

This is why most URL's that reference the default document (usually 
index.html), end in a slash.

Derrick

Xue-Feng Yang wrote:

>Input is in your message below.
>
>
>Cheers,
>
>Xue-Feng
>
> --- Somik Raha <somik@...> wrote: > Hi Xue,
>  
>
>>--- Xue-Feng Yang <just4look@...> wrote:
>>    
>>
>>>I had made a small parser to replace Htmlparser
>>>      
>>>
>>for
>>    
>>
>>>our program. I would like to replace back
>>>      
>>>
>>Htmlparser
>>    
>>
>>>in future. However, I am not so hurry on this now.
>>>      
>>>
>>Sorry about that. I am personally of the opinion
>>that
>>if a simple text search program works - you should
>>use
>>it instead of the parser. Go for the parser only
>>when
>>you will really get business value out of it.
>>    
>>
>
>I am an expert on parser and compiler. I wrote pasers
>and compilers for commercial purposes. I can build a
>htmlparser by myself for sure. However, your open
>source htmlparser is on going, why to write a second
>one.
>
>More comments below.
>
>  
>
>>>I am not clear what you mean "couldn't find
>>>      
>>>
>>issues".
>>    
>>
>>>Do you mean that you cannot run my program to find
>>>the
>>>problem? or you can run my program and find the
>>>problem but couldn't locate the issue in the
>>>htmlparser code?
>>>      
>>>
>>Neither, but close to the latter. I meant I couldn't
>>see any problem in the parser. Only if I see a
>>problem
>>can I proceed to fix it.
>>
>>    
>>
>
>So you mean you run my code, and see the print out
>correct? Really strange now! 
>
>More comments below.
>
>  
>
>>>On the other hand, I don't know much about the
>>>architecture of htmlparser. It is much easier for
>>>      
>>>
>>me
>>    
>>
>>>to write my own parser. So is there someone who
>>>      
>>>
>>can
>>    
>>
>>>show me more about htmlparser first?
>>>      
>>>
>>I wasn't asking you to delve into the code. Its
>>hard,
>>and a little crazy.. I was asking you to write a
>>failing test that involves "using" the parser to do
>>what you want, and assert that it does it correctly.
>>
>>Are you familiar with JUnit? 
>>
>>    
>>
>
>Sure, but why bother it here?
>
>More comments below.
>
>  
>
>>The best way to get familiar with the parser is to
>>look at the docs. Read
>>
>>    
>>
>http://htmlparser.sourceforge.net/docs/index.php/TestDrivenDevelopment
>  
>
>>- writing unit tests is really easy - you should be
>>able to get started here.
>>
>> 
>>    
>>
>>>By the way, in addition to the issue "missing
>>>      
>>>
>>text",
>>    
>>
>>>I also found that htmlparser changes the links.
>>>      
>>>
>>Here
>>    
>>
>>>is an example: if you run my code, you will see
>>>
>>>
>>>      
>>>
>linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
>  
>
>>>textString=
>>>
>>>However, the link in html is 
>>>
>>>Cities/
>>>
>>>So it represents
>>>
>>>
>>>      
>>>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/
>  
>
>>If you click on the link above, you will find that
>>it
>>is correct. The parser does append a prefix to each
>>link - the url from which it was picked up. If you
>>have a requirement that does not want the prefix to
>>be
>>added, then that is a functionality change, and
>>needs
>>to be requested as a feature.
>>    
>>
>
>Later one is of course OK. It is corrected by me and
>my own parser, but it is not the one returned from
>your Htmlparser. Your Htmlparser returns the former
>one:
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
>
>If your computer can reach this one, but not see
>
>Yahoo! - Document Not Found
>
>then your computer must have magic.
> 
>Comments ended!
>  
>

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-29 16:11

Thanks for your comment. You must have some typo there
since I cannot see how you get the different outputs
with the same code. However, I can guess what you
mean(?).

If I understand correctly, at least in both IE and
Netscape, we have

docbase plus
quotes.html==>http://cbc.ca/business/quotes.html

docbase plus /quotes.html==>http://cbc.ca/quotes.html

So it is not necessary to make such methods as you
mentioned. All should be determined in the
implementation, and users don't have to worry about. 

Seem to me is that the problem I met in htmlparser is
not this problem. It is more complicated. Let me
specify the problem a bit more here:

Let
docbase="http://cbc.ca/business1/business2/.../businessn/".

If n is big, then in htmlparser it has

docbase plus
quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html

The "/businessn" is missing. However, for small n, the
parser works properly. 

This is very strang. I believe that it is a bug.


Xue-Feng

 --- Derrick Oswald <DerrickOswald@...> wrote:
> Xue-Feng,
> 
> The URL 'error' you mention is actually just the way
> the Java URL class 
> works. Without a terminating slash, the document
> base URL is assumed to 
> be a resource, which is correctly removed by the
> algorithm. Here's an 
> example:
> 
> import java.io.IOException;
> import java.net.URL;
> 
> public class UrlProblem
> {
>     public static void main (String[] args) throws
> IOException
>     {
>         URL docbase;
>         URL relative;
>        
>         docbase = new URL
> ("http://cbc.ca/business");
>         relative = new URL (docbase, "quotes.html");
>         System.out.println (relative.toExternalForm
> ());
>         docbase = new URL
> ("http://cbc.ca/business/");
>         relative = new URL (docbase, "quotes.html");
>         System.out.println (relative.toExternalForm
> ());
> // output:
> //    http://cbc.ca/quotes.html
> //    http://cbc.ca/business/quotes.html
>     }
> }
> 
> This is why most URL's that reference the default
> document (usually 
> index.html), end in a slash.
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >Input is in your message below.
> >
> >
> >Cheers,
> >
> >Xue-Feng
> >
> > --- Somik Raha <somik@...> wrote: > Hi Xue,
> >  
> >
> >>--- Xue-Feng Yang <just4look@...> wrote:
> >>    
> >>
> >>>I had made a small parser to replace Htmlparser
> >>>      
> >>>
> >>for
> >>    
> >>
> >>>our program. I would like to replace back
> >>>      
> >>>
> >>Htmlparser
> >>    
> >>
> >>>in future. However, I am not so hurry on this
> now.
> >>>      
> >>>
> >>Sorry about that. I am personally of the opinion
> >>that
> >>if a simple text search program works - you should
> >>use
> >>it instead of the parser. Go for the parser only
> >>when
> >>you will really get business value out of it.
> >>    
> >>
> >
> >I am an expert on parser and compiler. I wrote
> pasers
> >and compilers for commercial purposes. I can build
> a
> >htmlparser by myself for sure. However, your open
> >source htmlparser is on going, why to write a
> second
> >one.
> >
> >More comments below.
> >
> >  
> >
> >>>I am not clear what you mean "couldn't find
> >>>      
> >>>
> >>issues".
> >>    
> >>
> >>>Do you mean that you cannot run my program to
> find
> >>>the
> >>>problem? or you can run my program and find the
> >>>problem but couldn't locate the issue in the
> >>>htmlparser code?
> >>>      
> >>>
> >>Neither, but close to the latter. I meant I
> couldn't
> >>see any problem in the parser. Only if I see a
> >>problem
> >>can I proceed to fix it.
> >>
> >>    
> >>
> >
> >So you mean you run my code, and see the print out
> >correct? Really strange now! 
> >
> >More comments below.
> >
> >  
> >
> >>>On the other hand, I don't know much about the
> >>>architecture of htmlparser. It is much easier for
> >>>      
> >>>
> >>me
> >>    
> >>
> >>>to write my own parser. So is there someone who
> >>>      
> >>>
> >>can
> >>    
> >>
> >>>show me more about htmlparser first?
> >>>      
> >>>
> >>I wasn't asking you to delve into the code. Its
> >>hard,
> >>and a little crazy.. I was asking you to write a
> >>failing test that involves "using" the parser to
> do
> >>what you want, and assert that it does it
> correctly.
> >>
> >>Are you familiar with JUnit? 
> >>
> >>    
> >>
> >
> >Sure, but why bother it here?
> >
> >More comments below.
> >
> >  
> >
> >>The best way to get familiar with the parser is to
> >>look at the docs. Read
> >>
> >>    
> >>
>
>http://htmlparser.sourceforge.net/docs/index.php/TestDrivenDevelopment
> >  
> >
> >>- writing unit tests is really easy - you should
> be
> >>able to get started here.
> >>
> >> 
> >>    
> >>
> >>>By the way, in addition to the issue "missing
> >>>      
> >>>
> >>text",
> >>    
> >>
> >>>I also found that htmlparser changes the links.
> >>>      
> >>>
> >>Here
> >>    
> >>
> >>>is an example: if you run my code, you will see
> >>>
> >>>
> >>>      
> >>>
>
>linkString=http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
> >  
> >
> >>>textString=
> >>>
> >>>However, the link in html is 
> >>>
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-29 19:14

I see the difference. No typo is in your post. So I
add a more comment here.

Both "http://cbc.ca/business/" and
"http://cbc.ca/business" have the same meaning for
directory, at least in both IE and Nescape. So both
can be the docbase in my last message.

Xue-Feng

 --- Xue-Feng Yang <just4look@...> wrote: >
Thanks for your comment. You must have some typo
> there
> since I cannot see how you get the different outputs
> with the same code. However, I can guess what you
> mean(?).
> 
> If I understand correctly, at least in both IE and
> Netscape, we have
> 
> docbase plus
> quotes.html==>http://cbc.ca/business/quotes.html
> 
> docbase plus
> /quotes.html==>http://cbc.ca/quotes.html
> 
> So it is not necessary to make such methods as you
> mentioned. All should be determined in the
> implementation, and users don't have to worry about.
> 
> 
> Seem to me is that the problem I met in htmlparser
> is
> not this problem. It is more complicated. Let me
> specify the problem a bit more here:
> 
> Let
>
docbase="http://cbc.ca/business1/business2/.../businessn/".
> 
> If n is big, then in htmlparser it has
> 
> docbase plus
>
quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
> 
> The "/businessn" is missing. However, for small n,
> the
> parser works properly. 
> 
> This is very strang. I believe that it is a bug.
> 
> 
> Xue-Feng
> 
>  --- Derrick Oswald <DerrickOswald@...>
> wrote:
> > Xue-Feng,
> > 
> > The URL 'error' you mention is actually just the
> way
> > the Java URL class 
> > works. Without a terminating slash, the document
> > base URL is assumed to 
> > be a resource, which is correctly removed by the
> > algorithm. Here's an 
> > example:
> > 
> > import java.io.IOException;
> > import java.net.URL;
> > 
> > public class UrlProblem
> > {
> >     public static void main (String[] args) throws
> > IOException
> >     {
> >         URL docbase;
> >         URL relative;
> >        
> >         docbase = new URL
> > ("http://cbc.ca/business");
> >         relative = new URL (docbase,
> "quotes.html");
> >         System.out.println
> (relative.toExternalForm
> > ());
> >         docbase = new URL
> > ("http://cbc.ca/business/");
> >         relative = new URL (docbase,
> "quotes.html");
> >         System.out.println
> (relative.toExternalForm
> > ());
> > // output:
> > //    http://cbc.ca/quotes.html
> > //    http://cbc.ca/business/quotes.html
> >     }
> > }
> > 
> > This is why most URL's that reference the default
> > document (usually 
> > index.html), end in a slash.
> > 
> > Derrick
> > 
> > Xue-Feng Yang wrote:
> > 
> > >Input is in your message below.
> > >
> > >
> > >Cheers,
> > >
> > >Xue-Feng
> > >
> > > --- Somik Raha <somik@...> wrote: > Hi
> Xue,
> > >  
> > >
> > >>--- Xue-Feng Yang <just4look@...> wrote:
> > >>    
> > >>
> > >>>I had made a small parser to replace Htmlparser
> > >>>      
> > >>>
> > >>for
> > >>    
> > >>
> > >>>our program. I would like to replace back
> > >>>      
> > >>>
> > >>Htmlparser
> > >>    
> > >>
> > >>>in future. However, I am not so hurry on this
> > now.
> > >>>      
> > >>>
> > >>Sorry about that. I am personally of the opinion
> > >>that
> > >>if a simple text search program works - you
> should
> > >>use
> > >>it instead of the parser. Go for the parser only
> > >>when
> > >>you will really get business value out of it.
> > >>    
> > >>
> > >
> > >I am an expert on parser and compiler. I wrote
> > pasers
> > >and compilers for commercial purposes. I can
> build
> > a
> > >htmlparser by myself for sure. However, your open
> > >source htmlparser is on going, why to write a
> > second
> > >one.
> > >
> > >More comments below.
> > >
> > >  
> > >
> > >>>I am not clear what you mean "couldn't find
> > >>>      
> > >>>
> > >>issues".
> > >>    
> > >>
> > >>>Do you mean that you cannot run my program to
> > find
> > >>>the
> > >>>problem? or you can run my program and find the
> > >>>problem but couldn't locate the issue in the
> > >>>htmlparser code?
> > >>>      
> > >>>
> > >>Neither, but close to the latter. I meant I
> > couldn't
> > >>see any problem in the parser. Only if I see a
> > >>problem
> > >>can I proceed to fix it.
> > >>
> > >>    
> > >>
> > >
> > >So you mean you run my code, and see the print
> out
> > >correct? Really strange now! 
> > >
> > >More comments below.
> > >
> > >  
> > >
> > >>>On the other hand, I don't know much about the
> > >>>architecture of htmlparser. It is much easier
> for
> > >>>      
> > >>>
> > >>me
> > >>    
> > >>
> > >>>to write my own parser. So is there someone who
> > >>>      
> > >>>
> > >>can
> > >>    
> > >>
> > >>>show me more about htmlparser first?
> > >>>      
> > >>>
> > >>I wasn't asking you to delve into the code. Its
> > >>hard,
> > >>and a little crazy.. I was asking you to write a
> > >>failing test that involves "using" the parser to
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Derrick Oswald <DerrickOswald@Ro...> - 2003-09-29 22:38

Xue-Feng,

They may resolve to the same document in any browser, but the server is 
performing the conversion, usually by adding index.html, even if it 
doesn't indicate it.

Try this little experiment:

Type http://www.cbc.ca/index.html  into your browser.  It works. Why? 
because the server converts both http://www.cbc.ca  and 
http://www.cbc.ca/  into the same reference, namely 
http://www.cbc.ca/index.html  which it then sends to your browser.  If 
you think it would accept anything, try typing 
http://www.cbc.ca/bogus.html - it won't work.

Now type http://www.cbc.ca/business/index.html  into your browser.  It 
doesn't work.  Why? Because the http://www.cbc.ca/business or 
http://www.cbc.ca/business/  does not get converted into that, but 
instead reference an unknown page, maybe even a jsp page or whatever.

On the client side, we cannot know that http://www.cbc.ca/business 
really refers to http://www.cbc.ca/business/local_cbc_portal.jsp  or 
whatever.   It must be assumed that the last element, unless it ends 
with a slash, is the file name and hence it must be removed to resolve 
relative references.

This is the correct behaviour.  It is not a bug.  Check out the unit 
tests in utilTests.HTMLLinkProcessorTest and it's reference documentation:

    //
    // Tests from Appendix C Examples of Resolving Relative URI References
    // RFC 2396 Uniform Resource Identifiers (URI): Generic Syntax
    // T. Berners-Lee et al.
    // http://www.ietf.org/rfc/rfc2396.txt

Derrick

Xue-Feng Yang wrote:

>I see the difference. No typo is in your post. So I
>add a more comment here.
>
>Both "http://cbc.ca/business/" and
>"http://cbc.ca/business" have the same meaning for
>directory, at least in both IE and Nescape. So both
>can be the docbase in my last message.
>
>Xue-Feng
>
> --- Xue-Feng Yang <just4look@...> wrote: >
>Thanks for your comment. You must have some typo
>  
>
>>there
>>since I cannot see how you get the different outputs
>>with the same code. However, I can guess what you
>>mean(?).
>>
>>If I understand correctly, at least in both IE and
>>Netscape, we have
>>
>>docbase plus
>>quotes.html==>http://cbc.ca/business/quotes.html
>>
>>docbase plus
>>/quotes.html==>http://cbc.ca/quotes.html
>>
>>So it is not necessary to make such methods as you
>>mentioned. All should be determined in the
>>implementation, and users don't have to worry about.
>>
>>
>>Seem to me is that the problem I met in htmlparser
>>is
>>not this problem. It is more complicated. Let me
>>specify the problem a bit more here:
>>
>>Let
>>
>>    
>>
>docbase="http://cbc.ca/business1/business2/.../businessn/".
>  
>
>>If n is big, then in htmlparser it has
>>
>>docbase plus
>>
>>    
>>
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
>  
>
>>The "/businessn" is missing. However, for small n,
>>the
>>parser works properly. 
>>
>>This is very strang. I believe that it is a bug.
>>
>>
>>Xue-Feng
>>
>>    
>>

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 00:33

See comments in the line.

 --- Derrick Oswald <DerrickOswald@...> wrote:
> Xue-Feng,
> 
> They may resolve to the same document in any
> browser, but the server is 
> performing the conversion, usually by adding
> index.html, even if it 
> doesn't indicate it.
> 
> Try this little experiment:
> 
> Type http://www.cbc.ca/index.html  into your
> browser.  It works. Why? 
> because the server converts both http://www.cbc.ca 
> and 
> http://www.cbc.ca/  into the same reference, namely 
> http://www.cbc.ca/index.html  which it then sends to
> your browser.  If 
> you think it would accept anything, try typing 
> http://www.cbc.ca/bogus.html - it won't work.
> 
> Now type http://www.cbc.ca/business/index.html  into
> your browser.  It 
> doesn't work.  Why? Because the
> http://www.cbc.ca/business or 
> http://www.cbc.ca/business/  does not get converted
> into that, but 
> instead reference an unknown page, maybe even a jsp
> page or whatever.
> 

I don't think so.
http://www.cbc.ca/business/index.html doesn't work
because index.html is not there. The default page for
that directory is index.jsp

You can check:

http://www.cbc.ca/business/index.jsp and compare with

http://www.cbc.ca/business/ or
http://www.cbc.ca/business

> On the client side, we cannot know that
> http://www.cbc.ca/business 
> really refers to
> http://www.cbc.ca/business/local_cbc_portal.jsp  or 
> whatever.   It must be assumed that the last
> element, unless it ends 
> with a slash, is the file name and hence it must be
> removed to resolve 
> relative references.
> 
> This is the correct behaviour.  It is not a bug. 
> Check out the unit 
> tests in utilTests.HTMLLinkProcessorTest and it's
> reference documentation:
> 
>     //
>     // Tests from Appendix C Examples of Resolving
> Relative URI References
>     // RFC 2396 Uniform Resource Identifiers (URI):
> Generic Syntax
>     // T. Berners-Lee et al.
>     // http://www.ietf.org/rfc/rfc2396.txt
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >I see the difference. No typo is in your post. So I
> >add a more comment here.
> >
> >Both "http://cbc.ca/business/" and
> >"http://cbc.ca/business" have the same meaning for
> >directory, at least in both IE and Nescape. So both
> >can be the docbase in my last message.
> >
> >Xue-Feng
> >
> > --- Xue-Feng Yang <just4look@...> wrote: >
> >Thanks for your comment. You must have some typo
> >  
> >
> >>there
> >>since I cannot see how you get the different
> outputs
> >>with the same code. However, I can guess what you
> >>mean(?).
> >>
> >>If I understand correctly, at least in both IE and
> >>Netscape, we have
> >>
> >>docbase plus
> >>quotes.html==>http://cbc.ca/business/quotes.html
> >>
> >>docbase plus
> >>/quotes.html==>http://cbc.ca/quotes.html
> >>
> >>So it is not necessary to make such methods as you
> >>mentioned. All should be determined in the
> >>implementation, and users don't have to worry
> about.
> >>
> >>
> >>Seem to me is that the problem I met in htmlparser
> >>is
> >>not this problem. It is more complicated. Let me
> >>specify the problem a bit more here:
> >>
> >>Let
> >>
> >>    
> >>
>
>docbase="http://cbc.ca/business1/business2/.../businessn/".
> >  
> >
> >>If n is big, then in htmlparser it has
> >>
> >>docbase plus
> >>
> >>    
> >>
>
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
> >  
> >
> >>The "/businessn" is missing. However, for small n,
> >>the
> >>parser works properly. 
> >>
> >>This is very strang. I believe that it is a bug.
> >>
> >>
> >>Xue-Feng
> >>
> >>    
> >>
> 
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 01:04

You are right. It should be directed by Webserver, not
browser. I only work on Apache webserver and test most
of the html there, but not read the standard yet. 

 --- Derrick Oswald <DerrickOswald@...> wrote:
> Xue-Feng,
> 
> They may resolve to the same document in any
> browser, but the server is 
> performing the conversion, usually by adding
> index.html, even if it 
> doesn't indicate it.
> 
> Try this little experiment:
> 
> Type http://www.cbc.ca/index.html  into your
> browser.  It works. Why? 
> because the server converts both http://www.cbc.ca 
> and 
> http://www.cbc.ca/  into the same reference, namely 
> http://www.cbc.ca/index.html  which it then sends to
> your browser.  If 
> you think it would accept anything, try typing 
> http://www.cbc.ca/bogus.html - it won't work.
> 
> Now type http://www.cbc.ca/business/index.html  into
> your browser.  It 
> doesn't work.  Why? Because the
> http://www.cbc.ca/business or 
> http://www.cbc.ca/business/  does not get converted
> into that, but 
> instead reference an unknown page, maybe even a jsp
> page or whatever.
> 
> On the client side, we cannot know that
> http://www.cbc.ca/business 
> really refers to
> http://www.cbc.ca/business/local_cbc_portal.jsp  or 
> whatever.   It must be assumed that the last
> element, unless it ends 
> with a slash, is the file name and hence it must be
> removed to resolve 
> relative references.
> 
> This is the correct behaviour.  It is not a bug. 
> Check out the unit 
> tests in utilTests.HTMLLinkProcessorTest and it's
> reference documentation:
> 
>     //
>     // Tests from Appendix C Examples of Resolving
> Relative URI References
>     // RFC 2396 Uniform Resource Identifiers (URI):
> Generic Syntax
>     // T. Berners-Lee et al.
>     // http://www.ietf.org/rfc/rfc2396.txt
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >I see the difference. No typo is in your post. So I
> >add a more comment here.
> >
> >Both "http://cbc.ca/business/" and
> >"http://cbc.ca/business" have the same meaning for
> >directory, at least in both IE and Nescape. So both
> >can be the docbase in my last message.
> >
> >Xue-Feng
> >
> > --- Xue-Feng Yang <just4look@...> wrote: >
> >Thanks for your comment. You must have some typo
> >  
> >
> >>there
> >>since I cannot see how you get the different
> outputs
> >>with the same code. However, I can guess what you
> >>mean(?).
> >>
> >>If I understand correctly, at least in both IE and
> >>Netscape, we have
> >>
> >>docbase plus
> >>quotes.html==>http://cbc.ca/business/quotes.html
> >>
> >>docbase plus
> >>/quotes.html==>http://cbc.ca/quotes.html
> >>
> >>So it is not necessary to make such methods as you
> >>mentioned. All should be determined in the
> >>implementation, and users don't have to worry
> about.
> >>
> >>
> >>Seem to me is that the problem I met in htmlparser
> >>is
> >>not this problem. It is more complicated. Let me
> >>specify the problem a bit more here:
> >>
> >>Let
> >>
> >>    
> >>
>
>docbase="http://cbc.ca/business1/business2/.../businessn/".
> >  
> >
> >>If n is big, then in htmlparser it has
> >>
> >>docbase plus
> >>
> >>    
> >>
>
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
> >  
> >
> >>The "/businessn" is missing. However, for small n,
> >>the
> >>parser works properly. 
> >>
> >>This is very strang. I believe that it is a bug.
> >>
> >>
> >>Xue-Feng
> >>
> >>    
> >>
> 
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 01:07

I still think it is a bug.

 --- Derrick Oswald <DerrickOswald@...> wrote:
> Xue-Feng,
> 
> They may resolve to the same document in any
> browser, but the server is 
> performing the conversion, usually by adding
> index.html, even if it 
> doesn't indicate it.
> 
> Try this little experiment:
> 
> Type http://www.cbc.ca/index.html  into your
> browser.  It works. Why? 
> because the server converts both http://www.cbc.ca 
> and 
> http://www.cbc.ca/  into the same reference, namely 
> http://www.cbc.ca/index.html  which it then sends to
> your browser.  If 
> you think it would accept anything, try typing 
> http://www.cbc.ca/bogus.html - it won't work.
> 
> Now type http://www.cbc.ca/business/index.html  into
> your browser.  It 
> doesn't work.  Why? Because the
> http://www.cbc.ca/business or 
> http://www.cbc.ca/business/  does not get converted
> into that, but 
> instead reference an unknown page, maybe even a jsp
> page or whatever.
> 
> On the client side, we cannot know that
> http://www.cbc.ca/business 
> really refers to
> http://www.cbc.ca/business/local_cbc_portal.jsp  or 
> whatever.   It must be assumed that the last
> element, unless it ends 
> with a slash, is the file name and hence it must be
> removed to resolve 
> relative references.
> 
> This is the correct behaviour.  It is not a bug. 
> Check out the unit 
> tests in utilTests.HTMLLinkProcessorTest and it's
> reference documentation:
> 
>     //
>     // Tests from Appendix C Examples of Resolving
> Relative URI References
>     // RFC 2396 Uniform Resource Identifiers (URI):
> Generic Syntax
>     // T. Berners-Lee et al.
>     // http://www.ietf.org/rfc/rfc2396.txt
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >I see the difference. No typo is in your post. So I
> >add a more comment here.
> >
> >Both "http://cbc.ca/business/" and
> >"http://cbc.ca/business" have the same meaning for
> >directory, at least in both IE and Nescape. So both
> >can be the docbase in my last message.
> >
> >Xue-Feng
> >
> > --- Xue-Feng Yang <just4look@...> wrote: >
> >Thanks for your comment. You must have some typo
> >  
> >
> >>there
> >>since I cannot see how you get the different
> outputs
> >>with the same code. However, I can guess what you
> >>mean(?).
> >>
> >>If I understand correctly, at least in both IE and
> >>Netscape, we have
> >>
> >>docbase plus
> >>quotes.html==>http://cbc.ca/business/quotes.html
> >>
> >>docbase plus
> >>/quotes.html==>http://cbc.ca/quotes.html
> >>
> >>So it is not necessary to make such methods as you
> >>mentioned. All should be determined in the
> >>implementation, and users don't have to worry
> about.
> >>
> >>
> >>Seem to me is that the problem I met in htmlparser
> >>is
> >>not this problem. It is more complicated. Let me
> >>specify the problem a bit more here:
> >>
> >>Let
> >>
> >>    
> >>
>
>docbase="http://cbc.ca/business1/business2/.../businessn/".
> >  
> >
> >>If n is big, then in htmlparser it has
> >>
> >>docbase plus
> >>
> >>    
> >>
>
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
> >  
> >
> >>The "/businessn" is missing. However, for small n,
> >>the
> >>parser works properly. 
> >>
> >>This is very strang. I believe that it is a bug.
> >>
> >>
> >>Xue-Feng
> >>
> >>    
> >>
> 
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Derrick Oswald <DerrickOswald@Ro...> - 2003-09-30 01:08

The point is, on the client side we cannot know that the real URL is 
http://www.cbc.ca/business/index.jsp and hence cannot know, a priori, 
that the correct document base is http://www.cbc.ca/business/  rather 
than http://www.cbc.ca/ .

Derrick

Xue-Feng Yang wrote:

>See comments in the line.
>
> --- Derrick Oswald <DerrickOswald@...> wrote:
>  
>
>>Xue-Feng,
>>
>>They may resolve to the same document in any
>>browser, but the server is 
>>performing the conversion, usually by adding
>>index.html, even if it 
>>doesn't indicate it.
>>
>>Try this little experiment:
>>
>>Type http://www.cbc.ca/index.html  into your
>>browser.  It works. Why? 
>>because the server converts both http://www.cbc.ca 
>>and 
>>http://www.cbc.ca/  into the same reference, namely 
>>http://www.cbc.ca/index.html  which it then sends to
>>your browser.  If 
>>you think it would accept anything, try typing 
>>http://www.cbc.ca/bogus.html - it won't work.
>>
>>Now type http://www.cbc.ca/business/index.html  into
>>your browser.  It 
>>doesn't work.  Why? Because the
>>http://www.cbc.ca/business or 
>>http://www.cbc.ca/business/  does not get converted
>>into that, but 
>>instead reference an unknown page, maybe even a jsp
>>page or whatever.
>>
>>    
>>
>
>I don't think so.
>http://www.cbc.ca/business/index.html doesn't work
>because index.html is not there. The default page for
>that directory is index.jsp
>
>You can check:
>
>http://www.cbc.ca/business/index.jsp and compare with
>
>http://www.cbc.ca/business/ or
>http://www.cbc.ca/business
>
>  
>
>>On the client side, we cannot know that
>>http://www.cbc.ca/business 
>>really refers to
>>http://www.cbc.ca/business/local_cbc_portal.jsp  or 
>>whatever.   It must be assumed that the last
>>element, unless it ends 
>>with a slash, is the file name and hence it must be
>>removed to resolve 
>>relative references.
>>
>>This is the correct behaviour.  It is not a bug. 
>>Check out the unit 
>>tests in utilTests.HTMLLinkProcessorTest and it's
>>reference documentation:
>>
>>    //
>>    // Tests from Appendix C Examples of Resolving
>>Relative URI References
>>    // RFC 2396 Uniform Resource Identifiers (URI):
>>Generic Syntax
>>    // T. Berners-Lee et al.
>>    // http://www.ietf.org/rfc/rfc2396.txt
>>
>>Derrick
>>
>>Xue-Feng Yang wrote:
>>
>>    
>>

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 01:23

I actually didn't argue that the directory should be
with "/" or not.  In my own code, I only use the one
with "/" too.

It looks you changed the topic.

My point is htmlparser returning a bad link(cite from
one of my message):

Let
docbase="http://cbc.ca/business1/business2/.../businessn/".

If n is big, then in htmlparser it has

docbase plus
quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html

The "/businessn" is missing. However, for small n, the
parser works properly. 

The example is

When you search links on the page

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte

It return "/Cities" to

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities

This is not coorect, and the correct link should be

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities

or 

http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/


However, the htmlparser misses
"/Skeena_Queen_Charlotte".


It is not because of the reason you stated in your
message.


Xue-Feng



 --- Derrick Oswald <DerrickOswald@...> wrote:
> The point is, on the client side we cannot know that
> the real URL is 
> http://www.cbc.ca/business/index.jsp and hence
> cannot know, a priori, 
> that the correct document base is
> http://www.cbc.ca/business/  rather 
> than http://www.cbc.ca/ .
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >See comments in the line.
> >
> > --- Derrick Oswald <DerrickOswald@...>
> wrote:
> >  
> >
> >>Xue-Feng,
> >>
> >>They may resolve to the same document in any
> >>browser, but the server is 
> >>performing the conversion, usually by adding
> >>index.html, even if it 
> >>doesn't indicate it.
> >>
> >>Try this little experiment:
> >>
> >>Type http://www.cbc.ca/index.html  into your
> >>browser.  It works. Why? 
> >>because the server converts both http://www.cbc.ca
> 
> >>and 
> >>http://www.cbc.ca/  into the same reference,
> namely 
> >>http://www.cbc.ca/index.html  which it then sends
> to
> >>your browser.  If 
> >>you think it would accept anything, try typing 
> >>http://www.cbc.ca/bogus.html - it won't work.
> >>
> >>Now type http://www.cbc.ca/business/index.html 
> into
> >>your browser.  It 
> >>doesn't work.  Why? Because the
> >>http://www.cbc.ca/business or 
> >>http://www.cbc.ca/business/  does not get
> converted
> >>into that, but 
> >>instead reference an unknown page, maybe even a
> jsp
> >>page or whatever.
> >>
> >>    
> >>
> >
> >I don't think so.
> >http://www.cbc.ca/business/index.html doesn't work
> >because index.html is not there. The default page
> for
> >that directory is index.jsp
> >
> >You can check:
> >
> >http://www.cbc.ca/business/index.jsp and compare
> with
> >
> >http://www.cbc.ca/business/ or
> >http://www.cbc.ca/business
> >
> >  
> >
> >>On the client side, we cannot know that
> >>http://www.cbc.ca/business 
> >>really refers to
> >>http://www.cbc.ca/business/local_cbc_portal.jsp 
> or 
> >>whatever.   It must be assumed that the last
> >>element, unless it ends 
> >>with a slash, is the file name and hence it must
> be
> >>removed to resolve 
> >>relative references.
> >>
> >>This is the correct behaviour.  It is not a bug. 
> >>Check out the unit 
> >>tests in utilTests.HTMLLinkProcessorTest and it's
> >>reference documentation:
> >>
> >>    //
> >>    // Tests from Appendix C Examples of Resolving
> >>Relative URI References
> >>    // RFC 2396 Uniform Resource Identifiers
> (URI):
> >>Generic Syntax
> >>    // T. Berners-Lee et al.
> >>    // http://www.ietf.org/rfc/rfc2396.txt
> >>
> >>Derrick
> >>
> >>Xue-Feng Yang wrote:
> >>
> >>    
> >>
> 
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Derrick Oswald <DerrickOswald@Ro...> - 2003-09-30 01:54

... which has bug #813838 links not parsed correctly 
http://sourceforge.net/tracker/index.php?func=detail&aid=813838&group_id=24399&atid=381399
<http://sourceforge.net/tracker/index.php?func=detail&aid=813838&group_id=24399&atid=381399>
Xue-Feng Yang wrote:

>I actually didn't argue that the directory should be
>with "/" or not.  In my own code, I only use the one
>with "/" too.
>
>It looks you changed the topic.
>
>My point is htmlparser returning a bad link(cite from
>one of my message):
>
>Let
>docbase="http://cbc.ca/business1/business2/.../businessn/".
>
>If n is big, then in htmlparser it has
>
>docbase plus
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
>
>The "/businessn" is missing. However, for small n, the
>parser works properly. 
>
>The example is
>
>When you search links on the page
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte
>
>It return "/Cities" to
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
>
>This is not coorect, and the correct link should be
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities
>
>or 
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/
>
>
>However, the htmlparser misses
>"/Skeena_Queen_Charlotte".
>
>
>It is not because of the reason you stated in your
>message.
>
>
>Xue-Feng
>
>
>
> --- Derrick Oswald <DerrickOswald@...> wrote:
>  
>
>>The point is, on the client side we cannot know that
>>the real URL is 
>>http://www.cbc.ca/business/index.jsp and hence
>>cannot know, a priori, 
>>that the correct document base is
>>http://www.cbc.ca/business/  rather 
>>than http://www.cbc.ca/ .
>>
>>Derrick
>>
>>Xue-Feng Yang wrote:
>>
>>    
>>
>>>See comments in the line.
>>>
>>>--- Derrick Oswald <DerrickOswald@...>
>>>      
>>>
>>wrote:
>>    
>>
>>> 
>>>
>>>      
>>>
>>>>Xue-Feng,
>>>>
>>>>They may resolve to the same document in any
>>>>browser, but the server is 
>>>>performing the conversion, usually by adding
>>>>index.html, even if it 
>>>>doesn't indicate it.
>>>>
>>>>Try this little experiment:
>>>>
>>>>Type http://www.cbc.ca/index.html  into your
>>>>browser.  It works. Why? 
>>>>because the server converts both http://www.cbc.ca
>>>>        
>>>>
>>>>and 
>>>>http://www.cbc.ca/  into the same reference,
>>>>        
>>>>
>>namely 
>>    
>>
>>>>http://www.cbc.ca/index.html  which it then sends
>>>>        
>>>>
>>to
>>    
>>
>>>>your browser.  If 
>>>>you think it would accept anything, try typing 
>>>>http://www.cbc.ca/bogus.html - it won't work.
>>>>
>>>>Now type http://www.cbc.ca/business/index.html 
>>>>        
>>>>
>>into
>>    
>>
>>>>your browser.  It 
>>>>doesn't work.  Why? Because the
>>>>http://www.cbc.ca/business or 
>>>>http://www.cbc.ca/business/  does not get
>>>>        
>>>>
>>converted
>>    
>>
>>>>into that, but 
>>>>instead reference an unknown page, maybe even a
>>>>        
>>>>
>>jsp
>>    
>>
>>>>page or whatever.
>>>>
>>>>   
>>>>
>>>>        
>>>>
>>>I don't think so.
>>>http://www.cbc.ca/business/index.html doesn't work
>>>because index.html is not there. The default page
>>>      
>>>
>>for
>>    
>>
>>>that directory is index.jsp
>>>
>>>You can check:
>>>
>>>http://www.cbc.ca/business/index.jsp and compare
>>>      
>>>
>>with
>>    
>>
>>>http://www.cbc.ca/business/ or
>>>http://www.cbc.ca/business
>>>
>>> 
>>>
>>>      
>>>
>>>>On the client side, we cannot know that
>>>>http://www.cbc.ca/business 
>>>>really refers to
>>>>http://www.cbc.ca/business/local_cbc_portal.jsp 
>>>>        
>>>>
>>or 
>>    
>>
>>>>whatever.   It must be assumed that the last
>>>>element, unless it ends 
>>>>with a slash, is the file name and hence it must
>>>>        
>>>>
>>be
>>    
>>
>>>>removed to resolve 
>>>>relative references.
>>>>
>>>>This is the correct behaviour.  It is not a bug. 
>>>>Check out the unit 
>>>>tests in utilTests.HTMLLinkProcessorTest and it's
>>>>reference documentation:
>>>>
>>>>   //
>>>>   // Tests from Appendix C Examples of Resolving
>>>>Relative URI References
>>>>   // RFC 2396 Uniform Resource Identifiers
>>>>        
>>>>
>>(URI):
>>    
>>
>>>>Generic Syntax
>>>>   // T. Berners-Lee et al.
>>>>   // http://www.ietf.org/rfc/rfc2396.txt
>>>>
>>>>Derrick
>>>>
>>>>Xue-Feng Yang wrote:
>>>>
>>>>   
>>>>
>>>>        
>>>>

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 02:02

Thanks. Although there is no testcase, I gave the my
code, sample links, and output on this list. It is OK
for me anyway since I remove htmlparser from our
search engine temporay and use something I wrote
before. I hope that this bug is fixed so that I can
move htmlparser back.

Let me know if the developer need to know the details.

Xue-Feng
 
 --- Derrick Oswald <DerrickOswald@...> wrote:
> ... which has bug #813838 links not parsed correctly
> 
>
http://sourceforge.net/tracker/index.php?func=detail&aid=813838&group_id=24399&atid=381399
>
<http://sourceforge.net/tracker/index.php?func=detail&aid=813838&group_id=24399&atid=381399>
> Xue-Feng Yang wrote:
> 
> >I actually didn't argue that the directory should
> be
> >with "/" or not.  In my own code, I only use the
> one
> >with "/" too.
> >
> >It looks you changed the topic.
> >
> >My point is htmlparser returning a bad link(cite
> from
> >one of my message):
> >
> >Let
>
>docbase="http://cbc.ca/business1/business2/.../businessn/".
> >
> >If n is big, then in htmlparser it has
> >
> >docbase plus
>
>quotes.html==>http://cbc.ca/business1/business2/.../business(n-1)/quotes.html
> >
> >The "/businessn" is missing. However, for small n,
> the
> >parser works properly. 
> >
> >The example is
> >
> >When you search links on the page
> >
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte
> >
> >It return "/Cities" to
> >
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Cities
> >
> >This is not coorect, and the correct link should be
> >
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities
> >
> >or 
> >
>
>http://dir.yahoo.com/Regional/Countries/Canada/Provinces_and_Territories/British_Columbia/Regional_Districts/Skeena_Queen_Charlotte/Cities/
> >
> >
> >However, the htmlparser misses
> >"/Skeena_Queen_Charlotte".
> >
> >
> >It is not because of the reason you stated in your
> >message.
> >
> >
> >Xue-Feng
> >
> >
> >
> > --- Derrick Oswald <DerrickOswald@...>
> wrote:
> >  
> >
> >>The point is, on the client side we cannot know
> that
> >>the real URL is 
> >>http://www.cbc.ca/business/index.jsp and hence
> >>cannot know, a priori, 
> >>that the correct document base is
> >>http://www.cbc.ca/business/  rather 
> >>than http://www.cbc.ca/ .
> >>
> >>Derrick
> >>
> >>Xue-Feng Yang wrote:
> >>
> >>    
> >>
> >>>See comments in the line.
> >>>
> >>>--- Derrick Oswald <DerrickOswald@...>
> >>>      
> >>>
> >>wrote:
> >>    
> >>
> >>> 
> >>>
> >>>      
> >>>
> >>>>Xue-Feng,
> >>>>
> >>>>They may resolve to the same document in any
> >>>>browser, but the server is 
> >>>>performing the conversion, usually by adding
> >>>>index.html, even if it 
> >>>>doesn't indicate it.
> >>>>
> >>>>Try this little experiment:
> >>>>
> >>>>Type http://www.cbc.ca/index.html  into your
> >>>>browser.  It works. Why? 
> >>>>because the server converts both
> http://www.cbc.ca
> >>>>        
> >>>>
> >>>>and 
> >>>>http://www.cbc.ca/  into the same reference,
> >>>>        
> >>>>
> >>namely 
> >>    
> >>
> >>>>http://www.cbc.ca/index.html  which it then
> sends
> >>>>        
> >>>>
> >>to
> >>    
> >>
> >>>>your browser.  If 
> >>>>you think it would accept anything, try typing 
> >>>>http://www.cbc.ca/bogus.html - it won't work.
> >>>>
> >>>>Now type http://www.cbc.ca/business/index.html 
> >>>>        
> >>>>
> >>into
> >>    
> >>
> >>>>your browser.  It 
> >>>>doesn't work.  Why? Because the
> >>>>http://www.cbc.ca/business or 
> >>>>http://www.cbc.ca/business/  does not get
> >>>>        
> >>>>
> >>converted
> >>    
> >>
> >>>>into that, but 
> >>>>instead reference an unknown page, maybe even a
> >>>>        
> >>>>
> >>jsp
> >>    
> >>
> >>>>page or whatever.
> >>>>
> >>>>   
> >>>>
> >>>>        
> >>>>
> >>>I don't think so.
> >>>http://www.cbc.ca/business/index.html doesn't
> work
> >>>because index.html is not there. The default page
> >>>      
> >>>
> >>for
> >>    
> >>
> >>>that directory is index.jsp
> >>>
> >>>You can check:
> >>>
> >>>http://www.cbc.ca/business/index.jsp and compare
> >>>      
> >>>
> >>with
> >>    
> >>
> >>>http://www.cbc.ca/business/ or
> >>>http://www.cbc.ca/business
> >>>
> >>> 
> >>>
> >>>      
> >>>
> >>>>On the client side, we cannot know that
> >>>>http://www.cbc.ca/business 
> >>>>really refers to
> >>>>http://www.cbc.ca/business/local_cbc_portal.jsp 
> >>>>        
> >>>>
> >>or 
> >>    
> >>
> >>>>whatever.   It must be assumed that the last
> >>>>element, unless it ends 
> >>>>with a slash, is the file name and hence it must
> >>>>        
> >>>>
> >>be
> >>    
> >>
> >>>>removed to resolve 
> >>>>relative references.
> >>>>
> >>>>This is the correct behaviour.  It is not a bug.
> 
> 
=== message truncated === 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca

Re: [personal] Re: [general] [Htmlparser-user] More details

From: Xue-Feng Yang <just4look@ya...> - 2003-09-30 02:09

Why do you need to know
http://www.cbc.ca/business/index.jsp?

 --- Derrick Oswald <DerrickOswald@...> wrote:
> The point is, on the client side we cannot know that
> the real URL is 
> http://www.cbc.ca/business/index.jsp and hence
> cannot know, a priori, 
> that the correct document base is
> http://www.cbc.ca/business/  rather 
> than http://www.cbc.ca/ .
> 
> Derrick
> 
> Xue-Feng Yang wrote:
> 
> >See comments in the line.
> >
> > --- Derrick Oswald <DerrickOswald@...>
> wrote:
> >  
> >
> >>Xue-Feng,
> >>
> >>They may resolve to the same document in any
> >>browser, but the server is 
> >>performing the conversion, usually by adding
> >>index.html, even if it 
> >>doesn't indicate it.
> >>
> >>Try this little experiment:
> >>
> >>Type http://www.cbc.ca/index.html  into your
> >>browser.  It works. Why? 
> >>because the server converts both http://www.cbc.ca
> 
> >>and 
> >>http://www.cbc.ca/  into the same reference,
> namely 
> >>http://www.cbc.ca/index.html  which it then sends
> to
> >>your browser.  If 
> >>you think it would accept anything, try typing 
> >>http://www.cbc.ca/bogus.html - it won't work.
> >>
> >>Now type http://www.cbc.ca/business/index.html 
> into
> >>your browser.  It 
> >>doesn't work.  Why? Because the
> >>http://www.cbc.ca/business or 
> >>http://www.cbc.ca/business/  does not get
> converted
> >>into that, but 
> >>instead reference an unknown page, maybe even a
> jsp
> >>page or whatever.
> >>
> >>    
> >>
> >
> >I don't think so.
> >http://www.cbc.ca/business/index.html doesn't work
> >because index.html is not there. The default page
> for
> >that directory is index.jsp
> >
> >You can check:
> >
> >http://www.cbc.ca/business/index.jsp and compare
> with
> >
> >http://www.cbc.ca/business/ or
> >http://www.cbc.ca/business
> >
> >  
> >
> >>On the client side, we cannot know that
> >>http://www.cbc.ca/business 
> >>really refers to
> >>http://www.cbc.ca/business/local_cbc_portal.jsp 
> or 
> >>whatever.   It must be assumed that the last
> >>element, unless it ends 
> >>with a slash, is the file name and hence it must
> be
> >>removed to resolve 
> >>relative references.
> >>
> >>This is the correct behaviour.  It is not a bug. 
> >>Check out the unit 
> >>tests in utilTests.HTMLLinkProcessorTest and it's
> >>reference documentation:
> >>
> >>    //
> >>    // Tests from Appendix C Examples of Resolving
> >>Relative URI References
> >>    // RFC 2396 Uniform Resource Identifiers
> (URI):
> >>Generic Syntax
> >>    // T. Berners-Lee et al.
> >>    // http://www.ietf.org/rfc/rfc2396.txt
> >>
> >>Derrick
> >>
> >>Xue-Feng Yang wrote:
> >>
> >>    
> >>
> 
> 
> 
> 
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Htmlparser-user mailing list
> Htmlparser-user@...
>
https://lists.sourceforge.net/lists/listinfo/htmlparser-user 

______________________________________________________________________ 
Post your free ad now! http://personals.yahoo.ca