Re: [Htmlparser-user] RE: [Htmlparser-user] RE: [Htmlparser-user] Finding a whole word
Brought to you by:
derrickoswald
Menu
▾
▴
Re: [Htmlparser-user] RE: [Htmlparser-user] RE: [Htmlparser-user] Finding a whole word
|
From: Derrick O. <Der...@Ro...> - 2006-05-30 22:16:00
|
You probably want to override visitStringNode (Text string) in the
StringBean like you've done, but you'll need to be smarter about it.
Like keeping track of where you are (in whitespace or not), perhaps by
looking at the last character in the StringBuffer and the first
character in the incoming text (the default behaviour is to just slap
them together - see below). That and parsing the incoming text to break
it into words. Each node has a getStartPosition () nethod that will tell
you where you are in the HTML page in units of characters.
/**
* Appends the text to the output.
* @param string The text node.
*/
public void visitStringNode (Text string)
{
if (!mIsScript && !mIsStyle)
{
String text = string.getText ();
if (!mIsPre)
{
text = Translate.decode (text);
if (getReplaceNonBreakingSpaces ())
text = text.replace ('\u00a0', ' ');
if (getCollapse ())
collapse (mBuffer, text);
else
mBuffer.append (text);
}
else
mBuffer.append (text);
}
}
Jay Kim wrote:
>Let me describe more on the the problems of using StringBean as a
>NodeVisitor.
>Here is my code snippet:
>
> private class TestVisitor extends StringBean {
> @Override
> public void visitStringNode(Text text) {
> System.out.println("text=" + text.getText());
> }
> }
>
> TestVisitor visitor = new TestVisitor();
> visitor.setCollapse(false);
> htmlParser.visitAllNodesWith(visitor);
>
>And, if I feed the sample HTML below, the visitStringNode() methods does
>not detect the second 'AAAAA' as one word, but instead, it splits into
>two words ('AAA' and 'AA'), which is basically the same problem that I
>described in the first email.
>Please let me know.
>Thanks,
>
>Jay
>
>-----Original Message-----
>From: htm...@li...
>[mailto:htm...@li...] On Behalf Of Jay
>Kim
>Sent: Tuesday, May 30, 2006 10:45 AM
>To: htm...@li...
>Subject: [Htmlparser-user] RE: [Htmlparser-user] Finding a whole word
>
>Derrick,
>
>Thank you so much for your quick respond, and getting back to me with
>the solution.
>Now that I'm able to count the number of words appears in a HTML file
>correctly, my next task is to find out the offset (start position) of
>each words. I'm guessing that I probably have to use NodeVisitor with
>StringBean, but I'd like to get some guidelines before I dig into the
>APIs.
>So, for the following sample HTML:
>
><HTML>
><head>
><title>Test HTML</title>
></head>
><body>
><p>AAAAA BBBBB AAA<font color='red'>AA</font> BBBBB AAAAA</p>
></body>
></HTML>
>
>If I search for 'AAAAA', I want to get three matches with their starting
>positions (offsets), such as,
> Match 1 offset = 58
> Match 2 offset = 70
> Match 3 offset = 108
>
>Could you show me how to achieve this?
>Thanks a lot,
>
>Jay
>
>
>-----Original Message-----
>From: htm...@li...
>[mailto:htm...@li...] On Behalf Of
>Derrick Oswald
>Sent: Monday, May 29, 2006 4:45 AM
>To: htm...@li...
>Subject: Re: [Htmlparser-user] Finding a whole word
>
>Jay
>The text you want can be obtained with the StringBean if Collapse is
>false.
>
>When collapse is true, there is a bug in the StringBean.
>I've logged this as bug #1496863 StringBean collapse() adds extra
>whitespace
><http://sourceforge.net/tracker/index.php?func=detail&aid=1496863&group_
>id=24399&atid=381399>
>so you can track it.
>Derrick
>
>Jay Kim wrote:
>
>
>
>>Hi,
>>
>>I'm trying to get the word count using htmlparser, but it doesn't seem
>>
>>
>
>
>
>>to be able to handle the following example.
>>
>>Let's say the source html looks like this:
>>
>><HTML>
>>
>><head>
>>
>><title>Test HTML</title>
>>
>></head>
>>
>><body>
>>
>><p>AAAAA BBBBB AAA<font color='red'>AA</font> BBBBB AAAAA</p>
>>
>></body>
>>
>></HTML>
>>
>>And, if you load it in a browser, you'll see the word 'AAAAA' three
>>times.
>>
>>But, if you parse this html, it returns following nodes:
>>
>>AAAAA BBBBB AAA AA BBBBB AAAAA
>>
>>So, it breaks down the second 'AAAAA' into two words because of the
>>font tag in the middle. And, the word count from the parsed text would
>>
>>
>
>
>
>>be "2".
>>
>>Is there any way that I can get the same text/string/word that I see
>>on the browser?
>>
>>Thanks,
>>
>>Jay
>>
>>
>>
>
>
>
>-------------------------------------------------------
>All the advantages of Linux Managed Hosting--Without the Cost and Risk!
>Fully trained technicians. The highest number of Red Hat certifications
>in
>the hosting industry. Fanatical Support. Click to learn more
>http://sel.as-us.falkag.net/sel?cmd=lnk&kid=107521&bid=248729&dat=121642
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>-------------------------------------------------------
>All the advantages of Linux Managed Hosting--Without the Cost and Risk!
>Fully trained technicians. The highest number of Red Hat certifications
>in
>the hosting industry. Fanatical Support. Click to learn more
>http://sel.as-us.falkag.net/sel?cmdk&kid7521&bid$8729&dat1642
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>-------------------------------------------------------
>All the advantages of Linux Managed Hosting--Without the Cost and Risk!
>Fully trained technicians. The highest number of Red Hat certifications in
>the hosting industry. Fanatical Support. Click to learn more
>http://sel.as-us.falkag.net/sel?cmd=k&kid7521&bid$8729&dat1642
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>
|
