[htdig-dev] Numbered HTML Entities mangled in Result Blurbs

SourceForge Headquarters 1320 Columbia Street Suite 310 San Diego, CA 92101 +1 (858) 422-6466

I am seeing some HTML entities show up in search result 'blurbs'.

See below.  Basically any entity of this form &#XXX; get translated to &amp;#XXX;

&#153; --> &amp;#153;

This only happens for numbered entities below 160.

&#160; --> &nbsp;
&#169; --> &copy;
&#174; --> &reg;

I'm digging for this code.. looks like

Is there a fix for this in 3.1.X??  Anyone complain about this before????

Thanks!

Example Page:

1 <HTML>
2 <TITLE>Test page
3 </TITLE>
4 <BODY>
5 <h1>HTDIG &#153;</h1>
6 <h2>Use our software &#151; to enhance your website</h2>
7 <BR>
8 HTDig &#153; 3.2.0
9 <BR>
10
11 The ht://Dig system is a complete world wide web indexing and searching system
12 for a domain or intranet.
13
14 <BR>
15 <BR>
16 1&nbsp;&#139;2&#160;&lt;&nbsp;3
17 <BR>
18 &#169;&#160;2003 Neal Richter
19 <BR>
20 &copy;&#160;2003 HtDig Group
21 </BODY>
22 </HTML>
23

Search results:

nealr@westfork htdig-3.2.0b5-bin]$ cgi-bin/htsearch -c conf/htdig.conf
Enter value for words: htdig
Content-type: text/html

Enter value for format: long
<dl><dt><a
href="http://westfork.rightnow.com/data/test/test2.html">Test page
</a><img src="/htdig/star.gif" alt="*"><img src="/htdig/star.gif"
alt="*"><img src="/htdig/star.gif" alt="*"><img src="/htdig/star.gif"
alt="*">
</dt><dd> HTDIG &amp;#153; USE OUR SOFTWARE &amp;#151; TO
ENHANCE YOUR WEBSITE HTDig &amp;#153; 3.2.0 The ht://Dig
system is a complete world wide web indexing and searching system for a
domain or intranet. 1&nbsp;&amp;#139;2&nbsp;&lt;&nbsp;3 &copy;&nbsp;2003
Neal Richter &copy;&nbsp;2003 HtDig Group 
<a
href="http://westfork.rightnow.com/data/test/test2.html">http://westfork.rightnow.com/data/test/test2.html</a>
 11/17/03, 384 bytes
</dd></dl>

Neal Richter
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485