[htdig] Entire Page Not Indexed

[Keith E. <ke...@nu...>]

Hi Folks,

I have a curious problem.  htdig seems to only index the title of my HTML
pages.  After simplifying things, I setup htdig to index just one page.
This page includes a lot of content, but only the words in the title are
included in the words list.

I have...

* Executed rundig, with start_url to exactly one page.

* Executed htdump.

* Viewed db.worddump - it only contains words in the title.

* Viewed the url_list of pages that were indexed - my page is in the list.

The page is dynamically generated (the URL is
animal.nurelm.com/site/faqs.jsp).  It's full of Flash and Javascript, but I
would hope that did not matter.  In fact, I removed all of the Flash and
JavaScript and it did not matter.  I have messed with most of the
configuration parameters and get seem to make any progress.

Your help would by HUGELY appreciated!

Thanks,
  Keith