Is there a way to configure ht://dig to descend down the links in our menus "<div><a href='some/url'>menu item</a></div>" but "tag" each page with the text on the menus.  We are having people search for key words that are on the menus and getting results containing every page that has that menu.  Instead I just want the pages with the contents.
I found the noindex_start and noindex_end, but my fear is that if I wrap these menus in these, then ht://dig will no longer "follow" the menu urls.  Is this correct?