[htdig] Duplicate URLs

[<ian...@di...>]

Just did my first run of rundig noticed that the search results were bring
up duplicates like:

http://www.digitalhit.com/cr/reneezellweger
http://www.digitalhit.com/cr/reneezellweger/

and

http://www.digitalhit.com/academy/73/index.shtml
http://www.digitalhit.com/academy/73/

Anyway to eliminate or weed those out?

Thanks.