Re: [Fofredux-devel] Duplicate items

[Kevin <ke...@dr...>]

Miles Beck wrote:
> I just noticed a good example of a duplicate item being added to a
> feed. I have had one article appear three times just a few minutes ago
> in one feed. One publish time was different and two were identical.
>
> The three urls to the articles are as follows:
> http://feeds.feedburner.com/boingboing/iBag?m=1286
> http://www.boingboing.net/2006/05/10/npr_xeni_tech_net_ne.html
> http://feeds.feedburner.com/boingboing/iBag?m=1285
>
> Now obviously the urls are different so this is probably why the
> article appeared three times. Did feedburner mess something up so this
> was posted twice by them and then once boingboing?
>
> I'm just trying to get some details here as I have noticed duplicate
> items still showing up for me. And am wanting to track down whether or
> not it is a FoFR issue or not.
Looks like it's feedburner's fault.   I guess they use a forwarding URL 
for hit tracking.  There are 2 id's pointing to the same blog entry.  
the rdf:about attribute has the boingboing link, perhaps we should favor 
using that for atom feeds.

We use link or guid tags for uniqueness generally.   If they are 
different, then fofr treats them as different items.  I see this 
sometimes on feeds from slashdot and the register.

-Kevin