#500 Duplicate finding

[Gjalt-Jorn Peters]

JabRef is great! I will be using it to replace Endnote as soon as possible. Two things are holding me back. One is that I don't know how to write import filters. I understand that this has to be done in Javas, but I don't know Java, which effectively blocks me :-)
The other thing is the following.

In EndNote, there is the Find Duplicates function, which, when used, shows only duplicates, selecting all entries that are duplicates of others. So, if you have five entries, A, B, C, D and E, and you have B two times, and you have C three times, making your list look like this:

A
B
B
C
C
C
D

then pressing the Find Duplicates function would only show B and C, selecting the duplicates:

B
-B-
C
-C-
-C-

(dashes indicate selection).

This allows very fast removal of duplicate records. Now, JabRef also has a 'find duplicates' function, which is perhaps a bit slower, but for the rest works very well.

However. :-)

I am doing a review. Several reviews actually. And it is useful to repeat a query (in my case in a database called PsycINFO) after a few months, or with improved keywords. I use Jabref to screen the hits of this query (so that I know which entries are excluded, which I need to examine, etc). I flag the entries accordingly (in a custom field). I prefer to not do this again every time I redo a query.

In Endnote, I can just import the new query into a new database, and then combine this database with the flagged database. I then look for duplicates, sort the shown records on the custom field, and delete all those that are not flagged. This allows me to add new hits to the flagged database very easily.

In JabRef, this would be very bothersome. I would have to go by over 1000 hits one-by-one . . .

Would it be possible to implement a second duplicate-finding feature, which acts like the Endnote one?

Thank you in advance :-)

Gjalt-Jorn

[Gjalt-Jorn Peters]

Logged In: YES
user_id=2143951
Originator: YES

I saw I already posted a related but slightly different request . . . Sorry for the overlap!!!

[Morten Omholt Alver]

Logged In: YES
user_id=704995
Originator: NO

I'm not sure I'm quite following your workflow, but I see how a different duplicate search mode could be useful.

It may not be relevant, but if you run the new query in your current database (in JabRef), you will see the windows showing the entries found. Each one for which a duplicate already exists, will be marked, and you can click to determine whether to import the duplicate entry and whether to keep the old entry.

[Gjalt-Jorn Peters]

Logged In: YES
user_id=2143951
Originator: YES

Dear Morten,

I am afraid I don't quite understand what you (but it SOUNDS like it might be what I needed all along :-)). Do you mean when I run a query on an online database such as PsycINFO?
If so, I am afraid that I don't know how to do that; I currently run the query using a WebSpirs interface to PsycINFO (a website), and then download the hits to a text file. I import that to Endnote (see my remark about not having an import filter :-)) and then export it to JabRef :-)

If you mean something else, then I don't know what, I'm sorry . . .

[Morten Omholt Alver]

Logged In: YES
user_id=704995
Originator: NO

How do you export it from Endnote into JabRef? Whether you export a bib file or some other format from Endnote, when you load it into JabRef, you can have your existing database open, and then use the function "Import into current database". Then you will see all entries in a popup-window where you can choose which entries to import. In this window, duplicates are marked with a D in one of the columns, and clicking on the D lets you decide what to do about the duplicate.

[Gjalt-Jorn Peters]

Logged In: YES
user_id=2143951
Originator: YES

Aaaaahh!!!

Very well, I will go and play with that!!

Thank you!!!!

I import by just exporting from EndNote using a 'style' I made (I attached it, perhaps it can be useful to anyone?). I then rename the resulting txt file to .bib and just open it in JabRef.

(I know that I could just export it to a file with the .bib extension, but I'm neurotic :-P)

Thank you for this!!! I will go and play with it as soon as I finished what I'm currently immersed in.
File Added: BibTeX Export - by GjY.ens

[Gjalt-Jorn Peters]

Style for Endnote that exports to BibTeX format - it uses my personal Custom Field names, but you can easily change these (I'll post this on my website at some point with some directions)

[Oliver Kopp]

How does this endnote style compare to the one available at http://jabref.sourceforge.net/resources.php#endnote_filters? Should we add your export style, too?