Menu

Nothing to compare?

Help
werner007
2009-03-10
2012-07-19
  • werner007

    werner007 - 2009-03-10

    Hello Alex

    I have a large collection of audio files and know 100% that some of them are duplicates, as 1-1 copies or in varying quality.
    All songs are in OGG format. Dump3 scans 30000 songs rapidly within 1 minute (0.33 Vergl./Millisekunde) and finds "nothing".
    What could be wrong by me?

    Greetings, Werner

     
    • Alexander Grasser

      Werner,

      That is odd. There could be a number of reasons for this:
      1) OGG library is broken (or it needs administrator privileges to run)
      2) your files don't have extension .ogg
      3) files are in a format that OGG library does not understand

      The best is to create a small subset and run Dump3 on that set with logging enabled. Edit log4j.properties and set the debug level to DEBUG instead of INFO and then send me the log file.

      Hope that helps.
      Alex

       
    • Alexander Grasser

      4) your db may indicate that you have already compared the files. create a backup of the database files and rerun the program.

       
      • werner007

        werner007 - 2009-03-10

        Hi Alex

        Before i had completely emptied the database, except table status.
        With the GUI and OGG file, only the table "filename" was filled. A test run with the GUI and MP3 file has revealed that after the scan no new entries from MP3 files in table "filename" occurred, only the OGG's I've found. I then changed to the CLI-version, which showed me that all the OGG's should be damaged. Again a try for MP3 with CLI, and now got some few fingerprints.

        Greetings, Werner

         
    • werner007

      werner007 - 2009-03-10

      Alex

      Here the first part of dump3.log:

      22:53:01,932 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/Albums/, Maske: ^.$
      22:53:01,933 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/Albums/ lesen gestartet.
      22:53:02,429 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Stoppe einlesen des Verzeichnis /media/Audio/Albums/.
      22:53:03,259 [main:] INFO net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Unterstützte Dateiformate: [ULAW, PCM_SIGNED, PCM_UNSIGNED, MP3, VORBIS, ALAW]
      22:53:03,315 [main:] INFO net.za.grasser.duplicate.fingerprint.ColorFingerprint - Unterstützte Dateiformate: [BMP, PNM, JPEG2000, JPG, RAW, PNG, JPEG, WBMP, GIF, TIF, TIFF, JPEG 2000]
      22:53:09,004 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/Albums/, Maske: (^.
      .ogg$)
      22:53:09,004 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/Albums/ lesen gestartet.
      22:53:09,079 [CompareWorker:2:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Thru The Winter.ogg]!
      javax.sound.sampled.LineUnavailableException: Audio Device Unavailable
      at com.sun.media.sound.HeadspaceMixer.nResume(Native Method)
      at com.sun.media.sound.HeadspaceMixer.implOpen(HeadspaceMixer.java:346)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:286)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:323)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:103)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:139)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at net.za.grasser.duplicate.fingerprint.FdmfFingerprint.makeFingerprintFromFile(FdmfFingerprint.java:463)
      at net.za.grasser.duplicate.fingerprint.AbstractFingerprint.getFingerprint(AbstractFingerprint.java:128)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:94)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:111)
      at net.za.grasser.duplicate.compare.CompareWorker.run(CompareWorker.java:132)
      at java.lang.Thread.run(Thread.java:619)
      22:53:09,081 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Thru The Winter.ogg könnte beschädigt sein!
      22:53:09,082 [CompareWorker:2:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Right Next Door.ogg]!
      javax.sound.sampled.LineUnavailableException: Audio Device Unavailable
      at com.sun.media.sound.HeadspaceMixer.nResume(Native Method)
      at com.sun.media.sound.HeadspaceMixer.implOpen(HeadspaceMixer.java:346)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:286)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:323)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:103)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:139)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at net.za.grasser.duplicate.fingerprint.FdmfFingerprint.makeFingerprintFromFile(FdmfFingerprint.java:463)
      at net.za.grasser.duplicate.fingerprint.AbstractFingerprint.getFingerprint(AbstractFingerprint.java:128)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:94)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:111)
      at net.za.grasser.duplicate.compare.CompareWorker.run(CompareWorker.java:132)
      at java.lang.Thread.run(Thread.java:619)
      22:53:09,083 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Right Next Door.ogg könnte beschädigt sein!
      22:53:09,085 [CompareWorker:3:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - When A Woman's Had Enough.ogg]!
      javax.sound.sampled.LineUnavailableException: Audio Device Unavailable
      at com.sun.media.sound.HeadspaceMixer.nResume(Native Method)
      at com.sun.media.sound.HeadspaceMixer.implOpen(HeadspaceMixer.java:346)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:286)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:323)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:103)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:139)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at net.za.grasser.duplicate.fingerprint.FdmfFingerprint.makeFingerprintFromFile(FdmfFingerprint.java:463)
      at net.za.grasser.duplicate.fingerprint.AbstractFingerprint.getFingerprint(AbstractFingerprint.java:128)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:94)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:111)
      at net.za.grasser.duplicate.compare.CompareWorker.run(CompareWorker.java:132)
      at java.lang.Thread.run(Thread.java:619)
      22:53:09,089 [CompareWorker:3:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - When A Woman's Had Enough.ogg könnte beschädigt sein!
      22:53:09,103 [CompareWorker:2:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Close As I'll Get To Heaven.ogg]!
      javax.sound.sampled.LineUnavailableException: Audio Device Unavailable

       
    • werner007

      werner007 - 2009-03-10

      Alex

      The same with MP3:

      23:07:38,302 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/zzOriginals/Albums/, Maske: ^.$
      23:07:38,303 [DirectoryReader:/media/Audio/zzOriginals/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/zzOriginals/Albums/ lesen gestartet.
      23:07:44,518 [DirectoryReader:/media/Audio/zzOriginals/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Stoppe einlesen des Verzeichnis /media/Audio/zzOriginals/Albums/.
      23:07:44,543 [main:] INFO net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Unterstützte Dateiformate: [ULAW, PCM_SIGNED, PCM_UNSIGNED, MP3, VORBIS, ALAW]
      23:07:44,584 [main:] INFO net.za.grasser.duplicate.fingerprint.ColorFingerprint - Unterstützte Dateiformate: [BMP, PNM, JPEG2000, JPG, RAW, PNG, JPEG, WBMP, GIF, TIF, TIFF, JPEG 2000]
      23:08:00,084 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/zzOriginals/Albums/, Maske: (^.
      .mp3$)
      23:08:00,084 [DirectoryReader:/media/Audio/zzOriginals/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/zzOriginals/Albums/ lesen gestartet.
      23:08:00,212 [CompareWorker:1:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/zzOriginals/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Serves Him Right.mp3]!
      javax.sound.sampled.LineUnavailableException: Audio Device Unavailable
      at com.sun.media.sound.HeadspaceMixer.nResume(Native Method)
      at com.sun.media.sound.HeadspaceMixer.implOpen(HeadspaceMixer.java:346)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:286)
      at com.sun.media.sound.AbstractMixer.open(AbstractMixer.java:323)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:103)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at com.sun.media.sound.AbstractDataLine.open(AbstractDataLine.java:139)
      at com.sun.media.sound.MixerSourceLine.open(MixerSourceLine.java:39)
      at net.za.grasser.duplicate.fingerprint.FdmfFingerprint.makeFingerprintFromFile(FdmfFingerprint.java:463)
      at net.za.grasser.duplicate.fingerprint.AbstractFingerprint.getFingerprint(AbstractFingerprint.java:128)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:94)
      at net.za.grasser.duplicate.compare.CompareWorker.process(CompareWorker.java:111)
      at net.za.grasser.duplicate.compare.CompareWorker.run(CompareWorker.java:132)
      at java.lang.Thread.run(Thread.java:619)
      23:08:00,212 [CompareWorker:2:] WARN net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Fehler beim Lesen der Datei [/media/Audio/zzOriginals/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Salt On My Wounds.mp3]!

      The message "Audio device unavaiable" is strange, so i stopped the media player and try again for OGG:

      23:13:41,904 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/Albums/, Maske: ^.$
      23:13:41,914 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/Albums/ lesen gestartet.
      23:13:51,021 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Stoppe einlesen des Verzeichnis /media/Audio/Albums/.
      23:13:51,127 [main:] INFO net.za.grasser.duplicate.fingerprint.FdmfFingerprint - Unterstützte Dateiformate: [ULAW, PCM_SIGNED, PCM_UNSIGNED, MP3, VORBIS, ALAW]
      23:13:51,341 [main:] INFO net.za.grasser.duplicate.fingerprint.ColorFingerprint - Unterstützte Dateiformate: [BMP, PNM, JPEG2000, JPG, RAW, PNG, JPEG, WBMP, GIF, TIF, TIFF, JPEG 2000]
      23:13:58,504 [main:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis: /media/Audio/Albums/, Maske: (^.
      .ogg$)
      23:13:58,504 [DirectoryReader:/media/Audio/Albums/:] INFO net.za.grasser.duplicate.file.DirectoryReader - Verzeichnis /media/Audio/Albums/ lesen gestartet.
      23:13:58,518 [CompareWorker:1:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - It Ain't Worth It After Awhile.ogg könnte beschädigt sein!
      23:13:58,521 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Thru The Winter.ogg könnte beschädigt sein!
      23:13:58,529 [CompareWorker:3:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - When A Woman's Had Enough.ogg könnte beschädigt sein!
      23:13:58,538 [CompareWorker:1:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Right Next Door.ogg könnte beschädigt sein!
      23:13:58,548 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Close As I'll Get To Heaven.ogg könnte beschädigt sein!
      23:13:58,559 [CompareWorker:3:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Salt On My Wounds.ogg könnte beschädigt sein!
      23:13:58,570 [CompareWorker:1:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Hey, Hey Baby (Bettye's Blues).ogg könnte beschädigt sein!
      23:13:58,574 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - A Woman Like Me.ogg könnte beschädigt sein!
      23:13:58,583 [CompareWorker:3:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Thinkin' Bout You.ogg könnte beschädigt sein!
      23:13:58,592 [CompareWorker:1:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - The Forecast.ogg könnte beschädigt sein!
      23:13:58,600 [CompareWorker:2:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - Serves Him Right.ogg könnte beschädigt sein!
      23:13:58,604 [CompareWorker:3:] WARN net.za.grasser.duplicate.file.FingerprintFile - /media/Audio/Albums/Bettye Lavette - A Woman Like Me/Bettye Lavette - When The Blues Catch Up To You.ogg könnte beschädigt sein!

      Regards, Werner

       
      • Alexander Grasser

        Hi Werner

        Are you running Dump3 on a machine that does not have a sound card? The "javax.sound.sampled.LineUnavailableException: Audio Device Unavailable" exception seems to indicate that the libraries are written in such a way that they require a sound device to do some of the conversion/playback!

        Maybe try to run on a machine with a sound device.

        Thanks
        Alex

         
        • werner007

          werner007 - 2009-03-11

          Alex.

          As i wrote last, it works with MP3 if the sound card is not busy from the player. Debian with Alsa. The log has no entries about exceptions.

          Regards, Werner

           
          • Alexander Grasser

            maybe it only needs the card for certain formats?

             
            • Rose McCarry

              Rose McCarry - 2009-08-29

              It is an interesting message. I have a question. Now I use Clone Remover to <a href="http://www.fileutilityblog.com/archives/234">find images and music files duplicates</a> What are the differences in these two programmes and how can I use the one from this article? Thank you.

               
    • werner007

      werner007 - 2009-03-10

      Alex

      I tried again for MP3 with the stopped audio player, and it works.
      That the used Lib can't handle OGG files can not be changed, right?

      I wanted to take an new start with Dump3 to clean up my duplicates.
      But in the meantime i had moved all audio to a new drive and converted to OGG.

      Greetings, Werner

       
    • werner007

      werner007 - 2009-03-11

      By the way, the thread view is odd of his order on this Forum.

       
    • Alexander Grasser

      i noticed that as well. maybe a bug in SF?

       
    • werner007

      werner007 - 2009-03-13

      Alex

      I started with the GUI to scan my audio collection.
      Once for about 8 hours with about 4900 songs have been processed, flow rate was 8.9 as indicated.
      The check in table "filename" shows me 165 songs between 2000 to 7000 times registered.
      Then once again i scanned for about 8 hours. 5100 songs were processed (including those from the previous day!).
      The table "filename" now shows 168 songs with about 2000 entries for the new and from 8000 to 26000 for the previous entrys.
      In a small collection this is probably not big noticeable, but for my collection it will never got something. You know the problem? It seems that the management between database and the something goes wrong. For example, it is not recognized if a entry is already present. The many duplicates in the table need not necessarily disturb the process of fingerprint comparison. But noticeable by the second run is the little progress it has been made. I would like to help somehow, then i like the tool. I work daily with SQL and i could give my experience.

      Regards, Werner

       

Log in to post a comment.