Media can not be 'accessed', can be copied

Help
emm_is
2008-05-03
2018-01-06
1 2 > >> (Page 1 of 2)
  • emm_is

    emm_is - 2008-05-03

    Lately I have noticed that I am having access issues to my mp3 collection on my ps3 (2.30).

    When displaying album directories sometimes the album art for a particular track is displayed, sometimes the generic audio icon. When scrolling up and down art that was displayed may show the generic icon and vice versa.

    When trying to play the mp3 often it will fail with "The folder could not be accessed. This content may have been deleted from the media server".

    When trying to copy from the media server to the ps3 directory individual media files that are not playing I get an error "An error occured during the copy operation (80030925)".

    *However* I can copy the whole album from the server and the tracks that didn't play/didn't show thumbnails now work just fine with the local copy.

    In terms of the bandwidth of my wireless connection, streaming divx works just fine and 10 MPix jpgs work just fine and a laptop by the ps3 gets a '54MBit/s excellent' connection.

    Any thoughts? I tried <retries-on-timeout> but it did not seem to improve things.

     
    • Jin

      Jin - 2008-05-03

      Forget the <retries-on-timeout> option, it was a special feature to workaround one of the early PS3 firmwares bugs in socket handling.

      We would maybe know more if "80030925" resolved to something more meaningful, otherwise I have no clue to why you are experiencing those problems, sorry.

      Kind regards,
      Jin

       
    • emm_is

      emm_is - 2008-05-04

      Checking further (after connecting the ps3 on 100BaseT).

      It seems as if folders (albums) which *do not have any* folder art thumbnails showing play fine but folders where folder art shows (intermittently) have the playing problem.

      Is there any way to disable thumbnails for mp3s?

      Also, noticed that the date obj.meta[M_DATE] is 'undefined' if a jpg etc does not have an exif value DATE_TIME*. This means poorly created jpgs (like from nokia phones) have no date entry at all, not even file create date.

      Also, if the date in the exif (Nikon Coolscan III being fingered here) is in the format 2005:3:1 then obj.meta[M_DATE] returns 2005-:3 1 (or something like that). I used this code to parse the normal and abnormal? dates:

      //reformat date
      DATE_VAR.replace(/:/,"-").replace(/:/,"-").replace(/ /,"T")

      //get year, month, day
      var matches = DATE_VAR.match(/^([0-9]{4})-([0-9]{1,2})-([0-9]{1,2})/);

      E

       
    • Jin

      Jin - 2008-05-04

      Interesting... no one reported anything like that before, I wonder why it is happening with your setup.

      Right now there is no way to disable the thumbnails, mainly because this has never been a problem so we did not think about adding an option for disabling it. The album art is retrieved from MP3 files, i.e. from the id3 tags, I wonder about the size of your pictures. Maybe they are simply too big, and since we do not do any extra checking on that the PS3 may be choking on the sizes. Can you please have a look?

      Thanks for the information regarding the date, I'll see that I add extra checks to the code that extracts the date from the EXIF tag to catch the case that you reported.

      Kind regards,
      Jin

       
    • emm_is

      emm_is - 2008-05-05

      Checked the thumbnails, just fine. However...

      Looking in the log file I found entries like this:

      2008-05-05 09:40:25   ERROR: Object not found: 32305
      2008-05-05 09:40:35    INFO: Exception: Object not found: 31934
      2008-05-05 09:41:27   ERROR: Object not found: 32208

      Cross checking in the web interface, the object codes *were* correct. I then noticed that the album from which I was playing a track from was being re-added to the database. Restarting the ps3, checking the object number and trying to play the track and again, in the log:

      2008-05-05 09:58:35    INFO: Exception: Object not found: 34103
      2008-05-05 10:00:18   ERROR: Object not found: 36108

      and I find that the tracks are being re-added again...

      Hmm, any thoughts? I should add that I have just moved to a Synology cs407 from an NSLU2. The Mediatomb on the nslu2 performs just fine with (its copy) of these files, though slow to import. I find these issues on the Synology cs407. Both are from the nslu2 optware repository.

      E

       
    • Jin

      Jin - 2008-05-05

      Hmm, "and I find that the tracks are being re-added again..." - so you are using autoscan, right? Inotify or timed? Is it possible that the system clock is being reset each time? Please check if the same issues happen to a directory that is not set to autoscan mode. Also, if using timed scan try using "basic" scan instead of "full" and see if that helps.

      Basically I suspect that there is some problem and that data gets readded again and again; the PS3 caches a lot and at some point things go wrong.

      Kind regards,
      Jin

       
    • emm_is

      emm_is - 2008-05-05

      The mp3 files were added using inotify. The issue happens whether the files are added in config.xml or the web interface.

      Looking more carefully (and I now find the nslu2 also suffers from this), files with embedded thumbnails seem to be the ones that don't play, are not found and then are readded. Files without thumbnails seems to play fine. (And as noted above, when the thumbnailed mp3 files are local to the ps3 they play just fine).

      Thanks for persevering with me here!

      E

       
    • Jin

      Jin - 2008-05-05

      OK, let's do a controlled test.

      If you do not want to reimport stuff, simply copy your sqlite3 database (mediatomb.db) somewhere, so you can restore it later on.

      Remove the original mediatomb.db* (there may be backup copies), then start the server.

      It will create a new, empty db so we start fresh.

      Put exactly one MP3 file which does have embedded thumbs into an emtpy directory, then set autoscan settings on this directory.

      Do not turn on the PS3 yet, just watch the MT log output.

      Refresh the UI from time to time and check if the object ID changes.

      Let me know if it does... and also watch the log for useful info.

       
    • emm_is

      emm_is - 2008-05-05

      When I hand added a single file (a problem one), no autoscan.

      The file lists, shows a thumbnail and plays fine.

      I then added a bunch of albums with the web interface just clicking + rather than using autoscan.

      As far as I have tested, every file plays fine.

      Ok. So it is a inotify(/ps3?) issue I guess. This is a 'works for me' now (for me, unlike photos, mp3s don't get added all the time), but I a happy to further pursue debugging further if you want.

       
    • Jin

      Jin - 2008-05-05

      Thanks for the test, ok, now throw away the added files and keep only one.

      Then set the test directory with this one file to an inotify scan mode. What happens now?

       
    • emm_is

      emm_is - 2008-05-05

      I deleted the database and started again.

      Added a known trouble file (has a thumbnail too) with '+'.

      Listed and played fine on ps3.

      Added its complete album directory in web interface with full inotify scan.

      2008-05-05 14:01:21   ERROR: Object not found: 173
      2008-05-05 14:01:21   ERROR: Object not found: 173
      2008-05-05 14:01:22   ERROR: Object not found: 83
      2008-05-05 14:01:23   ERROR: Object not found: 155
      2008-05-05 14:01:25   ERROR: Object not found: 128

      etc.

      The file I hand added also would no longer play.

      E

       
    • Jin

      Jin - 2008-05-05

      Doh.. I really appreciate your help in testing, but please let's do one step at a time :)

      Do not turn on the PS3 yet, do not add whole albums, I'm trying to localize the problem and this is not possible if we do several steps at once.

      If you have an empty directory, copy exactly one file in there, set this directory to autoscan - and then watch the UI and reload the UI, comparing the link to the item - does the object ID stay the same or is it changing? And do you see error messages like above (or anything else) in the log?

      Thanks,
      Jin

       
    • emm_is

      emm_is - 2008-05-05

      ok, ps3 off.

      Empty directory, copy one mp3 (a problem one). Autoscan inotify full the directory containing this file.

      Checked object ids (there are several, one for All Audio, another for All - full name etc).

      Reload, shut down mediatomb, start up mediatomb. No change.

      No errors logged in log.

       
    • Jin

      Jin - 2008-05-05

      OK, thanks! So the file is not being randomly readded. Now, please copy additional (problem) files into this directory, just a few and check if they got picked up by the inotify scan. Also repeat the same check with the IDs and reloading of the UI to make
      sure that the object ID's did not change and everything works as it should. No PS3 yet...

      As a further check you could try downloading the cidero control point (free download) from www.cidero.com, you can use it on your PC to view stuff that is on the server. I expect that it will show everything correctly.

      Let's see if we can get till this point.

      Again, thanks a lot for testing!

      Kind regards,
      Jin

       
    • emm_is

      emm_is - 2008-05-05

      Copied one more file to test directory. It was automatically recognised. Object IDs stable with reload and restart of server (no ps3!).

      Cidero displays as expected. No problems, so far.

       
    • Jonas Birgander

      Jonas Birgander - 2008-05-05

      I just wanted to say that I have the same problem, so emm_is is not alone.
      The problem occurs when using inotify, using timed scan it works great.

      If there's anything I can help with, just ask.
      Looking forward to the conclusion of this thread!

       
    • Jin

      Jin - 2008-05-06

      Jonas: what device are you running the server on?

      emm_is: OK, so you have a stable state without the PS3, which so far is as expected. The PS3 *can not* remove any media or alter any media on the server, so let's do another test:

      make sure you start with the stable state where everything works with Cidero and where you see that the IDs do not change in the UI, then turn on the PS3 and see what happens.

      I suspect two things: either the PS3 gets confused by something and requests wrong IDs, or something is going on, on the NAS device, something that triggers inotify events.

       
      • Jonas Birgander

        Jonas Birgander - 2008-05-06

        A box running Debian. Do you need more details?

         
    • Jin

      Jin - 2008-05-06

      x86 or something else?

      Also, is the issue that you have also experienced to mp3 files with album art?

       
      • Jonas Birgander

        Jonas Birgander - 2008-05-06

        Yes, it's x86 (some Intel Celeron) and yes, the problem occurs when the mp3 files have embedded album art.

         
    • Jin

      Jin - 2008-05-06

      OK, since you are on an x86 box it will be somewhat easier to debug this problem.

      Install the inotify-tools package and use the inotifywait utility to monitor the directory that you also set to inotify scan in MediaTomb:

      inotifywait -m /directory/to/monitor/ -e close_write -e create -e moved_from -e moved_to -e delete_self -e delete -e move_self -e unmount

      Then try to reproduce the problem with the PS3 and see if you get any events in the terminal with inotifywait.

      The idea:
      it was reported that the object ID's change. This can only happen if files are being readded to the database. The readding will only happen if a file in a monitored directory changes (well, actually it will happen when we receive events like above).

      So, what we want to check is - are any events causing the files to be readded?

      Thanks for testing!

      Kind regards,
      Jin

       
      • Jonas Birgander

        Jonas Birgander - 2008-05-06

        Okay, i started with a fresh mediatom.db and added inotify scan for one directory with mp3s (an album). Normally, i add inotify + recursive to one rootdir which contains alot more.

        This is what i get when i browse the album on the PS3:

        In mediatom console:
        2008-05-06 17:59:28   ERROR: Object not found: 71
        2008-05-06 17:59:28   ERROR: Object not found: 76
        2008-05-06 17:59:28   ERROR: Object not found: 81
        2008-05-06 17:59:28   ERROR: Object not found: 86
        2008-05-06 17:59:29   ERROR: Object not found: 91
        2008-05-06 17:59:29   ERROR: Object not found: 96
        2008-05-06 17:59:29   ERROR: Object not found: 101
        2008-05-06 17:59:29   ERROR: Object not found: 106
        2008-05-06 17:59:29   ERROR: Object not found: 111
        2008-05-06 17:59:30   ERROR: Object not found: 116
        2008-05-06 17:59:30   ERROR: Object not found: 121
        2008-05-06 17:59:30   ERROR: Object not found: 126
        2008-05-06 17:59:30   ERROR: Object not found: 131

        From inotifywait:
        Nothing

        When I try to play a song:
        Mediatomb:
        2008-05-06 18:00:38   ERROR: Object not found: 71
        2008-05-06 18:00:38   ERROR: Object not found: 71

        inotifywait:
        Nothing

        Back to the albumlist and try to play another song:
        Mediatomb:
        2008-05-06 18:01:20   ERROR: Object not found: 136
        2008-05-06 18:01:22   ERROR: Object not found: 106
        2008-05-06 18:01:22   ERROR: Object not found: 106
        2008-05-06 18:01:23   ERROR: Object not found: 141
        2008-05-06 18:01:23   ERROR: Object not found: 146
        2008-05-06 18:01:23   ERROR: Object not found: 151
        2008-05-06 18:01:23   ERROR: Object not found: 156
        2008-05-06 18:01:24   ERROR: Object not found: 161
        2008-05-06 18:01:24   ERROR: Object not found: 166
        2008-05-06 18:01:24   ERROR: Object not found: 171

        inotifywait:
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 04 E14.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 04 E14.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 05 Rådhusgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 05 Rådhusgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 06 Bangårdsgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 06 Bangårdsgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 07 Prästgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 07 Prästgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 08 Brunflovägen.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 08 Brunflovägen.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 09 Färjemansleden.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 09 Färjemansleden.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 10 Stuguvägen.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 10 Stuguvägen.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3

        Then i stopped inotifywait, showed the album list again, and started inotifywait. When i hit play for a song, this is what i get:

        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 01 Ingång.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 02 Storgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 02 Storgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 02 Storgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 03 Thoméegränd.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 03 Thoméegränd.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 03 Thoméegränd.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 04 E14.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 04 E14.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 04 E14.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 05 Rådhusgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 05 Rådhusgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 06 Bangårdsgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 06 Bangårdsgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 07 Prästgatan.mp3
        /media/mediatomb/musik/test/Vapnet/Jag Vet Hur Man Väntar/ CLOSE_WRITE,CLOSE 07 Prästgatan.mp3

        I tried with only one file too.

        Showing the album:
        Mediatomb:
        2008-05-06 18:06:36   ERROR: Object not found: 13
        2008-05-06 18:06:37   ERROR: Object not found: 13

        inotifywait:
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3

        Trying to play it:

        It works! Although without any album art. But i still get these:

        Mediatomb:
        2008-05-06 18:08:01   ERROR: Object not found: 13
        2008-05-06 18:08:03   ERROR: Object not found: 13
        2008-05-06 18:08:03   ERROR: Object not found: 13

        inotifywait:
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3
        /media/mediatomb/test/ CLOSE_WRITE,CLOSE test.mp3

        Do you need any more tests?

         
    • Jin

      Jin - 2008-05-06

      Wow! I think I now understand what is happening!

      We use TagLib to read the album art from the file, this is automated, opening the file happens within taglib - and it seems that taglib opens the file in rw mode. Which means: each time the album art is read, there is an inotify event! And this again means that the file gets reimported! So this indeed is related to album art, nice work guys :) That was not an easy bug to catch :>

      I will see if I can tell taglib to open the files in read only mode, if yes - that would be an easy fix.

      Thanks for testing!

      Kind regards,
      Jin

       
  • Celcal

    Celcal - 2017-01-04

    Hi
    Has this been fixed in mediatomb?
    If so in which version?

    I'm currently running version 0.12.1-4+deb7u1 (on a raspberry-pi. uname: Linux 4.1.13+ #826 PREEMPT Fri Nov 13 20:13:22 GMT 2015 armv6l GNU/Linux) , and I get the following error in mediatomb.log when trying to open mp3 files having album art:

    ERROR: Object not found:

    And those mp3 files won't play. (my player is BubbleUPnP v2.8.4)

    If I copy the same mp3 file after removing the album art to the mediatomb folder, then it plays without problem.

    As a work around based on what you explained above, I'm copying the mp3 files to the mediatomb folder using user/premissions so that the mediatomb account does not have write access. This is doing the trick for now.

     
  • Thev00d00

    Thev00d00 - 2017-01-04

    Its still not fixed... You can open files RO in taglib now, but no one has updated the code to that yet.

     
1 2 > >> (Page 1 of 2)

Log in to post a comment.