mediainfo run times > 2.5 minutes

Help
2013-11-08
2014-01-12
  • isometric13
    isometric13
    2013-11-08

    Sometimes mediainfo can take more than 2.5 minutes to return and I am wondering this is to be expected or if it indicates that there is some other performance bottleneck (e.g. I/O) that I should be concerned with.

    Here are some details about a specific example:
    Linux x86_64 x86_64 x86_64 GNU/Linux
    Red Hat Enterprise Linux Server release 5.7 (Tikanga)
    16 cores Intel(R) Xeon(R) CPU X5570 @ 2.93GHz
    7851 MB RAM

    media info output
    General
    Complete name : file.mxf
    Format : MXF
    Commercial name : XDCAM HD422
    Format profile : OP-1a
    Format settings : Closed / Complete
    File size : 51.3 GiB
    Duration : 2h 1mn
    Overall bit rate : 60.2 Mbps
    Encoded date : 2013-11-08 13:27:11.000
    Writing application : Rhozet Carbon 1.00
    Writing library : Rhozet Carbon 1.00

    Video
    ID : 2
    Format : MPEG Video
    Commercial name : XDCAM HD422
    Format version : Version 2
    Format profile : 4:2:2@High
    Format settings, BVOP : Yes
    Format settings, Matrix : Custom
    Format settings, GOP : M=3, N=12
    Format_Settings_Wrapping : Frame
    Duration : 2h 1mn
    Bit rate : 50.0 Mbps
    Width : 1 920 pixels
    Height : 1 080 pixels
    Display aspect ratio : 16:9
    Frame rate : 25.000 fps
    Color space : YUV
    Chroma subsampling : 4:2:2
    Bit depth : 8 bits
    Scan type : Interlaced
    Scan order : Top Field First
    Compression mode : Lossy
    Bits/(Pixel*Frame) : 0.965
    Stream size : 42.6 GiB (83%)
    Delay_SDTI : 3600000

    Audio #1
    ID : 3
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #2
    ID : 4
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #3
    ID : 5
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #4
    ID : 6
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #5
    ID : 7
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #6
    ID : 8
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #7
    ID : 9
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    Audio #8
    ID : 10
    Format : PCM
    Format settings, Endianness : Little
    Format_Settings_Wrapping : Frame (AES)
    Duration : 2h 1mn
    Bit rate mode : Constant
    Bit rate : 1 152 Kbps
    Channel(s) : 1 channel
    Sampling rate : 48.0 KHz
    Bit depth : 24 bits
    Stream size : 1 005 MiB (2%)
    Delay_SDTI : 3600000

    run time:
    start=17 58 29
    end= 18 01 05

    Do you know if this long run time is related to the mxf container?
    This file is stored on a SAN which is mounted to the box where i run mediainfo.
    I have seen other long run times for files in mov containers.
    So I wonder if it could be I/O related as well.

    I really appreciate any thoughts or insight you can provide.

    Thanks!
    Sean

     
  • I have currently some issues with mxf container and some files (especially 4K content), I am working on increasing the performance (currently, I do some useless, for main purpose of MediaInfo, analysis due to specific features I implemented for some customers), but 2.5 minutes for basic analysis (the default configuration of MediaInfo) is definitely long.
    I mainly work with a local storage (RAID disks directly attached to my machine, so my throughput is >500 GB/s), but I don't succeed to reproduce something near of a bottleneck (on my side, duration with default config is less than 1 second) even with MXF from Rhozet (but my files are less than 6 GB), 50 GB+ files I get are not made by Rhozet (same : less than 1 second).
    On another side, I got a report with slow analysis with some storage on a LAN at 1 Gbps, without being able to get the file or test myself.

    about MOV files, I had previously some issues with high bit rate files (several hundreds of MB were read, useless), but it should be corrected in latest public version (0.7.64)

    Summary: there is currently some work on MXF speed improvement with the files I have (for my customers, with their files), some issues are detected, but maybe not all issues (your issues are maybe same as my other customers, maybe not) are detected so maybe they will not be corrected.

    Having one sample of MXF and one sample of MOV files with such slow analysis speed would be great. I can not promise I'll correct speed issue fast (paid requests have higher priority), but if it is fast to patch, I'll patch it fast.
    If you can provide sample files, please contact me at info@mediaarea.net . I can sign an NDA if needed (I use to work with companies).

    another possibility is to provide a specific version of MediaInfo with some performance tracking (I check how many byte I read from your SAN and the speed of the SAN), but it is longer to implement for me (so not for free, at least currently)

     
  • Thomas Hesse
    Thomas Hesse
    2014-01-11

    I'm having the exact same problem with large files in 0.7.65 and 0.7.66.
    Here's a typical problem file:

    General
    ID : 0 (0x0)
    Complete name : E:\Filename.mp4
    Format : MPEG-TS
    File size : 8.06 GiB
    Duration : 2h 59mn
    Overall bit rate mode : Variable
    Overall bit rate : 6 442 Kbps
    Maximum Overall bit rate : 18.0 Mbps

    Video
    ID : 4113 (0x1011)
    Menu ID : 1 (0x1)
    Format : AVC
    Format/Info : Advanced Video Codec
    Format profile : Main@L4.0
    Format settings, CABAC : Yes
    Format settings, ReFrames : 4 frames
    Format settings, GOP : M=4, N=32
    Codec ID : 27
    Duration : 2h 59mn
    Bit rate mode : Variable
    Bit rate : 5 994 Kbps
    Maximum bit rate : 20.0 Mbps
    Width : 1 280 pixels
    Height : 720 pixels
    Display aspect ratio : 16:9
    Frame rate : 59.940 fps
    Color space : YUV
    Chroma subsampling : 4:2:0
    Bit depth : 8 bits
    Scan type : Progressive
    Bits/(Pixel*Frame) : 0.108
    Stream size : 7.50 GiB (93%)
    Color primaries : BT.709
    Transfer characteristics : BT.709
    Matrix coefficients : BT.709

    Audio
    ID : 4352 (0x1100)
    Menu ID : 1 (0x1)
    Format : AAC
    Format/Info : Advanced Audio Codec
    Format version : Version 2
    Format profile : LC
    Muxing mode : ADTS
    Codec ID : 15
    Duration : 2h 59mn
    Bit rate mode : Variable
    Bit rate : 129 Kbps
    Channel(s) : 2 channels
    Channel positions : Front: L R
    Sampling rate : 48.0 KHz
    Compression mode : Lossy
    Delay relative to video : -18ms
    Stream size : 165 MiB (2%)

    0.7.64 takes about 1 second to display the media info.
    0.7.65 and 66 take about 2-3 minutes for the exact same file.

    The file in question is 8 gigabytes, non-fragmented and located on a local hard-drive (2 terabytes, 7200rpm, SATA-3).

    I've reverted to 0.7.64 for the time being.
    Hope you'll find ways to optimize this. 3 minutes to get basic info on a video file is not practical.

     
    Last edit: Thomas Hesse 2014-01-11
  • I still need files.
    Without files, it is difficult to see the bug. I have 50+ GB TS files parsed in few seconds.

    I can provide a private FTP access for upload if you need one (drop an email to info@mediaarea.net )