Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#54 Add HDF5 support to PDL

None
pending
None
1
2014-01-26
2011-08-17
Chris Marshall
No

The current PDL::IO::HDF supports version 4 of the HDF standard.
HDF5 is the standard now. Perhaps it makes sense to move to
HDF5 for PDL as well.

I notice that John Cerney has a PDL::IO::HDF5 module out.
A lot of the motivation for this would be from knowing
how much use of HDF4 or HDF5 is being made and
whether the difference matters for PDL users (current
or prospective).

Discussion

  • Judd Taylor
    Judd Taylor
    2011-08-18

    HDF4 and HDF5 are completely different formats that have little to do with each other. HDF5 needs to be added as a separate interface library. An upgrade is not possible as the file formats are completely different. If it were to support HDF5, then it would no longer work with HDF4. There are thousands of applications using HDF4, and petabytes upon petabytes of data written in the HDF4 format.

     
  • Judd Taylor
    Judd Taylor
    2011-08-18

    It's worth nothing that I need both, but I limp by on HDF5 by using the netcdf interface (both formats are based on netcdf, but similarities basically end there). I would love a fully featured HDF5 library interface for PDL. NCSA (HDF group), contacted the PDL list a couple of years ago about doing just that, but I never heard from them again...

     
  • Chris Marshall
    Chris Marshall
    2011-08-19

    Modifying the title of this request since it was not intended
    to replace HDF4 support but to augment with HDF5.

     
  • Chris Marshall
    Chris Marshall
    2011-08-19

    • summary: Update HDF support to HDF5 --> Add HDF5 support to PDL
     
  • Chris Marshall
    Chris Marshall
    2013-01-02

    Upping the priority a bit. Will take an action to follow up with John Cerney and his HDF5 module. We should definitely have this support for PDL and should make sure it is a clean install and so available for a PDL bundle-type install.

     
  • Chris Marshall
    Chris Marshall
    2013-01-02

    • priority: 3 --> 5
     
  • Chris Marshall
    Chris Marshall
    2013-09-14

    We've started a pdl-io-hdf5 git repository on the PDL sf.net
    site based on the current PDL::IO::HDF5 by John Cerney. Still
    to do: handle HDF5 library detection on all platforms, verify
    the build works, minor clean-up for a full release. It is
    possible that this will make a release in time for PDL-2.007.

     
  • Chris Marshall
    Chris Marshall
    2014-01-26

    • status: open --> pending
    • assigned_to: Chris Marshall
    • Group: -->
    • Priority: 5 --> 1
     
  • Chris Marshall
    Chris Marshall
    2014-01-26

    PDL::IO::HDF5 version 0.6501 has just been released to CPAN. This updates and packages the original module with more features, correctly indexed by CPAN, and better library detection.

    I'm marking this feature request as pending and lowering the priority. There is still some packaging clean up needed and Alien::HDF5 support is planned to improve the buildability of the module.

     
  • Chris Marshall
    Chris Marshall
    2014-01-26

    Additional HDF5 support is planned once the PDL3 support for more general and/or universal type support is available.