Menu

#4 support creation of larger files

1.0
open
nobody
None
2014-10-12
2013-11-22
Tobias
No

28 Feb 2009, Mike wrote on Matlab Central:

"Writes to binary memory stream which runs out of memory at ~270 MB (.NET managed heap limitation, I believe) before being written to disk. Would be nice to have the option to take a performance hit but stream directly to disk, enabling creation of larger files."

Related

Discussion: Out of memory error
Discussion: Appending to Matfiles

Discussion

  • Steve Asprelli

    Steve Asprelli - 2014-10-12

    When trying to write structures with large data arrays using "MatFileWriter mfw = new MatFileWriter(outFilePath, mlList, true);" can recieve out of memory error. I believe this happens when 2 Gbyte limit is hit. Is it possible to have "zlib.net.dll" compiled with the largeaddressaware switch set? I have rebuilt csmatio.dll with this option but I believe zlib.net.dll is where the problem is originating as dumpbin.exe indicates it is not large address aware. Perhaps the solution is to avoid using zlib.net.dll altogther as was suggested in another post. If we can compile our own writer, than the largeaddressaware switch could be turned on of off as the application requires.

     
    • Tobias

      Tobias - 2014-10-15

      I just commited [r13], updating the project to VS2013 and making it possible to avoid zlib.net.dll. It would be nice to hear from you if this works better?

       

      Related

      Commit: [r13]


Log in to post a comment.