[MAS: feature requests] Compress/uncompress data files
Brought to you by:
jcochrane
From: Jim C. <jt...@di...> - 2003-05-31 02:39:33
|
When using the -w option to get data from the web, the cached data files are text files. The server could call upon gzip and unzip the file, process, then zip the file. The files are 40K+ in size and will continue to grow. If I eventually download a 10,000+ symbols that gets close to 0.5G. Zip can greatly reduce the storage requirements. This could be configured as an option so that users with plenty of space would not have to incur the time penalty for the compression. Note: A better solution would probably be for the server to store the files in compressed form and uncompress the data internally after reading it from the file, rather than uncompressing and compressing each file each time it is read. The option to compress data could probably also be applied to systems where the data comes directly from files. |