Loaded a 1 GB delimited file and run filter on it. The filter window doesn't close after filtering is completed, and doesn't show the result window. Had to click on the Filter button multiple time to get the result window to show.
Any idea?
Thanks!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Small files are stored in object form. This is very expensive in terms of Memory - not suitable for 1gb files.
Large files are stored in blocks, above a certain size, The RecordEditor will GZIP the blocks to reduce storage, If more space is needed it can also store blocks on Disk as well.
For a Large file it will have read blocks from disk if neccasary, Un-Zip the file, check each record, Re-Zip the blocks and may be write some back to disk.
There are comprimises for editing Large files
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hi Bruce,
Loaded a 1 GB delimited file and run filter on it. The filter window doesn't close after filtering is completed, and doesn't show the result window. Had to click on the Filter button multiple time to get the result window to show.
Any idea?
Thanks!
It was just me being impatient!!! Sorry about that! It worked if I waited a little longer for the magic to finish..
I will explain briefly what is going on
Small files are stored in object form. This is very expensive in terms of Memory - not suitable for 1gb files.
Large files are stored in blocks, above a certain size, The RecordEditor will GZIP the blocks to reduce storage, If more space is needed it can also store blocks on Disk as well.
For a Large file it will have read blocks from disk if neccasary, Un-Zip the file, check each record, Re-Zip the blocks and may be write some back to disk.
There are comprimises for editing Large files