Currently, due to EC2 drive space, all logs are stored on the ephemeris mount. This means, that when the server is rebooted or shut down, the logs are lost.
Ideally, we need to create a log rotation system that stores the most recent log locally, on the EBS drive, and then, during rotation, pushes older logs to the ephemeris.
In addition to Tomcat and Apache logs, it would be nice to also ensure that system logs are created and handled in a similar fashion.
Ephemeral storage should really be used for temporary transitional elements, such as uploading a file, scanning, making any modifications then moving to a final destination. Linux has a log rotation utility in place already. I think a good solution would be to use the AWS CLI tools to claim logs taht are in the .gz format older than say, 1 month, and move them to S3 for long term storage, or better yet, Glacier, for cheaper long term storage.