Menu
▾
▴
#1 Task-Executor: space usage
(this is more of an issue, not a bug)
For the task-executor's src/main/resources/resource.properties, we have a list of directories:
PATH_PACKAGE1 = /scratch1/pedros/TE/pkg/
PATH_PACKAGE2 = /scratch2/pedros/TaskExecutor/packages/
This is where task-executor keeps the submission packages (starting with 200kb and growing to 5MB during execution). When many projects are executed, task-executor exceeds its quota of space. There is currently no implemented way to deal with this. Sometimes when we exceed our limit on one scratch drive, we manually switch the code to the other scratch. That was the quickest way to handle this problem.
It would be useful to have a better way of dealing with this.
