Hello all. I currently work in a setting where I have access to cluster style computing. We have recently been having a lot of issues with jobs filling up all available disk space. I was wondering if someone knows the best way to actively monitor disk space and if there is a way to pause or otherwise modify submitted jobs to halt processes before the disk quota is reached.
Currently I am just using the df -H command to check how much space is available, and I could see maybe coding this into a bash script but I feel like a perl script designated for this task would be more useful. Does anyone know of any modules or methodologies that would be useful for me to actively monitor disk space and take actions on currently running processes if neccessary? I am very much a noob, so please bare with me if my question lacks appropriate detail. Thank you for your time!