Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

Re: Actively monitor space

by sundialsvc4 (Abbot)
on Aug 07, 2012 at 12:55 UTC ( #985968=note: print w/replies, xml ) Need Help??

in reply to Actively monitor space

There are many job-monitor systems out there for Unix and Linux, and one of the things they can regulate is “expected disk-space usage.”   But they really can’t observe how much disk space any particular job is using, nor can they necessarily regulate it (even with quota).   You need to know the jobs.

Many shops try to do job scheduling with crontabs, and they get into trouble because you really can’t predict the completion-time of one unit of work.   You wind up either wasting time or doubling-up on resources.

So-called “workflow monitoring” systems can be surprisingly effective.   The various components of what we call “jobs” can in fact all run as child-processes of a parent that is simply forking children and waiting for them to complete.   Heck, if the workflow is predictable and unchanging, that can be how you run jobs with a great deal of control, e.g. driven by a Perl script.   All the work is done under the auspices of one parent pid.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://985968]
[kschwab]: shades of "pimp my ride"

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (12)
As of 2017-03-27 15:09 GMT
Find Nodes?
    Voting Booth?
    Should Pluto Get Its Planethood Back?

    Results (320 votes). Check out past polls.