Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re^3: Looking for a POE based distributed job scheduler

by suaveant (Parson)
on Dec 29, 2009 at 12:35 UTC ( #814742=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Looking for a POE based distributed job scheduler
in thread Looking for a POE based distributed job scheduler

My thoughts would be that you'd probably save yourself a lot of effort by setting up ssh keys on each system and doing all the work on the main site. That way you don't have to do nearly as much synchronization and maintaining of multiple running instances that all need to communicate. Just use remote ps calls, remote run your apps (which makes them local instances sort of) and check /proc/loadavg for system load info. Don't make things harder than you have to. Then the only actual hard part you need to write is the part that decides when to use which computer and how to decide your resource allocation. (my code also handles time based allocation i.e. don't run until at least 4pm)

                - Ant
                - Some of my best work - (1 2 3)


Comment on Re^3: Looking for a POE based distributed job scheduler

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://814742]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (7)
As of 2014-09-20 20:45 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (163 votes), past polls