Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Parallel batch process plumbing issues

by secret (Beadle)
on Dec 22, 2005 at 21:43 UTC ( [id://518636]=note: print w/replies, xml ) Need Help??


in reply to Parallel batch process plumbing issues

Maybe make each job write a file when it is finished and watch the directory for all desired file to be there ?

There is also Schedule::SGE but it is in version 0.02 ...

  • Comment on Re: Parallel batch process plumbing issues

Replies are listed 'Best First'.
Re^2: Parallel batch process plumbing issues
by gmol (Sexton) on Dec 22, 2005 at 23:16 UTC
    Well ok, I think I have a simple solution. Just make a sub script that calls the binary, and writes to a file when it's done, checks to see if it's the last one to chip into the output pool, and if it is, exec the parent script again. A little ugly, but not kludgy enough to make me shudder... Sounds good, but I'll need to be careful about atomicity in checking/writing to files...any pointers would be apprecaited.
[reply]
      Ah ok O'Riley Perl cookbook chap 7.11. I think my problem is solved.
[reply]

In Section Seekers of Perl Wisdom

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?

www.com | www.net | www.org
Node Status?
node history
Node Type: note [id://518636]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? • Last hour • Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (3)
As of 2024-04-19 05:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found