Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Parallel batch process plumbing issues

by secret (Beadle)
on Dec 22, 2005 at 21:43 UTC ( #518636=note: print w/replies, xml ) Need Help??


in reply to Parallel batch process plumbing issues

Maybe make each job write a file when it is finished and watch the directory for all desired file to be there ?

There is also Schedule::SGE but it is in version 0.02 ...

  • Comment on Re: Parallel batch process plumbing issues

Replies are listed 'Best First'.
Re^2: Parallel batch process plumbing issues
by gmol (Sexton) on Dec 22, 2005 at 23:16 UTC
    Well ok, I think I have a simple solution. Just make a sub script that calls the binary, and writes to a file when it's done, checks to see if it's the last one to chip into the output pool, and if it is, exec the parent script again. A little ugly, but not kludgy enough to make me shudder... Sounds good, but I'll need to be careful about atomicity in checking/writing to files...any pointers would be apprecaited.
      Ah ok O'Riley Perl cookbook chap 7.11. I think my problem is solved.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://518636]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (3)
As of 2020-02-25 05:17 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    What numbers are you going to focus on primarily in 2020?










    Results (108 votes). Check out past polls.

    Notices?