Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: Distributed Computing Anyone?

by kvale (Monsignor)
on May 10, 2006 at 04:21 UTC ( #548382=note: print w/ replies, xml ) Need Help??


in reply to Distributed Computing Anyone?

One approach is to use OpenPBS a portable batch system. It includes queueing, parallel processing, prioritization, and more. It is open source and works on Unix systems. There is a perl binding PBS::Client that provides a nice interface:

use PBS::Client; # Create a client object linked to a server my $client = PBS::Client->new; # Describe the job my $job = PBS::Client::Job->new( %job_options, # e.g. queue => 'queue_1', mem => '800 +mb' cmd => \@commands ); # Optionally, re-organize the commands to a number of queues $job->pack(numQ => $numQ); # Submit job $client->qsub($job);
Alternatively, a pure perl solution could be built around Schedule::Depend. Hmm, it was up to v. 2.6, but doesn't seem to be on CPAN any more...

Update: Fixed the OpenPBS link.

-Mark


Comment on Re: Distributed Computing Anyone?
Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://548382]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others musing on the Monastery: (9)
As of 2014-12-21 15:56 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (106 votes), past polls