Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number

Re: Distributed Computing Anyone?

by kvale (Monsignor)
on May 10, 2006 at 04:21 UTC ( #548382=note: print w/replies, xml ) Need Help??

in reply to Distributed Computing Anyone?

One approach is to use OpenPBS a portable batch system. It includes queueing, parallel processing, prioritization, and more. It is open source and works on Unix systems. There is a perl binding PBS::Client that provides a nice interface:
use PBS::Client; # Create a client object linked to a server my $client = PBS::Client->new; # Describe the job my $job = PBS::Client::Job->new( %job_options, # e.g. queue => 'queue_1', mem => '800 +mb' cmd => \@commands ); # Optionally, re-organize the commands to a number of queues $job->pack(numQ => $numQ); # Submit job $client->qsub($job);
Alternatively, a pure perl solution could be built around Schedule::Depend. Hmm, it was up to v. 2.6, but doesn't seem to be on CPAN any more...

Update: Fixed the OpenPBS link.


Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://548382]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others exploiting the Monastery: (4)
As of 2018-05-20 20:33 GMT
Find Nodes?
    Voting Booth?