Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re: Distributed Computing Anyone?

by kvale (Monsignor)
on May 10, 2006 at 04:21 UTC ( #548382=note: print w/ replies, xml ) Need Help??

in reply to Distributed Computing Anyone?

One approach is to use OpenPBS a portable batch system. It includes queueing, parallel processing, prioritization, and more. It is open source and works on Unix systems. There is a perl binding PBS::Client that provides a nice interface:

use PBS::Client; # Create a client object linked to a server my $client = PBS::Client->new; # Describe the job my $job = PBS::Client::Job->new( %job_options, # e.g. queue => 'queue_1', mem => '800 +mb' cmd => \@commands ); # Optionally, re-organize the commands to a number of queues $job->pack(numQ => $numQ); # Submit job $client->qsub($job);
Alternatively, a pure perl solution could be built around Schedule::Depend. Hmm, it was up to v. 2.6, but doesn't seem to be on CPAN any more...

Update: Fixed the OpenPBS link.


Comment on Re: Distributed Computing Anyone?
Download Code

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://548382]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (5)
As of 2016-02-09 23:19 GMT
Find Nodes?
    Voting Booth?

    How many photographs, souvenirs, artworks, trophies or other decorative objects are displayed in your home?

    Results (329 votes), past polls