Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: Grid Engine

by gizmo_mathboy (Friar)
on May 18, 2009 at 03:35 UTC ( #764575=note: print w/replies, xml ) Need Help??


in reply to Grid Engine

Lots of questions I have before I can really make a good comment.

Are you talking about a job scheduler, resource manager or parallelization?

At work I use Torque for a resource manager, Maui for the scheduler (when I get it working) and typically MPI (various forks but I'm probably gonna settle on OpenMPI).

Are you submitting jobs to a queue?

Are you writing the software that is the job queue?

Are you running on a bunch of nodes/cores and what to parallelize things?

Replies are listed 'Best First'.
Re^2: Grid Engine
by baxy77bax (Chaplain) on May 18, 2009 at 10:22 UTC
    "Are you talking about a job scheduler, resource manager or parallelization?"

    well i'm talking about the whole thing, i think it is pretty resource wasteful and jobs are poorly distributed . it eats too much of my resources, so sometimes i just log on directly to each node and start my job's manually.

    the answer to your other 3 questions are

    Yes

    Yes

    Yes

    my colleges and me are doing all those things :)

      It might not be Perl, but from what you're mentioning about wasting resources, you might want to look at Alan Sussman's work on P2PGrid ... I saw the 2006 presentation, and he was working on having the programs register what resources they need (so they'd be assigned to appropriate machines ... so you didn't waste the machines w/ 32GB of RAM on something that only needed CPU time, not memory)

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://764575]
help
Chatterbox?
[ambrus]: No, you're not doing anything wrong. It's just that our automatic spam filters confuse you with the spammers who post advertisments for online shops of counterfeit branded clothing.
[ambrus]: Or unless you left the title field empty or entered a very short title for the node, but then you'd get a message saying that.
[ambrus]: I hope Corion or some other admin is here and can check the logs to see what the problem is.
[mz2255]: I wish I had an online shop but sadly no. The title field definitly wasn't short, had a perl module in the title with 5-6 additional words.
[ambrus]: you can also try to just post again in case it was some intermittent error

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (12)
As of 2017-10-19 15:34 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My fridge is mostly full of:

















    Results (255 votes). Check out past polls.

    Notices?