Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re: HPC Computing Question

by monkey_boy (Curate)
on Jun 21, 2014 at 11:31 UTC ( #1090759=note: print w/ replies, xml ) Need Help??


in reply to HPC Computing Question

I think you are barking up the wrong tree. I haven't used SGE for a number of years, but in its earlier incarnations, there was no concept of shared threads/memory BETWEEN nodes. The usual way you utilize the nodes is to write code such that smaller sections of data can be calculated independently. A usuall example is a script that takes a data file, then does some calculations upon it. Then, if we have 100 data files (e.g. numbered 1.txt .. 100.txt), we can:

qsub -t 1-100 myscript.pl
An in the code
open (my $fh , "<", $ENV{SGE_TASK_ID}.".txt") or die $!; etc ...
SGE then in your case would divide each task to a node as it sees fit (dependent on how the SGE is configured). Hope this helps.


This is not a Signature...


Comment on Re: HPC Computing Question
Select or Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1090759]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (7)
As of 2014-12-25 23:05 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (163 votes), past polls