You really are incapable of taking a hint! I've ignored your posts on this subject because they are irrelevant to my problem!

This is a research project; nothing to do with "production".

It will never "run out of ram" or move into swapping because the size of the -- runtime generated -- dataset is controlled by a command line parameter; which will be set specifically to prevent that.

It will only ever run on research hardware. Currently my machine during development; but once optimised, on a whole bunch of purchased cloud instances specially configured for research purposes!

Probably, though it depends on which cloud provider is offering the best terms at the time, AWS EC2 R3.8xlarge instances.

A few noteable highlights: "r3.8xlarge 32 cores 244 GiB ram 2 x 320 SSD".

And:

Use Cases: We recommend memory-optimized instances for high performance databases, distributed memory caches, in-memory analytics, genome assembly and analysis, larger deployments of SAP, Microsoft SharePoint, and other enterprise applications.

And no amount of you banging on about ancient history, extant wisdoms nor inapplicable generic truths changes the fact that I know my problem space and its requirements; and you know nothing.

(About this or anything contemporary or useful!)


(After all, magnetic doughnuts could be made only so small, and they had to be strung upon three tiny wires by hand.)

And that really explains the Sundial in your user handle and company name:

Sundial; as-in antiquated technology that was grossly inaccurate, and only came close to being correct about twice a year

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.

In reply to Re: RAM: It isn't free . . . (No, but its damn cheap!) by BrowserUk
in thread RAM: It isn't free . . . by sundialsvc4

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post; it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.