Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re: About text file parsing

by TheloniusMonk (Sexton)
on Aug 29, 2018 at 08:31 UTC ( #1221294=note: print w/replies, xml ) Need Help??


in reply to About text file parsing

Your arrays might occupy gigs of virtual memory, which might be too much for your machine. Also there are overheads for the internal format in which Perl stores arrays. You might be better off creating a RAM drive to store these as files in memory, so that a specific amount of memory is reserved in advance and it is less memory than is required for Perl arrays. It depends on your OS how to achieve this. And any solution also depends on what you are about to do with these arrays.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1221294]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (6)
As of 2020-12-03 02:05 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    How often do you use taint mode?





    Results (49 votes). Check out past polls.

    Notices?