http://www.perlmonks.org?node_id=1039685


in reply to Re: Edit huge file
in thread Edit huge file

Disclaimer: I have limited experience with Tie::File, so not sure how it performs w/ larger files.

Horribly!


With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.

Replies are listed 'Best First'.
Re^3: Edit huge file
by frozenwithjoy (Priest) on Jun 19, 2013 at 00:49 UTC
    Thanks. For my own future reference, do you have a suggestion for a file size that is too large to use with Tie::File?

      Hm. Say 1000 lines/100kB.

      Its actually not too bad for files ~10x that iff you know

      1. how it works:

        An LRU cache of limited size:

      2. what not to do:

        Don't use @theArray in either a list or scalar context;

      3. configure it correctly:

        The memory and dw_size options can interact in interesting but unintuitive ways.

        Bigger is not always better, especially if the predominant operations are deletion or insertion of whole lines, rather than in-place modification of existing lines.


      With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
      Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
      "Science is about questioning the status quo. Questioning authority".
      In the absence of evidence, opinion is indistinguishable from prejudice.