Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change

RE: RE: Schwartzian Transform

by chromatic (Archbishop)
on Apr 26, 2000 at 19:01 UTC ( #9246=note: print w/ replies, xml ) Need Help??

in reply to RE: Schwartzian Transform
in thread Schwartzian Transform

Use a tied array (@input) that operates on a disk file?

Comment on RE: RE: Schwartzian Transform
RE: RE: RE: Schwartzian Transform
by perlcgi (Hermit) on Apr 26, 2000 at 20:30 UTC
    Thanks chromatic, Despite the tie of @input, should not the list of references to lists overflow with very large files. Also should @a and @b be tied and what about the anonymous array. Is it possible to tie anonymous arrays, and if so would it, and the all the others require serialization? TIA
RE (tilly) 3: Schwartzian Transform
by tilly (Archbishop) on Aug 17, 2000 at 18:04 UTC

    First of all mixing references and arrays tied to disk without thinking carefully about it is asking for serious problems.

    Secondly passing the array to Perl's sort function is asking for very serious trouble. That will pass it all into memory!

    What I would do for large data structures would be to use DB_File to tie a hash to a BTree, and use properly formatted strings as keys. Blech. But it will work up to the maximum file size for your OS. (OK, up to about half that - BTrees waste something like 40% of the space in the tree.) Or use a proper database.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://9246]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (5)
As of 2015-03-29 08:26 GMT
Find Nodes?
    Voting Booth?

    When putting a smiley right before a closing parenthesis, do you:

    Results (630 votes), past polls