Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw

Re: Split 2GB file and parsing

by clueless newbie (Chaplain)
on Nov 01, 2007 at 17:11 UTC ( #648517=note: print w/replies, xml ) Need Help??

in reply to Split 2GB file and parsing

May a clueless newbie point out that he's reading a dump of a database? Perhaps it might be better to process the data one database record at a time?

Replies are listed 'Best First'.
Re^2: Split 2GB file and parsing
by Jenda (Abbot) on Nov 01, 2007 at 19:29 UTC

    Which might mean one line at a time or virtualy anything else. In what format is the dump? Tab separated? CSV? What about newlines in the data? Or is it XML? Or? Or? "Database dump" doesn't really say much more than "file". We are shooting in the dark.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://648517]
and cookies bake in the oven...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (5)
As of 2018-06-23 11:05 GMT
Find Nodes?
    Voting Booth?
    Should cpanminus be part of the standard Perl release?

    Results (125 votes). Check out past polls.