|Perl: the Markov chain saw|
Parse string greater than 2GBby BigHoss (Initiate)
|on Jun 30, 2013 at 01:13 UTC||Need Help??|
BigHoss has asked for the
wisdom of the Perl Monks concerning the following question:
I need to parse a string which is larger than 2GB. Unfortunately "split()" fails with a "Split loop" error.
Looking for an alternate. Here is the minimized test case. due to the nature of the original code, the "read()" of the file cannot be changed.thanks in advance for any help...
To clarify, this is trimmed down from the original to illustrate the problem with split.
I can only modify "BigParse". I have no control of the strings passed in.
The real code processes each split until end of data. The print statement in the loop is just to trim down the code.
Perl version: 5.12.4
Data File is binary file with embedded newline characters "\n".