in reply to Multithreading leading to Out of Memory error
There is simply not enough information here to judge whether you've encountered one of the (increasingly rare) thread memory leaks, or if your ParseXXX() routines are just badly coded. Any conclusions or recommendations based on the scant information you've posted will be premature; and likely wrong.
If you want real answers and solutions; post the real code.
How many files does that 231GB dataset contain?
With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
In Section
Seekers of Perl Wisdom