Re: Making this script process 56,000 lines 5 times faster

in reply to Making this script process 56,000 lines 5 times faster

To me it seems that by rebuilding grep's and awk's "line-by-line" processing you are taking Perl's drawbacks(starting the interpreter) but you don't profit from its power.

Why not loop over the response directly using the /g modifier:

while($response =~ /(\n0\.0\.0\.0)(\s)([\w\.]+?)\s+/g )
{
    print ".... $3 ...";
}
[download]

Comment on Re: Making this script process 56,000 lines 5 times faster Download Code

Replies are listed 'Best First'.
Re^2: Making this script process 56,000 lines 5 times faster by kris004 (Initiate) on Mar 22, 2018 at 18:23 UTC
Hi, thank you for this tip, it makes sense as long as I'm not worried about running out of memory.	[reply]
Re^3: Making this script process 56,000 lines 5 times faster by LanX (Saint) on Mar 22, 2018 at 18:49 UTC
> as long as I'm not worried about running out of memory. Where do you see a memory problem here? Cheers Rolf _{(addicted to the Perl Programming Language and ☆☆☆☆ :) Wikisyntax for the Monastery}	[reply]
Re^4: Making this script process 56,000 lines 5 times faster by kris004 (Initiate) on Mar 22, 2018 at 18:53 UTC
If I say, read in a 4gb file. Not really a problem with this hosts file. I assumed that if it wasn't line by line, then the whole file would have to be loaded into memory.	[reply]
Re^5: Making this script process 56,000 lines 5 times faster by LanX (Saint) on Mar 22, 2018 at 18:58 UTC
Re^6: Making this script process 56,000 lines 5 times faster by kris004 (Initiate) on Mar 22, 2018 at 19:03 UTC

In Section Seekers of Perl Wisdom