Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re: Multiple substitutions in large files

by ikegami (Pope)
on May 09, 2005 at 14:58 UTC ( #455196=note: print w/replies, xml ) Need Help??

in reply to Multiple substitutions in large files

a|b||d becomes a|b|\N|d
|b|c|d becomes \N|b|c|d
a|b|c| becomes a|b|c|\N
and similarly,
a|b|.|d becomes a|b|\N|d
.|b|c|d does not become \N|b|c|d
a|b|c|. does not become a|b|c|\N
Is that a bug?

If the above is a bug, the following regexps are probably faster:

s/\s*\|\s*/\|/g; s/^\.?(?=\|)/\\N/; s/(?<=\|)\.?(?=\||$)/\\N/g; s/(?<=\d{2}:\d{2}:\d{2})\.\d+//g; s/(?<=\d{5})-(?:\d{1,4}|\s+)//;

If the above is not a bug, the following regexps are probably faster:

s/\s*\|\s*/\|/g; s/^(?=\|)/\\N/; s/(?<=\|)(?=\||$)/\\N/g; s/(?<=\|)\.(?=\|)/\\N/g; s/(?<=\d{2}:\d{2}:\d{2})\.\d+//g; s/(?<=\d{5})-(?:\d{1,4}|\s+)//;

I reduced the number of regexps by combining a few, I shortened the regexps by removing the spaces first (not last), and I used zero-widths positive lookaheads and lookbehinds to mimimze the text being captured and substituted.

Use this in conjuction with the -p or -pi suggestion for better results.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://455196]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (4)
As of 2020-11-24 04:59 GMT
Find Nodes?
    Voting Booth?

    No recent polls found