Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Using Multiple m/\G.../gc to Tokenize

by ikegami (Pope)
on Apr 07, 2005 at 17:28 UTC ( #445804=note: print w/replies, xml ) Need Help??


in reply to Interpolate Text Not Inside a Certain Tag

An easily extendable solution:

{ for ($text) { # Alias $_ to $text. /\G `` (.*?) `` /gcsx && do { print($1 ); redo }; /\G \*\* (.*?) \*\* /gcsx && do { print("<b>$1</b>"); redo }; /\G ( . # Catchall. (?: # These four lines are optional. (?!``) # They are here to speed things up (?!\*\*) # by avoiding calling print for .)* # single characters. ) /gcsx && do { print($1); redo }; } }

Handles mismatched ** and `` by treating them as normal characters.

Update:

  • Removed "\n"s from prints.
  • Added /s option to regexps, since I'm guessing newlines are not special.
  • The 1st .*? was ((?:(?!``).)*
  • The 2nd .*? was ((?:(?!\*\*).)*

Tested:

foreach ( '**bold**', '``**bold**``', '**``bold``**', '**bold** test ** test', '``text`` test `` test', ) { print('in: ', $_, $/, 'out: '); TOKENIZER: { ... } print($/, $/); } __END__ in: **bold** out: <b>bold</b> in: ``**bold**`` out: **bold** in: **``bold``** out: <b>``bold``</b> in: **bold** test ** test out: <b>bold</b> test ** test in: ``text`` test `` test out: text test `` test

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://445804]
help
Chatterbox?
[choroba]: Tire chains are mandatory here in mountains, and the only unprepared each year are gritters
[stevieb]: I have a 3 day winter survival kit in my vehicle in the event I get snowed in in the mountains (which has happened before due to avalanches closing the roads (and once in the summer due to a massive forest fire that trapped us
[perldigious]: a handful of people in my work area did not make it, but I live pretty close and it's flat the whole way, so I didn't have any trouble. The roundabout is the worst thing I have to negotiate.
[thezip]: G'day all!
[perldigious]: Well, that and dodging the people who forget how ice works right away. :-)
[stevieb]: hey, thezip
[perldigious]: I don't miss having to drive up and down in elevation on roads that are iced over, I white knuckled gripping the steering wheel every time I had to where I used to live.
[perldigious]: So I don't envy you mountain guys if you have to drive in the winter, even with tire chains.
MidLifeXis waves.

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (10)
As of 2016-12-06 16:40 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    On a regular basis, I'm most likely to spy upon:













    Results (112 votes). Check out past polls.