Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Using Multiple m/\G.../gc to Tokenize

by ikegami (Pope)
on Apr 07, 2005 at 17:28 UTC ( #445804=note: print w/ replies, xml ) Need Help??


in reply to Interpolate Text Not Inside a Certain Tag

An easily extendable solution:

{ for ($text) { # Alias $_ to $text. /\G `` (.*?) `` /gcsx && do { print($1 ); redo }; /\G \*\* (.*?) \*\* /gcsx && do { print("<b>$1</b>"); redo }; /\G ( . # Catchall. (?: # These four lines are optional. (?!``) # They are here to speed things up (?!\*\*) # by avoiding calling print for .)* # single characters. ) /gcsx && do { print($1); redo }; } }

Handles mismatched ** and `` by treating them as normal characters.

Update:

  • Removed "\n"s from prints.
  • Added /s option to regexps, since I'm guessing newlines are not special.
  • The 1st .*? was ((?:(?!``).)*
  • The 2nd .*? was ((?:(?!\*\*).)*

Tested:

foreach ( '**bold**', '``**bold**``', '**``bold``**', '**bold** test ** test', '``text`` test `` test', ) { print('in: ', $_, $/, 'out: '); TOKENIZER: { ... } print($/, $/); } __END__ in: **bold** out: <b>bold</b> in: ``**bold**`` out: **bold** in: **``bold``** out: <b>``bold``</b> in: **bold** test ** test out: <b>bold</b> test ** test in: ``text`` test `` test out: text test `` test


Comment on Using Multiple m/\G.../gc to Tokenize
Select or Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://445804]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (20)
As of 2015-07-06 20:22 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (83 votes), past polls