comment on

Hello, I am reading in financial filings to see whether the information I need is in the financial filing. I used regex to get rid of those documents that I do not need to examine. My matching regex uses tons of "or" and counts up false positive words/ phrases. However, using lot of "or" slows perl down so much. I was wondering if there is a way to speed up the matching process. Thank you so much!

here is the code. I slurp the filing and then make into a one long line and then do the matching

   $fcount=()=$data=~m/outlook\s+for\s+any\s+rating|(?:rating|if\s+on\
+s+negative|Microsoft|suggesting\s+an|may\s+contain\s+statements\s+abo
+ut\s+future\s+events\,|business\s+conditions\s+and\s+the)\s+outlook|g
+uidance\s+(?:to\s+approve|facility)
                  |(?:authoritative|revenue\s+recognition|invaluable\s
++practical|valuable|regulatory|technical|under\s+the|staff\'s|judicia
+l|SEC|FDA|Treasury(?:\s+Department)?|specific|implementation|their|go
+vernment|any\s+ruling|college|absent|\s+his|interim|intrepretive|tran
+sition|administrative|procedural|related|applicable|accounting|defini
+tive|superceding|IRS|Internal\s+Revenue\s+Service|valued|EITF\s+accou
+nting)\s+guidance
                  |guidance\s+(?:and\s+rules|promulgated(?:\s+thereund
+er)?|in\s+SFAS)|(?:provided|issued)\s+by\s+(?:the\s+)?(?:SEC|Securiti
+es\s+and\s+Exchange\s+Commission|Internal\s+Revenue\s+Service|Secreta
+ry|United\s+States|Financial\s+Accounting)
                  |(?:other|applicable)\s+guidance\s+issued|according\
+s+to\s+the\s+guidance\s+contained|provide\s+guidance\s+to\s+directors
+|receiving\s+guidance
                  |(?:current|other)\s+guidance\s+(?:under|from)|assum
+es\s+guidance\s+of\s+(?:the|a)\s+(?:company|board|talented\s+team|com
+pensation)|guidance\s+(?:system|software|technology)
                  /xig;
[download]

In reply to Help with speeding up regex by eversuhoshin

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


P is for Practical
	PerlMonks