Re^2: error 1073741819

[eversuhoshin]

I followed ur suggestion and used Devel::Trace. I found that code stops here after looping through many files. The perl script just goes through files and counts if certain words are present and then records the file names to a csv file. Here is the part that is causing the problem.

Again, the file runs fine up to a point that the csv file is about a size of 700KB and then dies

According to Devel::Trace this is where it stops

 if($data=~m/${query}/io) {
      $match_found=1;
      $fcount=()=$data=~m/(?^:\n.*(?:(?:(?:(?:authoritative|revenue\s+
+recognition|invaluable\s+practical|valuable|regulatory|technical|unde
+r\s+the|staff's|judicial|SEC|FDA|Treasury(?:\s+Department)?|specific|
+implementation|their|government|any\s+ruling|college|absent|\s+his|in
+terim|intrepretive|transition|administrative|procedural|related|appli
+cable|accounting|definitive|supreme\s+court|superceding|IRS|Internal\
+s+Revenue\s+Service|valued|EITF\s+accounting)|provides?\s+guidance\s+
+(?:on\s+(?:how)?|for)\s+(?:to\s+identify|uncertain\s+tax|whether)|(?:
+interpretation|permits|knowledge|regulations|successor\s+statutes|pol
+icy(?:\s+statements)?)\s+(?:or|\,)|board\s+will\s+continue\s+to\s+pro
+vide\s+guidance|guidance\s+requiring\s+the\s+credit|(?:directive|navi
+gation|exemption|practice|judgments|doctrine|forecast),|FD\s+Disclosu
+re\s+of\s+Form\s+8-K\s+in\s+accordance\s+with\s+guidance|guidance\s+d
+ocument\s+promulgated|seek\s+guidance\s+from|employee\s+handbook\s+fo
+r|(?:SAB\s+101|FIN\s+48|EITF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d?)\s+(?:
+also\s+)?provides\s+guidance(?:\s+on\s+whether|related)|Item\s+\d\d?\
+s+pursuant\s+to|(?:other|applicable)\s+guidance\s+issued|according\s+
+to\s+the\s+guidance\s+contained|provide\s+guidance\s+to\s+directors|r
+eceiving)\s+guidanc|(?:\"projection\"|\"intend\")(?:\s+and\s+|\,)"out
+look"|company\s+follows\s+the\s+guidance\s+of|guidance\s+should\s+be\
+s+applied\s+prospectively|provides\s+guidance\s+for\s+using\s+fair\s+
+valu)e|guidance\s+(?:(?:from\s+(?:the\s+)?(?:FDA|Financial\s+Accounti
+ng\s+Standards\s+Board)|(?:counsel|advice|information|circular|regula
+tion|code)\s+and|(?:prescribed|set\s+forth|issued)\s+by(?:\s+the\s+(?
+:Department|Treasury|AICPA|FASB|SEC))?|(?:action|policy|orders)\s+or)
+\s+guidance|(?:and\s+rules|promulgated(?:\s+thereunder)?|in\s+SFAS)|(
+?:provided|issued)\s+by\s+(?:the\s+)?(?:SEC|Securities\s+and\s+Exchan
+ge\s+Commission|Internal\s+Revenue\s+Service|Secretary|United\s+State
+s|Financial\s+Accounting)|(?:on|of|in)\s+(?:de\-recognition|APB\s+25|
+S?FAS\s+No\.\s+144|SFAS\s+No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP
+\s+90-7|Emerging\s+Issues|SAB\s+101|determining\s+whether\s+multiple)
+|(?:is\s+effective|which\s+allowed)|(?:comply\s+with\s+guidance\s+set
+\s+forth\s+by|guidance\s+available\s+from)\s+the\s+(?:treasury|intern
+al\s+revenue\s+service|IRS|SEC|FASB|AICPA)|disseminated\s+by\s+the\s+
+SEC|additional\s+guidance\s+to\s+physicians|FASB\s+issued\s+final\s+g
+uidance|informed\s+of\s+the\s+guidance\s+relating|on\s+(?:recognizing
+|the\s+application|the\s+identification|when\s+to\s+assess|accounting
+\s+for\s+revenue))|(?:regarding\s+management's\s+plans,\s+goals,\s+ex
+pectations,\s+guidance|To\s+obtain\s+guidance\s+on|for\s+additional\s
++guidance\s+on\s+which\s+number\s+to\s+repor|under\s+the\s+guidance\s
++and\s+(?:advice\s+of|Procedures|leadership|counsel|support)|company\
+s+follows\s+the\s+guidance\s+set\+forth\s+in\s+statemen|(?:future\s+s
+tatutes|ordinances|orders|rules|regulations),\s+guidance|pursuant\s+t
+o\s+SEC\s+guidance|Outlook\s+Pointe|guidance\s+line\s+of\s+credi)t|ou
+tlook\s+for\s+any\s+rating|(?:rating|if\s+on\s+negative|Microsoft|sug
+gesting\s+an|may\s+contain\s+statements\s+about\s+future\s+events\,|b
+usiness\s+conditions\s+and\s+the)\s+outlook|guidance\s+(?:to\s+approv
+e|facility)|the\s+guidance\s+from\s+the\s+OCA|Internal\s+Revenue\s+Se
+rvice\s+has\s+issued\s+guidance|(?:wisdom|technical\s+assistance|nece
+ssary\s+supervision|leadership)\s+and\s+guidances?|(?:current|other)\
+s+guidance\s+(?:under|from)|assumes\s+guidance\s+of\s+(?:the|a)\s+(?:
+company|board|talented\s+team|compensation)|guidance\s+(?:system|soft
+ware|technology)|forward\s+to\s+his\s+guidance|guidance\s+received\s+
+by\s+the\s+Company|section\s+409A\s+transition\s+guidance|absent\s+gu
+idance\s+from\s+the\s+(?:Commission|government)|Statements\s+in\s+thi
+s\s+press\s+release\s+concerning\s+the\s+company's\s+business\s+outlo
+ok|guidance\s+regarding\s+the\s+acceptance\s+of\s+gifts))
                  /xig;  
}

I built this regex using regex::assemble. Please let me know if there are better ways to speed up regex. Thank you again!

[BrowserUk]

Hm. You are not giving us accurate information. That regex is invalid and would never run. It stops immediately with:

Sequence (?^...) not recognized in regex; marked by <-- HERE in m/(?^ 
+<-- HERE :\n.*(? ...

Ie. The third character in the regex is a syntax error. There is no way for it to ever run, much less process many files correctly.

Surely you didn't type that lot in by hand instead of cutting and pasting? And if you cut and pasted, where is the Devel::Trace line information prefix?

[eversuhoshin]

Ok this is really weird but it runs in Komodo don't ask me how. The expression is what I got from using Regex::Assemble. Please let me know if there is something wrong with Komodo or the regex assemble.

use strict;
use Regexp::Assemble;

my $ra = Regexp::Assemble->new;
$ra->add( 'outlook\s+for\s+any\s+rating|(?:rating|if\s+on\s+negative|M
+icrosoft|suggesting\s+an|may\s+contain\s+statements\s+about\s+future\
+s+events\,|business\s+conditions\s+and\s+the)\s+outlook|guidance\s+(?
+:to\s+approve|facility)' );
$ra->add( '(?:authoritative|revenue\s+recognition|invaluable\s+practic
+al|valuable|regulatory|technical|under\s+the|staff\'s|judicial|SEC|FD
+A|Treasury(?:\s+Department)?|specific|implementation|their|government
+|any\s+ruling|college|absent|\s+his|interim|intrepretive|transition|a
+dministrative|procedural|related|applicable|accounting|definitive|sup
+reme\s+court|superceding|IRS|Internal\s+Revenue\s+Service|valued|EITF
+\s+accounting)\s+guidance' );
$ra->add( 'guidance\s+(?:and\s+rules|promulgated(?:\s+thereunder)?|in\
+s+SFAS)|(?:provided|issued)\s+by\s+(?:the\s+)?(?:SEC|Securities\s+and
+\s+Exchange\s+Commission|Internal\s+Revenue\s+Service|Secretary|Unite
+d\s+States|Financial\s+Accounting)' );
$ra->add( '(?:other|applicable)\s+guidance\s+issued|according\s+to\s+t
+he\s+guidance\s+contained|provide\s+guidance\s+to\s+directors|receivi
+ng\s+guidance' );
$ra->add( '(?:current|other)\s+guidance\s+(?:under|from)|assumes\s+gui
+dance\s+of\s+(?:the|a)\s+(?:company|board|talented\s+team|compensatio
+n)|guidance\s+(?:system|software|technology)' );
$ra->add( '(?:future\s+statutes|ordinances|orders|rules|regulations)\,
+\s+guidance|pursuant\s+to\s+SEC\s+guidance|Outlook\s+Pointe|guidance\
+s+line\s+of\s+credit' );
$ra->add( 'guidance\s+from\s+(?:the\s+)?(?:FDA|Financial\s+Accounting\
+s+Standards\s+Board)|(?:counsel|advice|information|circular|regulatio
+n|code)\s+and\s+guidance' );
$ra->add( 'forward\s+to\s+his\s+guidance|guidance\s+received\s+by\s+th
+e\s+Company|section\s+409A\s+transition\s+guidance|absent\s+guidance\
+s+from\s+the\s+Commission' );
$ra->add( 'the\s+guidance\s+from\s+the\s+OCA|Internal\s+Revenue\s+Serv
+ice\s+has\s+issued\s+guidance|(?:wisdom|technical\s+assistance|necess
+ary\s+supervision|leadership)\s+and\s+guidances?' );
$ra->add( 'guidance\s+(?:on|of|in)\s+(?:de\-recognition|APB\s+25|S?FAS
+\s+No\.\s+144|SFAS\s+No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP\s+90
+\-7|Emerging\s+Issues|SAB\s+101|determining\s+whether\s+multiple)' );
$ra->add( 'provides?\s+guidance\s+(?:on\s+(?:how)?|for)\s+(?:to\s+iden
+tify|uncertain\s+tax|whether)|(?:interpretation|permits|knowledge|reg
+ulations|successor\s+statutes|policy(?:\s+statements)?)\s+(?:or|\,)\s
++guidance' );
$ra->add( 'regarding\s+management\'s\s+plans\,\s+goals\,\s+expectation
+s\,\s+guidance|To\s+obtain\s+guidance\s+on|for\s+additional\s+guidanc
+e\s+on\s+which\s+number\s+to\s+report' );
$ra->add( 'FD\s+Disclosure\s+of\s+Form\s+8\-K\s+in\s+accordance\s+with
+\s+guidance|guidance\s+document\s+promulgated|seek\s+guidance\s+from|
+employee\s+handbook\s+for\s+guidance' );
$ra->add( '(?:SAB\s+101|FIN\s+48|EITF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d
+?)\s+(?:also\s+)?provides\s+guidance(?:\s+on\s+whether|related)|Item\
+s+\d\d?\s+pursuant\s+to\s+guidance' );
$ra->add( 'guidance\s+disseminated\s+by\s+the\s+SEC|additional\s+guida
+nce\s+to\s+physicians|FASB\s+issued\s+final\s+guidance|informed\s+of\
+s+the\s+guidance\s+relating' );
$ra->add( '(?:\"projection\"|\"intend\")(?:\s+and\s+|\,)\"outlook\"|co
+mpany\s+follows\s+the\s+guidance\s+of|guidance\s+should\s+be\s+applie
+d\s+prospectively|provides\s+guidance\s+for\s+using\s+fair\s+value' )
+;
$ra->add( 'under\s+the\s+guidance\s+and\s+(?:advice\s+of|Procedures|le
+adership|counsel|support)|company\s+follows\s+the\s+guidance\s+set\+f
+orth\s+in\s+statement' );
$ra->add( 'board\s+will\s+continue\s+to\s+provide\s+guidance|guidance\
+s+requiring\s+the\s+credit|(?:directive|navigation|exemption|practice
+|judgments|doctrine|forecast)\,\s+guidance' );
$ra->add( 'guidance\s+(?:is\s+effective|which\s+allowed)|(?:comply\s+w
+ith\s+guidance\s+set\s+forth\s+by|guidance\s+available\s+from)\s+the\
+s+(?:treasury|internal\s+revenue\s+service|IRS|SEC|FASB|AICPA)' );
$ra->add( 'guidance\s+(?:prescribed|set\s+forth|issued)\s+by(?:\s+the\
+s+(?:Department|Treasury|AICPA|FASB|SEC))?|(?:action|policy|orders)\s
++or\s+guidance' );
$ra->add( 'Statements\s+in\s+this\s+press\s+release\s+concerning\s+the
+\s+company\'s\s+business\s+outlook|guidance\s+regarding\s+the\s+accep
+tance\s+of\s+gifts');
$ra->add( 'guidance\s+on\s+(?:recognizing|the\s+application|the\s+iden
+tification|when\s+to\s+assess|accounting\s+for\s+revenue)');
print $ra->re;

thanks again for the quick response

[BrowserUk]

Again, you are not giving us accurate information. (Maybe because your tools are lying to you.)

When I run the above program, I get this output:

(?-xism:(?:(?:(?:(?:authoritative|revenue\s+recognition|invaluable\s+p
+ractical|valuable|regulatory|technical|under\s+the|staff's|judicial|S
+EC|FDA|Treasury(?:\s+Department)?|specific|implementation|their|gover
+nment|any\s+ruling|college|absent|\s+his|interim|intrepretive|transit
+ion|administrative|procedural|related|applicable|accounting|definitiv
+e|supreme\s+court|superceding|IRS|Internal\s+Revenue\s+Service|valued
+|EITF\s+accounting)|provides?\s+guidance\s+(?:on\s+(?:how)?|for)\s+(?
+:to\s+identify|uncertain\s+tax|whether)|(?:interpretation|permits|kno
+wledge|regulations|successor\s+statutes|policy(?:\s+statements)?)\s+(
+?:or|\,)|board\s+will\s+continue\s+to\s+provide\s+guidance|guidance\s
++requiring\s+the\s+credit|(?:directive|navigation|exemption|practice|
+judgments|doctrine|forecast),|FD\s+Disclosure\s+of\s+Form\s+8-K\s+in\
+s+accordance\s+with\s+guidance|guidance\s+document\s+promulgated|seek
+\s+guidance\s+from|employee\s+handbook\s+for|(?:SAB\s+101|FIN\s+48|EI
+TF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d?)\s+(?:also\s+)?provides\s+guidan
+ce(?:\s+on\s+whether|related)|Item\s+\d\d?\s+pursuant\s+to|(?:other|a
+pplicable)\s+guidance\s+issued|according\s+to\s+the\s+guidance\s+cont
+ained|provide\s+guidance\s+to\s+directors|receiving)\s+guidanc|(?:\"p
+rojection\"|\"intend\")(?:\s+and\s+|\,)"outlook"|company\s+follows\s+
+the\s+guidance\s+of|guidance\s+should\s+be\s+applied\s+prospectively|
+provides\s+guidance\s+for\s+using\s+fair\s+valu)e|guidance\s+(?:(?:fr
+om\s+(?:the\s+)?(?:FDA|Financial\s+Accounting\s+Standards\s+Board)|(?
+:counsel|advice|information|circular|regulation|code)\s+and|(?:prescr
+ibed|set\s+forth|issued)\s+by(?:\s+the\s+(?:Department|Treasury|AICPA
+|FASB|SEC))?|(?:action|policy|orders)\s+or)\s+guidance|(?:and\s+rules
+|promulgated(?:\s+thereunder)?|in\s+SFAS)|(?:provided|issued)\s+by\s+
+(?:the\s+)?(?:SEC|Securities\s+and\s+Exchange\s+Commission|Internal\s
++Revenue\s+Service|Secretary|United\s+States|Financial\s+Accounting)|
+(?:on|of|in)\s+(?:de\-recognition|APB\s+25|S?FAS\s+No\.\s+144|SFAS\s+
+No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP\s+90-7|Emerging\s+Issues|
+SAB\s+101|determining\s+whether\s+multiple)|(?:is\s+effective|which\s
++allowed)|(?:comply\s+with\s+guidance\s+set\s+forth\s+by|guidance\s+a
+vailable\s+from)\s+the\s+(?:treasury|internal\s+revenue\s+service|IRS
+|SEC|FASB|AICPA)|disseminated\s+by\s+the\s+SEC|additional\s+guidance\
+s+to\s+physicians|FASB\s+issued\s+final\s+guidance|informed\s+of\s+th
+e\s+guidance\s+relating|on\s+(?:recognizing|the\s+application|the\s+i
+dentification|when\s+to\s+assess|accounting\s+for\s+revenue))|(?:rega
+rding\s+management's\s+plans,\s+goals,\s+expectations,\s+guidance|To\
+s+obtain\s+guidance\s+on|for\s+additional\s+guidance\s+on\s+which\s+n
+umber\s+to\s+repor|under\s+the\s+guidance\s+and\s+(?:advice\s+of|Proc
+edures|leadership|counsel|support)|company\s+follows\s+the\s+guidance
+\s+set\+forth\s+in\s+statemen|(?:future\s+statutes|ordinances|orders|
+rules|regulations),\s+guidance|pursuant\s+to\s+SEC\s+guidance|Outlook
+\s+Pointe|guidance\s+line\s+of\s+credi)t|outlook\s+for\s+any\s+rating
+|(?:rating|if\s+on\s+negative|Microsoft|suggesting\s+an|may\s+contain
+\s+statements\s+about\s+future\s+events\,|business\s+conditions\s+and
+\s+the)\s+outlook|guidance\s+(?:to\s+approve|facility)|the\s+guidance
+\s+from\s+the\s+OCA|Internal\s+Revenue\s+Service\s+has\s+issued\s+gui
+dance|(?:wisdom|technical\s+assistance|necessary\s+supervision|leader
+ship)\s+and\s+guidances?|(?:current|other)\s+guidance\s+(?:under|from
+)|assumes\s+guidance\s+of\s+(?:the|a)\s+(?:company|board|talented\s+t
+eam|compensation)|guidance\s+(?:system|software|technology)|forward\s
++to\s+his\s+guidance|guidance\s+received\s+by\s+the\s+Company|section
+\s+409A\s+transition\s+guidance|absent\s+guidance\s+from\s+the\s+Comm
+ission|Statements\s+in\s+this\s+press\s+release\s+concerning\s+the\s+
+company's\s+business\s+outlook|guidance\s+regarding\s+the\s+acceptanc
+e\s+of\s+gifts))

And when I run that regex against a million word string, it runs perfectly.

At this point, I can only reiterate my earlier advises:

1. Stop running your code inside Komodo -- it appears to be lying to you.
2. Post real code and a small dataset that reproduces the problem -- outside of Komodo -- and you stand a chance of getting a solution.

Until then, I'm diagnosing this as a Komodo problem, which I cannot help you with, and which is beyond the scope of this forum.