Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re^2: error 1073741819

by eversuhoshin (Sexton)
on Aug 20, 2012 at 02:13 UTC ( #988375=note: print w/ replies, xml ) Need Help??


in reply to Re: error 1073741819
in thread error 1073741819

I followed ur suggestion and used Devel::Trace. I found that code stops here after looping through many files. The perl script just goes through files and counts if certain words are present and then records the file names to a csv file. Here is the part that is causing the problem.

Again, the file runs fine up to a point that the csv file is about a size of 700KB and then dies

According to Devel::Trace this is where it stops

if($data=~m/${query}/io) { $match_found=1; $fcount=()=$data=~m/(?^:\n.*(?:(?:(?:(?:authoritative|revenue\s+ +recognition|invaluable\s+practical|valuable|regulatory|technical|unde +r\s+the|staff's|judicial|SEC|FDA|Treasury(?:\s+Department)?|specific| +implementation|their|government|any\s+ruling|college|absent|\s+his|in +terim|intrepretive|transition|administrative|procedural|related|appli +cable|accounting|definitive|supreme\s+court|superceding|IRS|Internal\ +s+Revenue\s+Service|valued|EITF\s+accounting)|provides?\s+guidance\s+ +(?:on\s+(?:how)?|for)\s+(?:to\s+identify|uncertain\s+tax|whether)|(?: +interpretation|permits|knowledge|regulations|successor\s+statutes|pol +icy(?:\s+statements)?)\s+(?:or|\,)|board\s+will\s+continue\s+to\s+pro +vide\s+guidance|guidance\s+requiring\s+the\s+credit|(?:directive|navi +gation|exemption|practice|judgments|doctrine|forecast),|FD\s+Disclosu +re\s+of\s+Form\s+8-K\s+in\s+accordance\s+with\s+guidance|guidance\s+d +ocument\s+promulgated|seek\s+guidance\s+from|employee\s+handbook\s+fo +r|(?:SAB\s+101|FIN\s+48|EITF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d?)\s+(?: +also\s+)?provides\s+guidance(?:\s+on\s+whether|related)|Item\s+\d\d?\ +s+pursuant\s+to|(?:other|applicable)\s+guidance\s+issued|according\s+ +to\s+the\s+guidance\s+contained|provide\s+guidance\s+to\s+directors|r +eceiving)\s+guidanc|(?:\"projection\"|\"intend\")(?:\s+and\s+|\,)"out +look"|company\s+follows\s+the\s+guidance\s+of|guidance\s+should\s+be\ +s+applied\s+prospectively|provides\s+guidance\s+for\s+using\s+fair\s+ +valu)e|guidance\s+(?:(?:from\s+(?:the\s+)?(?:FDA|Financial\s+Accounti +ng\s+Standards\s+Board)|(?:counsel|advice|information|circular|regula +tion|code)\s+and|(?:prescribed|set\s+forth|issued)\s+by(?:\s+the\s+(? +:Department|Treasury|AICPA|FASB|SEC))?|(?:action|policy|orders)\s+or) +\s+guidance|(?:and\s+rules|promulgated(?:\s+thereunder)?|in\s+SFAS)|( +?:provided|issued)\s+by\s+(?:the\s+)?(?:SEC|Securities\s+and\s+Exchan +ge\s+Commission|Internal\s+Revenue\s+Service|Secretary|United\s+State +s|Financial\s+Accounting)|(?:on|of|in)\s+(?:de\-recognition|APB\s+25| +S?FAS\s+No\.\s+144|SFAS\s+No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP +\s+90-7|Emerging\s+Issues|SAB\s+101|determining\s+whether\s+multiple) +|(?:is\s+effective|which\s+allowed)|(?:comply\s+with\s+guidance\s+set +\s+forth\s+by|guidance\s+available\s+from)\s+the\s+(?:treasury|intern +al\s+revenue\s+service|IRS|SEC|FASB|AICPA)|disseminated\s+by\s+the\s+ +SEC|additional\s+guidance\s+to\s+physicians|FASB\s+issued\s+final\s+g +uidance|informed\s+of\s+the\s+guidance\s+relating|on\s+(?:recognizing +|the\s+application|the\s+identification|when\s+to\s+assess|accounting +\s+for\s+revenue))|(?:regarding\s+management's\s+plans,\s+goals,\s+ex +pectations,\s+guidance|To\s+obtain\s+guidance\s+on|for\s+additional\s ++guidance\s+on\s+which\s+number\s+to\s+repor|under\s+the\s+guidance\s ++and\s+(?:advice\s+of|Procedures|leadership|counsel|support)|company\ +s+follows\s+the\s+guidance\s+set\+forth\s+in\s+statemen|(?:future\s+s +tatutes|ordinances|orders|rules|regulations),\s+guidance|pursuant\s+t +o\s+SEC\s+guidance|Outlook\s+Pointe|guidance\s+line\s+of\s+credi)t|ou +tlook\s+for\s+any\s+rating|(?:rating|if\s+on\s+negative|Microsoft|sug +gesting\s+an|may\s+contain\s+statements\s+about\s+future\s+events\,|b +usiness\s+conditions\s+and\s+the)\s+outlook|guidance\s+(?:to\s+approv +e|facility)|the\s+guidance\s+from\s+the\s+OCA|Internal\s+Revenue\s+Se +rvice\s+has\s+issued\s+guidance|(?:wisdom|technical\s+assistance|nece +ssary\s+supervision|leadership)\s+and\s+guidances?|(?:current|other)\ +s+guidance\s+(?:under|from)|assumes\s+guidance\s+of\s+(?:the|a)\s+(?: +company|board|talented\s+team|compensation)|guidance\s+(?:system|soft +ware|technology)|forward\s+to\s+his\s+guidance|guidance\s+received\s+ +by\s+the\s+Company|section\s+409A\s+transition\s+guidance|absent\s+gu +idance\s+from\s+the\s+(?:Commission|government)|Statements\s+in\s+thi +s\s+press\s+release\s+concerning\s+the\s+company's\s+business\s+outlo +ok|guidance\s+regarding\s+the\s+acceptance\s+of\s+gifts)) /xig; }

I built this regex using regex::assemble. Please let me know if there are better ways to speed up regex. Thank you again!


Comment on Re^2: error 1073741819
Download Code
Re^3: error 1073741819
by BrowserUk (Pope) on Aug 20, 2012 at 02:33 UTC

    Hm. You are not giving us accurate information. That regex is invalid and would never run. It stops immediately with:

    Sequence (?^...) not recognized in regex; marked by <-- HERE in m/(?^ +<-- HERE :\n.*(? ...

    Ie. The third character in the regex is a syntax error. There is no way for it to ever run, much less process many files correctly.

    Surely you didn't type that lot in by hand instead of cutting and pasting? And if you cut and pasted, where is the Devel::Trace line information prefix?


    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

    The start of some sanity?

      Ok this is really weird but it runs in Komodo don't ask me how. The expression is what I got from using Regex::Assemble. Please let me know if there is something wrong with Komodo or the regex assemble.

      use strict; use Regexp::Assemble; my $ra = Regexp::Assemble->new; $ra->add( 'outlook\s+for\s+any\s+rating|(?:rating|if\s+on\s+negative|M +icrosoft|suggesting\s+an|may\s+contain\s+statements\s+about\s+future\ +s+events\,|business\s+conditions\s+and\s+the)\s+outlook|guidance\s+(? +:to\s+approve|facility)' ); $ra->add( '(?:authoritative|revenue\s+recognition|invaluable\s+practic +al|valuable|regulatory|technical|under\s+the|staff\'s|judicial|SEC|FD +A|Treasury(?:\s+Department)?|specific|implementation|their|government +|any\s+ruling|college|absent|\s+his|interim|intrepretive|transition|a +dministrative|procedural|related|applicable|accounting|definitive|sup +reme\s+court|superceding|IRS|Internal\s+Revenue\s+Service|valued|EITF +\s+accounting)\s+guidance' ); $ra->add( 'guidance\s+(?:and\s+rules|promulgated(?:\s+thereunder)?|in\ +s+SFAS)|(?:provided|issued)\s+by\s+(?:the\s+)?(?:SEC|Securities\s+and +\s+Exchange\s+Commission|Internal\s+Revenue\s+Service|Secretary|Unite +d\s+States|Financial\s+Accounting)' ); $ra->add( '(?:other|applicable)\s+guidance\s+issued|according\s+to\s+t +he\s+guidance\s+contained|provide\s+guidance\s+to\s+directors|receivi +ng\s+guidance' ); $ra->add( '(?:current|other)\s+guidance\s+(?:under|from)|assumes\s+gui +dance\s+of\s+(?:the|a)\s+(?:company|board|talented\s+team|compensatio +n)|guidance\s+(?:system|software|technology)' ); $ra->add( '(?:future\s+statutes|ordinances|orders|rules|regulations)\, +\s+guidance|pursuant\s+to\s+SEC\s+guidance|Outlook\s+Pointe|guidance\ +s+line\s+of\s+credit' ); $ra->add( 'guidance\s+from\s+(?:the\s+)?(?:FDA|Financial\s+Accounting\ +s+Standards\s+Board)|(?:counsel|advice|information|circular|regulatio +n|code)\s+and\s+guidance' ); $ra->add( 'forward\s+to\s+his\s+guidance|guidance\s+received\s+by\s+th +e\s+Company|section\s+409A\s+transition\s+guidance|absent\s+guidance\ +s+from\s+the\s+Commission' ); $ra->add( 'the\s+guidance\s+from\s+the\s+OCA|Internal\s+Revenue\s+Serv +ice\s+has\s+issued\s+guidance|(?:wisdom|technical\s+assistance|necess +ary\s+supervision|leadership)\s+and\s+guidances?' ); $ra->add( 'guidance\s+(?:on|of|in)\s+(?:de\-recognition|APB\s+25|S?FAS +\s+No\.\s+144|SFAS\s+No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP\s+90 +\-7|Emerging\s+Issues|SAB\s+101|determining\s+whether\s+multiple)' ); $ra->add( 'provides?\s+guidance\s+(?:on\s+(?:how)?|for)\s+(?:to\s+iden +tify|uncertain\s+tax|whether)|(?:interpretation|permits|knowledge|reg +ulations|successor\s+statutes|policy(?:\s+statements)?)\s+(?:or|\,)\s ++guidance' ); $ra->add( 'regarding\s+management\'s\s+plans\,\s+goals\,\s+expectation +s\,\s+guidance|To\s+obtain\s+guidance\s+on|for\s+additional\s+guidanc +e\s+on\s+which\s+number\s+to\s+report' ); $ra->add( 'FD\s+Disclosure\s+of\s+Form\s+8\-K\s+in\s+accordance\s+with +\s+guidance|guidance\s+document\s+promulgated|seek\s+guidance\s+from| +employee\s+handbook\s+for\s+guidance' ); $ra->add( '(?:SAB\s+101|FIN\s+48|EITF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d +?)\s+(?:also\s+)?provides\s+guidance(?:\s+on\s+whether|related)|Item\ +s+\d\d?\s+pursuant\s+to\s+guidance' ); $ra->add( 'guidance\s+disseminated\s+by\s+the\s+SEC|additional\s+guida +nce\s+to\s+physicians|FASB\s+issued\s+final\s+guidance|informed\s+of\ +s+the\s+guidance\s+relating' ); $ra->add( '(?:\"projection\"|\"intend\")(?:\s+and\s+|\,)\"outlook\"|co +mpany\s+follows\s+the\s+guidance\s+of|guidance\s+should\s+be\s+applie +d\s+prospectively|provides\s+guidance\s+for\s+using\s+fair\s+value' ) +; $ra->add( 'under\s+the\s+guidance\s+and\s+(?:advice\s+of|Procedures|le +adership|counsel|support)|company\s+follows\s+the\s+guidance\s+set\+f +orth\s+in\s+statement' ); $ra->add( 'board\s+will\s+continue\s+to\s+provide\s+guidance|guidance\ +s+requiring\s+the\s+credit|(?:directive|navigation|exemption|practice +|judgments|doctrine|forecast)\,\s+guidance' ); $ra->add( 'guidance\s+(?:is\s+effective|which\s+allowed)|(?:comply\s+w +ith\s+guidance\s+set\s+forth\s+by|guidance\s+available\s+from)\s+the\ +s+(?:treasury|internal\s+revenue\s+service|IRS|SEC|FASB|AICPA)' ); $ra->add( 'guidance\s+(?:prescribed|set\s+forth|issued)\s+by(?:\s+the\ +s+(?:Department|Treasury|AICPA|FASB|SEC))?|(?:action|policy|orders)\s ++or\s+guidance' ); $ra->add( 'Statements\s+in\s+this\s+press\s+release\s+concerning\s+the +\s+company\'s\s+business\s+outlook|guidance\s+regarding\s+the\s+accep +tance\s+of\s+gifts'); $ra->add( 'guidance\s+on\s+(?:recognizing|the\s+application|the\s+iden +tification|when\s+to\s+assess|accounting\s+for\s+revenue)'); print $ra->re;

      thanks again for the quick response

        Again, you are not giving us accurate information. (Maybe because your tools are lying to you.)

        When I run the above program, I get this output:

        (?-xism:(?:(?:(?:(?:authoritative|revenue\s+recognition|invaluable\s+p +ractical|valuable|regulatory|technical|under\s+the|staff's|judicial|S +EC|FDA|Treasury(?:\s+Department)?|specific|implementation|their|gover +nment|any\s+ruling|college|absent|\s+his|interim|intrepretive|transit +ion|administrative|procedural|related|applicable|accounting|definitiv +e|supreme\s+court|superceding|IRS|Internal\s+Revenue\s+Service|valued +|EITF\s+accounting)|provides?\s+guidance\s+(?:on\s+(?:how)?|for)\s+(? +:to\s+identify|uncertain\s+tax|whether)|(?:interpretation|permits|kno +wledge|regulations|successor\s+statutes|policy(?:\s+statements)?)\s+( +?:or|\,)|board\s+will\s+continue\s+to\s+provide\s+guidance|guidance\s ++requiring\s+the\s+credit|(?:directive|navigation|exemption|practice| +judgments|doctrine|forecast),|FD\s+Disclosure\s+of\s+Form\s+8-K\s+in\ +s+accordance\s+with\s+guidance|guidance\s+document\s+promulgated|seek +\s+guidance\s+from|employee\s+handbook\s+for|(?:SAB\s+101|FIN\s+48|EI +TF\s+00\-14|SOP98\-\d|SFAS\s+\d\d\d?)\s+(?:also\s+)?provides\s+guidan +ce(?:\s+on\s+whether|related)|Item\s+\d\d?\s+pursuant\s+to|(?:other|a +pplicable)\s+guidance\s+issued|according\s+to\s+the\s+guidance\s+cont +ained|provide\s+guidance\s+to\s+directors|receiving)\s+guidanc|(?:\"p +rojection\"|\"intend\")(?:\s+and\s+|\,)"outlook"|company\s+follows\s+ +the\s+guidance\s+of|guidance\s+should\s+be\s+applied\s+prospectively| +provides\s+guidance\s+for\s+using\s+fair\s+valu)e|guidance\s+(?:(?:fr +om\s+(?:the\s+)?(?:FDA|Financial\s+Accounting\s+Standards\s+Board)|(? +:counsel|advice|information|circular|regulation|code)\s+and|(?:prescr +ibed|set\s+forth|issued)\s+by(?:\s+the\s+(?:Department|Treasury|AICPA +|FASB|SEC))?|(?:action|policy|orders)\s+or)\s+guidance|(?:and\s+rules +|promulgated(?:\s+thereunder)?|in\s+SFAS)|(?:provided|issued)\s+by\s+ +(?:the\s+)?(?:SEC|Securities\s+and\s+Exchange\s+Commission|Internal\s ++Revenue\s+Service|Secretary|United\s+States|Financial\s+Accounting)| +(?:on|of|in)\s+(?:de\-recognition|APB\s+25|S?FAS\s+No\.\s+144|SFAS\s+ +No\.\s+(?:150|13|123)|ARB|SEC\s+Release|SOP\s+90-7|Emerging\s+Issues| +SAB\s+101|determining\s+whether\s+multiple)|(?:is\s+effective|which\s ++allowed)|(?:comply\s+with\s+guidance\s+set\s+forth\s+by|guidance\s+a +vailable\s+from)\s+the\s+(?:treasury|internal\s+revenue\s+service|IRS +|SEC|FASB|AICPA)|disseminated\s+by\s+the\s+SEC|additional\s+guidance\ +s+to\s+physicians|FASB\s+issued\s+final\s+guidance|informed\s+of\s+th +e\s+guidance\s+relating|on\s+(?:recognizing|the\s+application|the\s+i +dentification|when\s+to\s+assess|accounting\s+for\s+revenue))|(?:rega +rding\s+management's\s+plans,\s+goals,\s+expectations,\s+guidance|To\ +s+obtain\s+guidance\s+on|for\s+additional\s+guidance\s+on\s+which\s+n +umber\s+to\s+repor|under\s+the\s+guidance\s+and\s+(?:advice\s+of|Proc +edures|leadership|counsel|support)|company\s+follows\s+the\s+guidance +\s+set\+forth\s+in\s+statemen|(?:future\s+statutes|ordinances|orders| +rules|regulations),\s+guidance|pursuant\s+to\s+SEC\s+guidance|Outlook +\s+Pointe|guidance\s+line\s+of\s+credi)t|outlook\s+for\s+any\s+rating +|(?:rating|if\s+on\s+negative|Microsoft|suggesting\s+an|may\s+contain +\s+statements\s+about\s+future\s+events\,|business\s+conditions\s+and +\s+the)\s+outlook|guidance\s+(?:to\s+approve|facility)|the\s+guidance +\s+from\s+the\s+OCA|Internal\s+Revenue\s+Service\s+has\s+issued\s+gui +dance|(?:wisdom|technical\s+assistance|necessary\s+supervision|leader +ship)\s+and\s+guidances?|(?:current|other)\s+guidance\s+(?:under|from +)|assumes\s+guidance\s+of\s+(?:the|a)\s+(?:company|board|talented\s+t +eam|compensation)|guidance\s+(?:system|software|technology)|forward\s ++to\s+his\s+guidance|guidance\s+received\s+by\s+the\s+Company|section +\s+409A\s+transition\s+guidance|absent\s+guidance\s+from\s+the\s+Comm +ission|Statements\s+in\s+this\s+press\s+release\s+concerning\s+the\s+ +company's\s+business\s+outlook|guidance\s+regarding\s+the\s+acceptanc +e\s+of\s+gifts))

        And when I run that regex against a million word string, it runs perfectly.

        At this point, I can only reiterate my earlier advises:

        1. Stop running your code inside Komodo -- it appears to be lying to you.
        2. Post real code and a small dataset that reproduces the problem -- outside of Komodo -- and you stand a chance of getting a solution.

        Until then, I'm diagnosing this as a Komodo problem, which I cannot help you with, and which is beyond the scope of this forum.


        With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.

        The start of some sanity?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://988375]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (4)
As of 2014-09-23 05:11 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (210 votes), past polls