Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Efficient Way to Parse a Large Log File with a Large Regex

by thor (Priest)
on Apr 12, 2005 at 23:48 UTC ( [id://447212]=note: print w/replies, xml ) Need Help??


in reply to Efficient Way to Parse a Large Log File with a Large Regex

From your tail -f comment, this is a running log. If so, you can trim down your time by saving off the last position that you ended with in the file with tell and reading it back in at script start and using seek. That way, you're only looking at new entries every time.

thor

Feel the white light, the light within
Be your own disciple, fan the sparks of will
For all of us waiting, your kingdom will come

  • Comment on Re: Efficient Way to Parse a Large Log File with a Large Regex

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://447212]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others lurking in the Monastery: (5)
As of 2024-04-19 20:07 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found