Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

pboin's scratchpad

by pboin (Deacon)
on Jun 02, 2004 at 23:31 UTC ( #359823=scratchpad: print w/ replies, xml ) Need Help??

I've got a bunch of apache logs. They're cut into timestamp files each day, and my rsync job brings 7 down to my local machine. The host keeps a 7 day rotation and that's it.

Now, what I want to do is take those 7 files and concatenate them to my big master log for analysis. However, I'd like to be smart and not just do a 'dumb' concatenation. That would give me duplicate lines.

I'm sure there's a tasty unix-y command that will merge the files, only adding new lines to the master file, but what's it called? I looked into 'merge', but that doesn't seem right (or maybe I don't understand the man page.)

Log In?
Username:
Password:

What's my password?
Create A New User
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (12)
As of 2014-09-18 20:09 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (124 votes), past polls