Beefy Boxes and Bandwidth Generously Provided by pair Networks DiBona
Problems? Is your data what you think it is?
 
PerlMonks  

pboin's scratchpad

by pboin (Deacon)
on Jun 02, 2004 at 23:31 UTC ( #359823=scratchpad: print w/ replies, xml ) Need Help??

I've got a bunch of apache logs. They're cut into timestamp files each day, and my rsync job brings 7 down to my local machine. The host keeps a 7 day rotation and that's it.

Now, what I want to do is take those 7 files and concatenate them to my big master log for analysis. However, I'd like to be smart and not just do a 'dumb' concatenation. That would give me duplicate lines.

I'm sure there's a tasty unix-y command that will merge the files, only adding new lines to the master file, but what's it called? I looked into 'merge', but that doesn't seem right (or maybe I don't understand the man page.)

Log In?
Username:
Password:

What's my password?
Create A New User
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (9)
As of 2014-04-17 09:40 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    April first is:







    Results (443 votes), past polls