Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

pboin's scratchpad

by pboin (Deacon)
on Jun 02, 2004 at 23:31 UTC ( #359823=scratchpad: print w/replies, xml ) Need Help??

I've got a bunch of apache logs. They're cut into timestamp files each day, and my rsync job brings 7 down to my local machine. The host keeps a 7 day rotation and that's it.

Now, what I want to do is take those 7 files and concatenate them to my big master log for analysis. However, I'd like to be smart and not just do a 'dumb' concatenation. That would give me duplicate lines.

I'm sure there's a tasty unix-y command that will merge the files, only adding new lines to the master file, but what's it called? I looked into 'merge', but that doesn't seem right (or maybe I don't understand the man page.)

Log In?

What's my password?
Create A New User
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (3)
As of 2021-06-14 06:16 GMT
Find Nodes?
    Voting Booth?
    What does the "s" stand for in "perls"? (Whence perls)

    Results (60 votes). Check out past polls.