http://www.perlmonks.org?node_id=359823

I've got a bunch of apache logs. They're cut into timestamp files each day, and my rsync job brings 7 down to my local machine. The host keeps a 7 day rotation and that's it.

Now, what I want to do is take those 7 files and concatenate them to my big master log for analysis. However, I'd like to be smart and not just do a 'dumb' concatenation. That would give me duplicate lines.

I'm sure there's a tasty unix-y command that will merge the files, only adding new lines to the master file, but what's it called? I looked into 'merge', but that doesn't seem right (or maybe I don't understand the man page.)