Re^10: write to Disk instead of RAM without using modules

[Laurent_R]

The problem with your code is that you are loading all your files into memory (the %seen hash).

What I am suggesting is to load only the first file into such a hash, and then to read line by line all the other files and, for each record, see if you have already seen that record in the first file. If you haven't seen it, you know that record will not be in all the files, since it wasn't in the first file anyway, so there is no point to add it to your hash. If you've seen it, just increment the value of the hash for it.

At the end, your hash is in fact a set of counters telling, for each record of the first file, how many times it has been seen. You just need to keep the records whose counter is equal to the number of files.

Update: please look at my other post in reply to your original question (at the bottom of the thread) for a detailed algorithm.