Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?

Re^3: Safe to open+close for every write, with locking?

by flexvault (Monsignor)
on Dec 21, 2012 at 18:25 UTC ( #1009947=note: print w/replies, xml ) Need Help??

in reply to Re^2: Safe to open+close for every write, without locking?
in thread Safe to open+close for every write, without locking?


I didn't previously think about the consequences of slide #4, but it probably is why I don't 'flock' the actual file. I use a dummy file called ".../LOCK", that I use 'flock' to lock/unlock. This file is alway of length '0', so that allows the actual file that I'm writing/reading to continue to be buffered. You have to use it the exact same way. ('LOCK_EX' for write, 'LOCK_SH' for read.)

As long as you're preventing the race condition by always 'flock'ing the dummy file, you will not get into trouble. Early on I found problems with 'flock'ing the actual file, which may be why 'flock' was fixed to eliminate the problem described in slide #4. But buffering is good!

I looked at your benchmark, and noticed that you don't delete the file each time your script is entered and before you start the benchmark. Even though you're 'open'ing the file with append, you may distort the results due to more disk head activity by having a larger and larger file with each additional call. I adjusted your script and did a comparison to 'syslog' and found that 'syslog' was about twice as slow. I'm guessing that is the socket activity between different processes.

Anyway, looks like you have a plan.

Good Luck...Ed

"Well done is better than well said." - Benjamin Franklin

  • Comment on Re^3: Safe to open+close for every write, with locking?

Replies are listed 'Best First'.
Re^4: Safe to open+close for every write, with locking?
by sedusedan (Monk) on Dec 22, 2012 at 01:40 UTC

    Hi Ed,

    In the actual module (File::Write::Rotate, now already uploaded to CPAN), I do use a zero-length dummy file (lock file).

    Regarding not deleting the data file for every script: you have good eyes :) Actually I did truncate the file before each test, but I didn't include it in the post. So, my bad.

    Also, thanks for comparing with syslog. Nice to know.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1009947]
and the leaves swirl about...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (7)
As of 2017-09-24 09:11 GMT
Find Nodes?
    Voting Booth?
    During the recent solar eclipse, I:

    Results (273 votes). Check out past polls.