Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options

Re^4: Strange IO + concurrency issue

by vsespb (Hermit)
on Sep 30, 2013 at 08:28 UTC ( #1056308=note: print w/ replies, xml ) Need Help??

in reply to Re^3: Strange IO + concurrency issue
in thread [SOLVED] Strange IO + concurrency issue

I suspect this test does not do what you think it does. In particular, consider the case that one process opens the file and writes to it, then another process opens the same file and, perhaps, writes to it, then the if ($f) test executes in the first process. Is the result any different because of what the other process did? I think you will find it is not and, therefore, that the statements in the if block are not as protected as you think they are.
Notice also "my $f = undef" and "unless (-e $filename)"
my $f=undef; getlock sub { unless (-e $filename) { open ($f, ">", $filename) or confess; binmode $f; } }; if ($f) {
( I admit that this code is unclear )
Whether your problem is solved depends on what you are trying to do, which you don't say, but what you are calling a solution seems strange to me.
That was proof of concept code, it contained a bug. Bug found, thus solved.
what you are trying to do, which you don't say
This was proof-of-concept code. I.e. I simplified my 1000 lines program to this code. Thus what I am trying to do is behind the scene, and we should focus only on technical part of problem, not business requirements.
If I post my original code, this would require at least couple of hours to set up things and reproduce the problem for anyone who tries to.
the test could pass but another process could modify the source file before the copy executes
Yes, but btw there are no concurrent writes to same file.
Changing the test on the die to 40_000_000 != -s $newfilename makes little difference to the outcome: there is still a variable subset of the possible 25 copied files and there are still several of them with fewer than 40_000_000 characters.
Well, it indeed does not fix program to output correct files, but it causes some processes to DIE, thus eliminating a bug. See assertions.

Actual fix is to extend lock to whole program, until copy is done (as other posters suggested). Or even just extend it to the point when write to source file is done and file is closed.

Comment on Re^4: Strange IO + concurrency issue
Download Code

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1056308]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others musing on the Monastery: (11)
As of 2014-09-17 18:52 GMT
Find Nodes?
    Voting Booth?

    How do you remember the number of days in each month?

    Results (95 votes), past polls