Greeting Monks!
I would like to seek advice from senior monks on this matter.
I am developing automatic data re-processing system.
Basically it is pretty similar to TCP data re-transmission.
A process will generate a bunch of data di (d1,d2,d3...dn), and it must be transferred to receiver process. Sender sends di+1 if receiver reply di (with OK) otherwise, Sender will re-send di again.
Basically Receiver should receive data in order (d1,d2,..dn) and sender should at the end received replies with (OK) in order (d1,d2,..dn)
Note: Sender and receiver are different processes (potentially across network) and there are time gaps between data generation (d1, 1/2 hour ,d2 , 1 hr, d3 ..)
My plan currently is as follow:
There will be persitence queue with some sort of locking mechanism.
I have found some modules (http://search.cpan.org/~revmischa/Data-Queue-Persistent-0.13/lib/Data/Queue/Persistent.pm) but it does not seem to provide locking the queue.
OnDataGenerationEvent(Data d) -
queue.add(d, {state => PENDING_TRANSFER} )
process(queue)
OnDataReceivedEvent(Data reply) -
lock(queue) {
d = dequeue()
if reply.status = OK then
# no Op
else # status is NAK
# add back to front of queue
queue.add_front(d,{state => PENDING_TRANSFER})
endif
}
process(queue)
sub process(queue)
lock(queue ){
d = dequeue(queue)
if d.state = PENDING_TRANSFER then
transfer(d)
queue.add(d, {state => PENDING_REPLY } )
endif
}
-
Are you posting in the right place? Check out Where do I post X? to know for sure.
-
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big>
<blockquote> <br /> <dd>
<dl> <dt> <em> <font>
<h1> <h2> <h3> <h4>
<h5> <h6> <hr /> <i>
<li> <nbsp> <ol> <p>
<small> <strike> <strong>
<sub> <sup> <table>
<td> <th> <tr> <tt>
<u> <ul>
-
Snippets of code should be wrapped in
<code> tags not
<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).
-
Want more info? How to link
or How to display code and escape characters
are good places to start.
|