Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number

Re: Serializing a large object

by BrowserUk (Pope)
on Oct 03, 2010 at 06:48 UTC ( #863154=note: print w/replies, xml ) Need Help??

in reply to Serializing a large object

Are you still looking for a solution to this problem?

I think I might have one, but it would take some work to test it. I'd need you to supply me with a test dataset and results.

Replies are listed 'Best First'.
Re^2: Serializing a large object
by daverave (Scribe) on Oct 09, 2010 at 11:14 UTC
    I am currently using nstore with a fd opened using gzip IO layer. Other solutions will be most welcomed. What exactly would you like me to supply and where should I put it?

      A small set (say 1000 or so) "typical" input ranges; and a hundred or so test ranges along with the result counts when compared against the supplied input set. Timings of how long it took to run would also be useful.

      As for how to exchange them, email seems possible. One set of 1000 pairs; plus 1 set of 100 hundred pairs + counts; plus a time won't take much space. You could probably even post them here. /msg me for a email address if you want to go that route.

      Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
      "Science is about questioning the status quo. Questioning authority".
      In the absence of evidence, opinion is indistinguishable from prejudice.
        coordinates are in 1 .. 877879 (both inclusive). I used some real data so the number of ranges is 2777 and it followed by some 1000 queries and their results.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://863154]
[1nickt]: ugh, I stuck my head in the bass bin for 30 seconds on a dare at Ted Nugent at Hammersmith Odeon. Yes, I am 40% deaf now.
[johngg]: My daughter is incredibly jealous of my wife who got to see The Clash at Brixton many years ago. They went to see The Vaccines there recently.
[1nickt]: But the bands are even louder! I saw Spearhead (Michael Franti) at an outdoor show and had to walk a mile away to not feel pain in my chest! Babies were crying ... I asked the sound engineer why it was necessary to have the bass so loud and he laughed...
[Discipulus]: but the best i attended live was Mano Negra Patchanka at Forte Prenestino .. in 1990
[Corion]: Hmmm - Mano Negra or at least Manu Chao seem to put on a good live show. At least the one live CD I have from Manu Chao sounds good ;)
Discipulus feels the same jealousity of the johngg's daughter
[1nickt]: choroba I agree
[choroba]: Playing in a punk rock band for 20 years... my hearing is quite bad
[Corion]: I still have hopes to turn my godson and his two siblings into a punk band ;)
[Corion]: Their older sister just started piano but has been interested in drumming, which she should be able to start with 8 years or so)

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (12)
As of 2017-03-24 12:19 GMT
Find Nodes?
    Voting Booth?
    Should Pluto Get Its Planethood Back?

    Results (301 votes). Check out past polls.