Beefy Boxes and Bandwidth Generously Provided by pair Networks
The stupid question is the question not asked
 
PerlMonks  

Re: Processing ~1 Trillion records

by erix (Parson)
on Oct 25, 2012 at 09:52 UTC ( #1000795=note: print w/replies, xml ) Need Help??


in reply to Processing ~1 Trillion records

I'd say you first have to profile: where is that time spent: database retrieval, downstream processing, writing, (perhaps also writing back to database?), etc.

16 days; there is probably room for improvement, so try cutting up that profile in as many parts as you can think of.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000795]
help
Chatterbox?
[shmem]: discovered a fuel tank leakage at my second hand motorbike. Some bloke drove a screw too long through the fairing
[shmem]: hard to fix, and plans wrecked. And more... won't tell.
[shmem]: the leakage has been "fixed" with a piece of bycicle tube. Bleargh.
[karlgoethebier]: shmem: yes. my first ride tomorrow is questionable because of lumbago. shit
[shmem]: But! the bloke wasn't me, at least.
[shmem]: karlgoethebier: isn't bike riding a way of fixing lumbago?
[karlgoethebier]: shmem: scheiss technik

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (11)
As of 2017-06-25 20:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    How many monitors do you use while coding?















    Results (570 votes). Check out past polls.