Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number

Re: Optimising processing for large data files.

by Vautrin (Hermit)
on Apr 10, 2004 at 16:35 UTC ( #344131=note: print w/ replies, xml ) Need Help??

in reply to Optimising processing for large data files.

Databases are never quicker unless you can use some fairly simplistic criteria to make wholesale reductions in the volume of the data that you need to process within your application program.

I recommend using databases to people not because of any kind of performance gain you get from the "database magic bullet", but because there's a lot of programming work you can cut out of the picture.

For instance, if you need a data structure that can persist outside of your program, and be accessed and modified via multiple programs, all you have to do is create a table to represent the data structure, and all of the work is basically done for you. SQL is all you need, and it's done very easily for someone who is familiar with it.

However, if you're rolling your own, it's going to take a lot of time, you're going to have to take care of a lot of details which are just provided for you using a database, and (if you're on a virtual host without root access) it may be the only thing you have write access to.

Want to support the EFF and FSF by buying cool stuff? Click here.

Comment on Re: Optimising processing for large data files.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://344131]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (13)
As of 2015-11-30 09:06 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (767 votes), past polls