Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re: Speeding up large file processing

by gryphon (Abbot)
on Jul 13, 2005 at 02:31 UTC ( #474443=note: print w/ replies, xml ) Need Help??


in reply to Speeding up large file processing

Greetings ralphch,

Wow. Well, not knowing the current state of your code-line, I'll just give general pointers. Take a look at FastCGI for starters. Ultimately, a mod_perl solution would be better, but it may be more difficult to migrate your code. Also, if I were you, I'd look into moving the data from large text files into a database. MySQL is my database of choice, but there are alternatives that are free, good, and fast.

My general rule of thumb is not to spend time (or money) on different or additional hardware if there's a fairly straight-forward software solution to improve efficiency.

gryphon
Whitepages.com Development Manager (DSMS)
code('Perl') || die;


Comment on Re: Speeding up large file processing

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://474443]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (5)
As of 2014-07-26 02:10 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (175 votes), past polls