Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer

Performance : process lakhs of database records

by selva (Scribe)
on Jun 03, 2010 at 07:30 UTC ( #842866=perlquestion: print w/replies, xml ) Need Help??
selva has asked for the wisdom of the Perl Monks concerning the following question:

Dear Monks,

I have a requirement to process lakhs of recorda which
is in remote machine. Kindly instruct me the best
solution to process it.

Thanks in Advance
  • Comment on Performance : process lakhs of database records

Replies are listed 'Best First'.
Re: Performance : process lakhs of database records
by marto (Archbishop) on Jun 03, 2010 at 07:32 UTC

      "Lakh" is a unit much used in India and thereabouts, and is equal to 100,000.


        Yeah, I linked to the wiki entry in my post under the suspicion that was what OP meant.

        Also known as 100 grand pianos, right? :)
Re: Performance : process lakhs of database records
by JavaFan (Canon) on Jun 03, 2010 at 09:40 UTC
    I fail to pinpoint a particular problem in your question. Is it the "how do I connect to the database" issue you have a problem with? Is it "how do I process records"? Is it "how do I write a Perl program"? Is it "please write a program for me?". Please elaborate. And tell us what you've done so far.

      Currently i take nearly hundred thousands of record and load it in hash.
      After that compare the record values to another table.
      It leads to performance issue. Is there any efficient way to improve this.

        Why not simply do a database query via DBI and compare the values between the two tables?

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://842866]
Approved by moritz
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others musing on the Monastery: (6)
As of 2018-06-19 11:07 GMT
Find Nodes?
    Voting Booth?
    Should cpanminus be part of the standard Perl release?

    Results (113 votes). Check out past polls.