Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw

Re: Comparing DBI records

by nikosv (Chaplain)
on Feb 19, 2013 at 09:11 UTC ( #1019487=note: print w/replies, xml ) Need Help??

in reply to Comparing DBI records

why don't you bulk insert the DBF data into a Mysql table and do the comparison with sql?

It seems like that you are doing equi joins;if that is so, then you can use a HASH table structure which is ideal for exact key retrieval.

you insert the DBF data into a table hashed on the keys and also make a HASHed secondary index on the keys of the Mysql table, which will be used for the joining

Replies are listed 'Best First'.
Re^2: Comparing DBI records
by parser (Acolyte) on Feb 19, 2013 at 20:15 UTC
    Great question. The short answer is that I am not SQL savvy enough to do so. I have used dbf2mysql to perform bulk imports to MySQL and that worked fairly well.

    The overarching goal is to update the MySQL database with the DBF files and to log the changes made to the master table. I will read up on equi joins and see if I cannot leverage the MySQL engine to do the heavy lifting.


Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1019487]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (7)
As of 2018-05-23 17:33 GMT
Find Nodes?
    Voting Booth?