http://www.perlmonks.org?node_id=1019487


in reply to Comparing DBI records

why don't you bulk insert the DBF data into a Mysql table and do the comparison with sql?

It seems like that you are doing equi joins;if that is so, then you can use a HASH table structure which is ideal for exact key retrieval.

you insert the DBF data into a table hashed on the keys and also make a HASHed secondary index on the keys of the Mysql table, which will be used for the joining

Replies are listed 'Best First'.
Re^2: Comparing DBI records
by parser (Acolyte) on Feb 19, 2013 at 20:15 UTC
    Great question. The short answer is that I am not SQL savvy enough to do so. I have used dbf2mysql to perform bulk imports to MySQL and that worked fairly well.

    The overarching goal is to update the MySQL database with the DBF files and to log the changes made to the master table. I will read up on equi joins and see if I cannot leverage the MySQL engine to do the heavy lifting.

    Cheers
[reply]

In Section Seekers of Perl Wisdom