Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris

Re: Database Comparison

by sundialsvc4 (Abbot)
on Jul 01, 2011 at 21:16 UTC ( #912414=note: print w/replies, xml ) Need Help??

in reply to Database Comparison

When you reach this volume of data, especially when they are on two different servers (hence... a network of some kind will now be involved ...), you're simply going to have to devise some strategy that will enable you to “divide and conquer.”

There are various possibilities to consider, depending on exactly what kind of comparisons you want to make.   For example, I once worked on a similar task where we pulled row-counts and MD5-sums of blocks of records, then compared those results, gradually zeroing-in on the differences.   (These queries focused on just one server at a time.)

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://912414]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others romping around the Monastery: (11)
As of 2016-10-28 15:12 GMT
Find Nodes?
    Voting Booth?
    How many different varieties (color, size, etc) of socks do you have in your sock drawer?

    Results (385 votes). Check out past polls.