|Problems? Is your data what you think it is?|
high speed checksum for video finger printing?by faber (Acolyte)
|on Feb 04, 2012 at 21:52 UTC||Need Help??|
faber has asked for the
wisdom of the Perl Monks concerning the following question:
I'm wondering if anyone here has thought about a high speed checksum for video finger printing. I'd like to avoid if possible reading an entire video file to determine it's checksum, rather I would like to only read segments of the data to try and determine this.
My first thoughts were to use crc32 against selected segments of the files, (say 1 megabyte every 2 megabytes of data) or something like that.
I understand that without checksuming the entire file it's very hard to guarantee uniqueness, however I'm more concerned with speed.
Alright guys, first generation of File::Fingerprint::Huge is up on cpan. I'll update it with some further refinements as I move forward. Thanks for all of you help!