|Problems? Is your data what you think it is?|
Re: matching datetimestamps and concatenating data where timestamps match from multiple large datafilesby Marshall (Prior)
|on Sep 23, 2013 at 06:44 UTC||Need Help??|
One way to do this is to adopt a "standard" format that is ASCII sortable.
Example: "2012-10-06 1649".
The leading zero's are important!
The above format sorts in ASCII order. No problem. That also means that you can compare Date X vs Date Y!.
In general, log files should use GMT or what is called UTC time. This is time zone independent.
If you use a DB, same idea: normalize to GMT/UTC time - that is what goes into the DB.
Basically, normalize the date/times to a standard ASCII sortable format using GMT/UTC time. Put that into a DB or not. You can sort/search on these times in ASCII format if you want to. Perl sorts ASCII fields like a rocket. If you have a time zone independent date/time format, the DB will also sort/search it like a rocket.