Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: Specialized data compression

by QM (Parson)
on Oct 04, 2012 at 09:34 UTC ( #997211=note: print w/replies, xml ) Need Help??


in reply to Specialized data compression

Thanks for posting such an interesting question!

Another idea I've seen work is to transpose your CSV, so that the first row is the timestamp, the second row is the X, etc. Then compress this. As the X's may be self-similar, and the Y's self-similar, but the X's and Y's are not, this may give the compression algorithm a break.

The timestamp should also be delta, except the first reading on resume.

-QM
--
Quantum Mechanics: The dreams stuff is made of

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://997211]
help
Chatterbox?
NodeReaper serves mincemeat tarts with the cider

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (6)
As of 2017-09-25 18:15 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    During the recent solar eclipse, I:









    Results (287 votes). Check out past polls.

    Notices?