|The stupid question is the question not asked|
Re: creating and managing many hashesby LanX (Cardinal)
|on Feb 18, 2018 at 13:20 UTC||Need Help??|
> I have currently done this using arrays over the 2 million pairs that arise from 2,000 products and it ran for 4 days before
I think your speed problems result from linear searches.
You may want to organise your data in a nested structure.
Please note (like others mentioned) that this approach can't compete with an SQL DB in terms of efficiency.
Those hashes need lots a memory where a SQL is managing an index on columns of the same table. (Think of all the hashes you'd need to easily look up year, month and day separately)
Also reading files to build the data structure will cause you overhead where SQL is persistent.