Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

Re: file merge with config(parameter) files

by moritz (Cardinal)
on Mar 02, 2013 at 13:47 UTC ( #1021413=note: print w/ replies, xml ) Need Help??


in reply to file merge with config(parameter) files

due to this, need your help whether we can use perl (using hash) for merging files or using sql database (pl sql) to make it faster.

It should be quite possible to do it perl. Keep the config file and the relevant parts of the smaller file (file2) in memory, and process the larger file (file1) line by line.

Of course you can do it in SQL too. If the records already exists in a database, that's probably a simpler approach. If not, importing it likely takes as long as doing the whole processing in Perl.


Comment on Re: file merge with config(parameter) files
Re^2: file merge with config(parameter) files
by hyans.milis (Novice) on Mar 02, 2013 at 15:07 UTC

    Hi Moritz,

    my idea is to process 1st file line by line. may i know what's the meaning to store the smaller file (file2) in memory ?is there any sample about this? bcoz i'm newbie in perl. thanks

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1021413]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (5)
As of 2014-09-17 22:14 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (100 votes), past polls