Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Re^2: how can i work with huge files?

by morfeas (Novice)
on Feb 08, 2005 at 14:47 UTC ( #429070=note: print w/ replies, xml ) Need Help??


in reply to Re: how can i work with huge files?
in thread how can i work with huge files?

yes. the smaller is about 30MB. Now imagine some hundrents or thousants of such files needing to be processed by the script we mentioned. Quite '80s e? Further more say how hours should take, if for ONE 30MB needs 30 mins...you might reffer to 1980 hours... I need something more (P)ractical(erl) Anyway, thinking that tie:File have some potential on it ...


Comment on Re^2: how can i work with huge files?
Re^3: how can i work with huge files?
by Anonymous Monk on Feb 08, 2005 at 15:18 UTC
    Since we don't know what you do to a file, how can we asses the "30 minutes to process 30Mb"? Perhaps you have been very clever to do the task at hand in just 30 minutes. Perhaps you have used an extremely slow algorithm, and it could be done in a few seconds. Who knows? Well, you know, but we don't.

    But I remain, as long as you think that 30 Mb is a "very large file", you're not from this era.

      ..'But I remain, as long as you think that 30 Mb is a "very large file", you're not from this era'... For sure. If you cannot distinguish the file from files "very large files " and furthermore, if you 'remain' to that , yes i'm not from your era ... and neither the practical fellows how clarify what they read. As to what i share try to read "I found out that xml faces the same problem, when an xsl is used for transformations. How can we process the files without loading them to memory ?" is from the same asking...

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://429070]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (6)
As of 2014-08-29 21:44 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best computer themed movie is:











    Results (289 votes), past polls