Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask

Re^2: how can i work with huge files?

by morfeas (Novice)
on Feb 08, 2005 at 14:47 UTC ( #429070=note: print w/replies, xml ) Need Help??

in reply to Re: how can i work with huge files?
in thread how can i work with huge files?

yes. the smaller is about 30MB. Now imagine some hundrents or thousants of such files needing to be processed by the script we mentioned. Quite '80s e? Further more say how hours should take, if for ONE 30MB needs 30 might reffer to 1980 hours... I need something more (P)ractical(erl) Anyway, thinking that tie:File have some potential on it ...

Replies are listed 'Best First'.
Re^3: how can i work with huge files?
by Anonymous Monk on Feb 08, 2005 at 15:18 UTC
    Since we don't know what you do to a file, how can we asses the "30 minutes to process 30Mb"? Perhaps you have been very clever to do the task at hand in just 30 minutes. Perhaps you have used an extremely slow algorithm, and it could be done in a few seconds. Who knows? Well, you know, but we don't.

    But I remain, as long as you think that 30 Mb is a "very large file", you're not from this era.

      ..'But I remain, as long as you think that 30 Mb is a "very large file", you're not from this era'... For sure. If you cannot distinguish the file from files "very large files " and furthermore, if you 'remain' to that , yes i'm not from your era ... and neither the practical fellows how clarify what they read. As to what i share try to read "I found out that xml faces the same problem, when an xsl is used for transformations. How can we process the files without loading them to memory ?" is from the same asking...

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://429070]
[Discipulus]: just in Eataly: brain surgery while playing clarinet..
[erix]: installing perfect pitch?
[karlgoethebier]: ...good Hot tuna. Note the stacks & racks in the background
[karlgoethebier]: ..the last hippies. They still perform. At least the survivors...
[Discipulus]: not survived

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (10)
As of 2017-11-17 20:18 GMT
Find Nodes?
    Voting Booth?
    In order to be able to say "I know Perl", you must have:

    Results (272 votes). Check out past polls.