Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation

Re: Extracting keywords from HTML

by socketdave (Curate)
on Aug 21, 2005 at 13:49 UTC ( #485523=note: print w/replies, xml ) Need Help??

in reply to Extracting keywords from HTML

Is performance a problem with your current code?

Replies are listed 'Best First'.
Re^2: Extracting keywords from HTML
by wfsp (Abbot) on Aug 21, 2005 at 14:09 UTC
    I've only taken a rough measure of the time it takes.

    There are about 2k files (32MB). From scratch it takes less than a minute (about 45secs on susequent runs). This includes importing the hash into a DBM::Deep db.

    The idea would be to only create it once and then update it.

    That's not a problem for me.

    wintel 2.66Mhz, 640MB