monkfan has asked for the wisdom of the Perl Monks concerning the following question:
Hi,
For example now I want to download this list of files.
What I usually do is to use "wget" one by one for each of the url of each file. Is there a way we can do it automatically with Perl? Since each of the file is quite large I need to download it overnight.
I am aware that I can write a parser for that website , get the *.gz link for each of the file and run wget for each of them.
I was thinking if it is could be done in quicker way. Any CPAN module that does this kind of task?
Regards,
Edward
For example now I want to download this list of files.
What I usually do is to use "wget" one by one for each of the url of each file. Is there a way we can do it automatically with Perl? Since each of the file is quite large I need to download it overnight.
I am aware that I can write a parser for that website , get the *.gz link for each of the file and run wget for each of them.
I was thinking if it is could be done in quicker way. Any CPAN module that does this kind of task?
Regards,
Edward
|
---|
Replies are listed 'Best First'. | |
---|---|
Re: Automatic Download of Multiple Files with Perl
by Joost (Canon) on Apr 16, 2007 at 15:16 UTC | |
by varian (Chaplain) on Apr 16, 2007 at 15:41 UTC | |
by smahesh (Pilgrim) on Apr 17, 2007 at 03:43 UTC | |
Re: Automatic Download of Multiple Files with Perl
by Corion (Patriarch) on Apr 16, 2007 at 15:24 UTC | |
Re: Automatic Download of Multiple Files with Perl
by jettero (Monsignor) on Apr 16, 2007 at 15:18 UTC | |
Re: Automatic Download of Multiple Files with Perl
by logie17 (Friar) on Apr 16, 2007 at 16:26 UTC | |
Re: Automatic Download of Multiple Files with Perl
by Scott7477 (Chaplain) on Apr 16, 2007 at 21:48 UTC |
Back to
Seekers of Perl Wisdom