Fetching web pages via Perl

[mrguy123]

Hi Monks,
I am working on a tool that fetches results from different search engines and parses the results for display.
In the past I have mostly worked with the LWP::UserAgent module, and would like to also try some different modules as well.
I have heard good things about WWW:Mechanize and would like to hear any other recommendations or advice about similar modules that do a good job
Any suggestions?

Thanks,
Guy (mrguy123)

Unix is user friendly - it's just a bit more choosy about who it's friends are -- Gene Buckle

[Corion]

If you are targetting search engines, maybe WWW::Search may or may not be of interest. Other than that, there is little that beats the API of WWW::Mechanize. WWW::Mechanize has everything LWP::UserAgent has and a bit more. There is WWW::Scripter, a descendant of WWW::Mechanize. The Mechanize namespace is where almost all modules for web navigation live.

[moritz]

I've made good experiences with Mojo::UserAgent.

[mrguy123]

Thanks for the recommendations