How do I send one query to many sites & read back their replies?

[Anonymous Monk]

How can I send one query to many sites on the web, and read back their replies.

I would rather not uses LWP as it is very slow, because it handles one agent at a time.

I need to parse the incoming replies as fast as they arrive.

Originally posted as a Categorized Question.

[btrott]

Yes, I know you say you don't want to use LWP, but:

Have you checked out LWP::Parallel? It sounds like it does what you want.

[Anonymous Monk]

The LWP::Parallel is a very good solution,but it is not available on my server? DO YOU HAVE ANOTHER SOLUTION ?

[toadi]

Maybe it's time to look in the LWP::Parallel module and try to figure out how it's done. You can maybe recreate the part you need.(This is the hardway)

Use Sockets and code it yourself.(a bit easier)

Ask the sysadmin to install the module.

Install the module yourself and set the module path to your user module path.

--
My opinions may have changed,
but not the fact that I am right

[mdillon]

if the unavailability of the module on your server is all that's stopping you from using it, why don't you set up your own module directory?

more information on how to do so can be found here.

if you don't have shell access to the server to build the modules yourself, you can mirror the server's directory structure on a local machine for the purpose of building the module and upload the result to the server via FTP.