Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

How do I send one query to many sites & read back their replies?

( #10006=categorized question: print w/ replies, xml ) Need Help??
Contributed by Anonymous Monk on May 03, 2000 at 03:57 UTC
Q&A  > network programming


Description:

How can I send one query to many sites on the web, and read back their replies.

I would rather not uses LWP as it is very slow, because it handles one agent at a time.

I need to parse the incoming replies as fast as they arrive.

Answer: How do I send one query to many sites & read back their replies?
contributed by btrott

Yes, I know you say you don't want to use LWP, but:

Have you checked out LWP::Parallel? It sounds like it does what you want.

Answer: How do I send one query to many sites & read back their replies?
contributed by Anonymous Monk

The LWP::Parallel is a very good solution,but it is not available on my server? DO YOU HAVE ANOTHER SOLUTION ?

Answer: How do I send one query to many sites & read back their replies?
contributed by mdillon

if the unavailability of the module on your server is all that's stopping you from using it, why don't you set up your own module directory?

more information on how to do so can be found here.

if you don't have shell access to the server to build the modules yourself, you can mirror the server's directory structure on a local machine for the purpose of building the module and upload the result to the server via FTP.

Please (register and) log in if you wish to add an answer



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • Outside of code tags, you may need to use entities for some characters:
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.
  • Log In?
    Username:
    Password:

    What's my password?
    Create A New User
    Chatterbox?
    and the web crawler heard nothing...

    How do I use this? | Other CB clients
    Other Users?
    Others taking refuge in the Monastery: (14)
    As of 2014-07-30 07:47 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      My favorite superfluous repetitious redundant duplicative phrase is:









      Results (229 votes), past polls