Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling

Re: Help with Web Scraping Script

by marto (Archbishop)
on Oct 19, 2017 at 10:24 UTC ( #1201664=note: print w/replies, xml ) Need Help??

in reply to Help with Web Scraping Script - Updated

This isn't a SSCCE (e.g. get is not shown), however, a couple of points. You read from STDIN but don't chomp. You don't print the reason for failure when you call die, e.g. ....or die "Can't open directory: $!\n". Hopefully you have rate limited requests so you're not hammering the sites in question. Also How do I post a question effectively?

Update: Strikeout, see below.

Replies are listed 'Best First'.
Re^2: Help with Web Scraping Script
by hippo (Canon) on Oct 19, 2017 at 10:33 UTC
    This isn't a SSCCE (e.g. get is not shown)

    The OP is using LWP::Simple which exports get so it's probably safe to assume that it is that one.

      (Picard) Face palm. I sit corrected. Too early for me.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1201664]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (4)
As of 2018-08-17 16:52 GMT
Find Nodes?
    Voting Booth?
    Asked to put a square peg in a round hole, I would:

    Results (182 votes). Check out past polls.