Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re: Help with Web Scraping Script

by marto (Bishop)
on Oct 19, 2017 at 10:24 UTC ( #1201664=note: print w/replies, xml ) Need Help??

in reply to Help with Web Scraping Script - Updated

This isn't a SSCCE (e.g. get is not shown), however, a couple of points. You read from STDIN but don't chomp. You don't print the reason for failure when you call die, e.g. ....or die "Can't open directory: $!\n". Hopefully you have rate limited requests so you're not hammering the sites in question. Also How do I post a question effectively?

Update: Strikeout, see below.

Replies are listed 'Best First'.
Re^2: Help with Web Scraping Script
by hippo (Abbot) on Oct 19, 2017 at 10:33 UTC
    This isn't a SSCCE (e.g. get is not shown)

    The OP is using LWP::Simple which exports get so it's probably safe to assume that it is that one.

      (Picard) Face palm. I sit corrected. Too early for me.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1201664]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (8)
As of 2017-12-18 18:48 GMT
Find Nodes?
    Voting Booth?
    What programming language do you hate the most?

    Results (495 votes). Check out past polls.