in reply to
Re: Scrappy user_agent error
in thread Scrappy user_agent error
Some sites I visit automatically block robots. I was under the impression that this would change the default "Browser" id... Am I wrong?
From CPAN: The user_agent attribute holds the Scrappy::Scraper::UserAg
+ent object which is used to set and manipulate the user-agent header
+of the scraper.
use Scrappy qw/:syntax/;
user_agent random_ua 'firefox'; # firefox only
user_agent random_ua 'firefox', 'linux'; # firefox on linux only