Tested this but it still gives an error. Maybe Scrappy is just not the right tool for this job..
in reply to Re^5: Scrappy user_agent error
in thread Scrappy user_agent error
Can't locate object method "user_agent" via package "scraper" (perhaps
+ you forgot to load "scraper"?) at ./scrappy.pl line 8.
my $url = 'http://google.com';
my $scraper = Scrappy->new;
print $scraper->domain, "\n"; # print www.google.com