Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation

Re: My Crawler script

by atcroft (Monsignor)
on Mar 10, 2011 at 07:49 UTC ( #892357=note: print w/replies, xml ) Need Help??

in reply to My Crawler script

While learning socket programming is useful (and you may wish to look at perlipc for more on that), might I suggest LWP, LWP::Simple, and LWP::UserAgent as a starting point, if all you want to build is a web crawler?

Hope that helps.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://892357]
[1nickt]: Is it possible to disable it?
[Discipulus]: if you mean [download] after the code it is there 1nickt
[1nickt]: yes, Corion sees it too, and I see it when not logged in.
[Corion]: I think you can disable download links in your settings?
[1nickt]: Looking in settings to see if I disabled it in my profile ...
[1nickt]: There is "Don;t show embedded d/l links" in Display settings. It is unchecked.
[1nickt]: Oh, there is a minimum lines setting!

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (9)
As of 2017-05-23 18:21 GMT
Find Nodes?
    Voting Booth?