WWW::Spyder Module

[kevyt]

I am trying to use the spyder module but I can't get it installed because of an error in the ._Makefile.PL file. Can someone please help?

I have tried:

# perl Makefile.PL

Checking if your kit is complete...
Looks good
Writing Makefile for WWW::Spyder
#

# make test

cp ._test.pl blib/lib/WWW/._test.pl
.
.
.
1..20
1 - WWW::Spyder->new
ok 2 - Resting timeout on UserAgent
ok 3 - Setting VERBOSITY to 5
.
.
.
ok 18 - Attributes: bell, current_Bytes, html_parser, linkText, seenUR
+Ls, current_enQ, text, sleep_base, courtesy_Queue, enqueue_Objects, s
+pydered, linkSwitch, cookie_file, page_content, alt, UA, page_Memory,
+ href, and bytes_GOT.
ok 19 - Time: 4
ok 20 - Kbs: 186
#

# make install

Manifying blib/man3/WWW::Spyder.3pm
/usr/bin/perl "-Iblib/arch" "-Iblib/lib" ._Makefile.PL ._Makefile
Unrecognized character \x05 at ._Makefile.PL line 1.
make: *** [._Makefile] Error 255
#

The contents of ._Makefile.pl is:

^@^E^V^G^@^B^@^@Mac OS X        ^@^B^@^@^@      ^@^@^@2^@^@^@ ^@^@^@^B
+^@^@^@R^@^@^@^@^@^@^@^@^@^@^@^@^A^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
+^@^@^@^@^@

Is this module made for a MAC? I am on linux/fedora.
The module can be found at http://search.cpan.org/~ashley/WWW-Spyder-0.19/Spyder.pm Thanks a bunch, Kevin

[hossman]

Note that if you look at the cpan search page for this distribution...

http://search.cpan.org/~ashley/WWW-Spyder-0.19/

...the "CPAN Testers" section seems to indicate that there is a problem of some kind ... 11 CPAN Testers tried this install and it failed for all of them. clicking the link to view the details...

http://cpantesters.perl.org/show/WWW-Spyder.html#WWW-Spyder-0.19

...you can see that most of the 11 testers seem to have had the same problem as you with version 0.19, but earlier versions seemed to install cleanly for at least a few people.

[hossman]

Actually, thinking about this a bit more, if you browse the files in the release there is a "._*" file for every normal file and they are all 82 bytes. I suspect these are some sort of MacOS specific resource fork / hidden files that made it into the release by mistake (as an artifact of whatever mechanism was used to copy/bundle up the tgz) and ExtUtils::MakeMaker seems to be making some sort of assumption about the "._Makefile.PL"

have you tried just removing the "._*" files from the distribution after you unpack it (and before running perl Makefile.PL) to see if that solves your problem?

[kevyt]

Thanks everyone. I removed all of the "._" files and it worked!!!

rm ._*

Thanks! Kevin

[zshzn]

Conveniently that module appears to be stand-alone, so you could try just copying the source file into an appropriate @INC directory and see if it works.

[kevyt]

I want to add some key words to this so people can find it. Such as crawl webpages.

Try using the Spyder module from CPAN to help you spider or crawl web pages / web sites.

[Your Mother]

Someone's post on this issue with new versions of tar + mac: CPAN vs. dot-underscore.

Update: An answer for Mac OS X devs is in the comments here: Damn Mac's dot-underscore (AppleDot) problem. $ENV{COPY_EXTENDED_ATTRIBUTES_DISABLE} needs to be true.