You could try to repeat the CPAN build process manually. Whenever CPAN build fails, I will chdir to ~/.cpan/build/<moudle> directory, then do a manual build under that directory by:
in reply to Im struggling to use cpan to install modules
make | tee make.log
This will always give me warm and fuzzy feeling that I am in control, and it will always give me (or enable me to find out) the precise reason of build failure. You may either need to 'sudo' the make process, or to reset the owner/group of your 'stuffed-by-sudo' CPAN build directories.