http://www.perlmonks.org?node_id=1006514


in reply to Re^2: Building a local perl to use the system perl's libraries as a fallback
in thread Building a local perl to use the system perl's libraries as a fallback

You may have to install headers of the libraries XS code uses (i.e. simply speaking, files in /usr/include/ which point to the functions defined in *.so files). For example, building Wx from CPAN requires libwxgtk2.8-dev to be installed.
Sorry if my advice was wrong.