Bundling modules into your own distribution has worked great for us. What I use now is based on the build system in
the Krang CMS. The CPAN sources are bundled with the software, and there is a build script that builds and installs them all to a local lib directory, making them available to all programs withing the distribution and avoiding any issues of updating system libs. With this approach, you can even have multiple copies with dependencies on different versions of the same modules installed on the same machine.