For pure-Perl modules this should work just fine.
For XS modules it might also work, provided you have the same version of Perl (at least the same major version, threaded vs. non-threaded build, same C runtime lib), the same architecture (e.g. 32-bit vs, 64-bit), and any dependent (3rd-party) shared libraries that some of the XS modules might be linked against (think of Imager, for example) are available (in the same versions) on both machines. — The problem with the latter often lies in the details...