If you are not happy with a CPAN module you will have to essentially re-write it ( or at least parts of it )
You can get the code from CPAN or GitHub, find the chunks that you are using ( which might be a pain considering the number of sub-modules it has ) and then try to optimize it.
Also that module does not look like it has been maintained in over two years, but you could try to get in touch with the maintainers.
If you do manage to speed it up / improve it, you might want to submit a patch.
Or you could just try and get the same data in CSV - is that possible?