As long as perl is useful to and educational for you, who cares what someone else says about the popularity of the language you use?
Everybody who cares about Perl should care. Public perception influences what programming languages are taught at universities, and what language new "from scratch" projects are written in. Both choices influence the talent pool and the number and quality of available modules and tools. So the past perception of Perl has shaped the status quo (about which you seem to be happy), and the current perception of Perl shapes the future of Perl.