For the modules you want Test::More and friends. A good introduction is Test::Tutorial.
For testing the web application itself WWW::Mechanize is very useful, and people have said good things about HTTP::WebTest. You may also find Test::HTML::Content and Test::HTML::Lint of interest.
On perlmonks try:
Hope this helps.