http://www.perlmonks.org?node_id=1033530

PerlSufi has asked for the wisdom of the Perl Monks concerning the following question:

Hello Monks, I have been at this for a little while, and I am stuck on one part. I am trying to crawl a page to access a csv file. Here is my script (or part of it):
my $ua = LWP::UserAgent->new(ssl_opts => { verify_hostname => 1 }); $ua->agent('Mozilla/5.0'); $ua->cookie_jar({}); my $response = $ua->get('firstpage.com'); my $response2 = $ua->get('secondpage.com'); (etc) ###This section is where I am having trouble: my $post = $ua->post('https://www.foo.com/downloadAcsReportSearch.html +', "Search");

The problem I am having right now is that I am not clicking the "Search" button at the last post. Firebug shows it has the value 'Search'. I think I need help understanding how to do this. I also have to click one last button on the page proceeding that, but I'll cross that bridge when I get there. Any insight is greatly appreciated.Thanks!
PS-I should add that I cannot use a module that utilizes a browser or javascript plugin.