|Don't ask to ask, just ask|
Re^3: How do I access a password protected site and access data?by marto (Archbishop)
|on Jun 29, 2005 at 08:35 UTC||Need Help??|
Looking back at this question a day later raises a query in my mind. Does the page you are trying to access have some kind of login form where you are required to enter a valid username and password, or is a pop up window displayed asking for valid credentials?
Either way, in the past I have implemented screen scraping / data processing of sites using WWW::Mechanize. The previous link shows some examples of how easy it is to process forms (login or otherwise), follow links and return page content for processing.
I have done the same thing using other methods, but in my experience using WWW::Mechanize is easier to implement.
It is also worth while reading merlyn's column Web scraping with WWW::Mechanize (Apr 03) which I found very informative.
Hope this helps