LWP and HTTPS

Gangabass has asked for the wisdom of the Perl Monks concerning the following question:

This code gives me the error message

Error GETing https://www.kmcgov.in/KMCPortal/jsp/KMCDeathRecordSearch.jsp: Can't connect to www.kmcgov.in:443

ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0;

my $mech = WWW::Mechanize->new();
$mech->agent_alias("Windows IE 6");
$mech->ssl_opts( verify_hostnames => 0 );

$mech->get( "https://www.kmcgov.in/KMCPortal/jsp/KMCDeathRecordSearch.
+jsp" );
[download]

What can I do to fix this issue? I have the latest versions of Net::SSLeay, Crypt::SSLeay, LWP, LWP::Protocol::https. Also I have installed Mozilla::CA, CACertOrg::CA

Comment on LWP and HTTPS Download Code

Replies are listed 'Best First'.
Re: LWP and HTTPS by moritz (Cardinal) on Apr 26, 2014 at 13:26 UTC
$ wget https://www.kmcgov.in/KMCPortal/jsp/KMCDeathRecordSearch.jsp --2014-04-26 15:23:36-- https://www.kmcgov.in/KMCPortal/jsp/KMCDeathR +ecordSearch.jsp Resolving www.kmcgov.in (www.kmcgov.in)... 210.212.29.170 Connecting to www.kmcgov.in (www.kmcgov.in)\|210.212.29.170\|:443... con +nected. OpenSSL: error:140773E8:SSL routines:SSL23_GET_SERVER_HELLO:reason(100 +0) Unable to establish SSL connection. $ curl https://www.kmcgov.in/KMCPortal/jsp/KMCDeathRecordSearch.jsp curl: (35) error:140773E8:SSL routines:SSL23_GET_SERVER_HELLO:reason(1 +000) [download] I'd argue that either server's SSL setup is broken, or that you need a trust client certificate. Perl won't help you here. Perl 6 - the future is here, just unevenly distributed	[reply] [d/l]
Re^2: LWP and HTTPS by Gangabass (Vicar) on Apr 26, 2014 at 13:30 UTC
But why it's working in the browser? How I can tell LWP to ignore this error?	[reply]
Re^3: LWP and HTTPS by noxxi (Pilgrim) on Apr 26, 2014 at 20:48 UTC
Yet another broken SSL server which cannot do TLS1.0 or better. Browsers work around this kind of error by retrying with a downgraded SSL version. Recent versions of LWP (base of WWW::Mechanize) use IO::Socket::SSL/Net::SSLeay by default and you can simply enforce a specific SSL version like this: `$mech->ssl_opts( SSL_version => 'SSLv3');` [download] I've tested it and it works with this broken server.	[reply] [d/l]
Re^4: LWP and HTTPS by Gangabass (Vicar) on Apr 27, 2014 at 01:15 UTC
Re^5: LWP and HTTPS by noxxi (Pilgrim) on Apr 27, 2014 at 18:02 UTC
Re^3: LWP and HTTPS by Gangabass (Vicar) on Apr 26, 2014 at 13:37 UTC
I see this Python solution: SSL routines:SSL23_GET_SERVER_HELLO:reason(1112). Is there any way I can make same for Perl?	[reply]
Re^2: LWP and HTTPS by Gangabass (Vicar) on Apr 26, 2014 at 13:44 UTC
I tried `$ENV{HTTPS_VERSION} = 3;` because `curl -3 $URL` is working but my Perl code still return same error :-(	[reply] [d/l] [select]
Re^3: LWP and HTTPS by Corion (Patriarch) on Apr 26, 2014 at 16:35 UTC
If you want to set up the environment, either do so outside your script, or at least, before the SSL modules are loaded: `BEGIN { $ENV{ HTTPS_VERSION }= 3; }; use WWW::Mechanize;` [download]	[reply] [d/l]
Re^4: LWP and HTTPS by Gangabass (Vicar) on Apr 27, 2014 at 01:14 UTC
Re: LWP and HTTPS by Khen1950fx (Canon) on Apr 26, 2014 at 19:21 UTC
FWIW, I've had a similar problem for the last 4 months with my smokers. The problem was with LWP::UserAgent and LWP::Protocol::https. I my case, I was using an external tar program. I solved the problem by doing: `cpan> o conf init prefer_external_tar cpan> <prefer_external_tar> Use the external tar program instead of Archive::Tar? [no] cpan> o conf commit` [download] Next, reinstall Crypt::SSLeay	[reply] [d/l]
Re: LWP and HTTPS by zentara (Archbishop) on Apr 26, 2014 at 14:46 UTC
Maybe Mechanize wants a cookie? WWW::Mechanize (and LWP) should use CONNECT for HTTPS request when a proxy is used? I'm not really a human, but I play one on earth. Old Perl Programmer Haiku ................... flash japh	[reply]


Come for the quick hacks, stay for the epiphanies.
	PerlMonks