Beefy Boxes and Bandwidth Generously Provided by pair Networks chromatic writing perl on a camel
laziness, impatience, and hubris
 
PerlMonks  

Re^3: i need help to download text data from ensemble for a project

by Anonymous Monk
on Feb 28, 2012 at 13:23 UTC ( #956654=note: print w/ replies, xml ) Need Help??

Comment on Re^3: i need help to download text data from ensemble for a project
Re^4: i need help to download text data from ensemble for a project
by aaabc (Initiate) on Feb 28, 2012 at 13:31 UTC
    ok this is not related to problem really, anyway correct me if i am mistaken but if you are trying to say that what i do, may be illegal in terms of service. no it is not. just there is not much demand for alignments of 6 primates (there many many different alignments) that they just dont provide servives to download as a whole. this is science and information is open to public.

      Ok, so I go to http://www.ensembl.org/ to check the TOS and I see

      Fetch only the data you want from our public database, using the Perl API

      So here you go

      #!/usr/bin/perl -- use strict; use warnings; use autodie qw/ system /; my $ensemblUrl = '......r='; ## rearrange like this my $start_range = 4953971; my $end_range = 5753970; my $range_increment = $end_range - $start_range; for my $times ( 0 .. 10 ){ my $range = $start_range.'-'.$end_range; my $rangefile = "$range.txt"; system qw/ wget -c /, '-O', $rangefile, $ensemblUrl.$range ; $start_range = $end_range ; $end_range = $start_range + $range_increment; }

        Bah! Forget it! As Marshalls points out this would violate the TOS, and that is not nice. Don't use this code.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://956654]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (6)
As of 2013-05-25 00:37 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best material for plates (tableware) is:









    Results (516 votes), past polls