Re^3: A complicated file parsing and 2D array/matrix problem.

in reply to Re^2: A complicated file parsing and 2D array/matrix problem.
in thread A file parsing and 2D array/matrix problem.

I think you've done well in your attempt to create a matrix to represent your data set. Perhaps the following will help further your efforts:

use Modern::Perl;
use File::Slurp qw/read_file/;
use Text::Table;
use Data::Dumper;

my ( %supermatrix, @titles, %seen, @rows );

my @list = read_file 'LIST.txt';

for ( my $i = 0 ; $i < $#list + 1 ; $i += 2 ) {
    my ($substrateID) = $list[$i] =~ /(\d+)/g;
    $supermatrix{$substrateID}{$1} = 1 while $list[ $i + 1 ] =~ /(\d+)
+/g;
}

for my $product ( read_file 'SUPERLIST_PRODUCT.txt' ) {
    my ($productID) = $product =~ /(\d+)/g;
    push @titles, $productID unless $seen{$productID}++;

    for my $substrate ( read_file 'SUPERLIST_SUBSTRATE.txt' ) {
        my ($substrateID) = $substrate =~ /(\d+)/g;
        $supermatrix{$substrateID}{$productID} //= '.';
    }
}

my $titles = join ',',
  map "{title => 'p$_', align_title => 'center', align => 'center'}",
  sort { $a <=> $b } @titles;

for my $y ( sort { $a <=> $b } keys %supermatrix ) {    #rows
    my ( $rowLable, @row );

    for my $x ( sort { $a <=> $b } keys %{ $supermatrix{$y} } ) {    #
+columns
        $rowLable = $y unless $rowLable;
        push @row, $supermatrix{$y}{$x};
    }
    push @rows, [ "s$rowLable", @row ];
}

my $tb = Text::Table->new( ' ', eval $titles );
$tb->load(@rows);
say $tb;

say "\n", Dumper \%supermatrix;
[download]

Partial output:

      p1825 p1875 p2543 p2809 p3182 p3186 p3419 p3485 p3486 p3487 p348
+8 p3489 p3490 p3492 p3647 p3648 p3674 p3877
s2809   .     .     .     .     1     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3006   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3049   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3182   .     1     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3186   .     .     .     1     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3314   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3485   .     .     .     .     .     .     .     .     1     .     . 
+    .     .     .     .     .     .     .  
s3486   .     .     .     .     .     .     .     .     .     .     1 
+    .     .     .     .     .     .     .  
s3487   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     1  
s3488   .     .     .     .     .     .     .     .     .     1     . 
+    .     .     .     .     .     .     .  
s3489   .     .     .     .     .     .     .     .     .     .     . 
+    .     1     .     .     .     .     .  
s3490   .     .     .     .     .     .     .     1     .     .     . 
+    .     .     .     .     .     .     .  
s3492   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     .     .  
s3645   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     1     .     .     .  
s3649   .     .     .     .     .     .     1     .     .     .     . 
+    .     .     .     .     1     .     .  
s3659   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     1     .     .     .  
s3674   .     .     .     .     .     .     .     .     .     .     . 
+    1     1     .     .     .     .     .  
s3675   .     .     .     .     .     .     .     .     .     .     . 
+    .     .     .     .     .     1     .  
s3877   .     .     .     .     .     .     1     .     .     .     . 
+    .     .     .     .     .     .     .  

$VAR1 = {
          '3182' => {
                      '1825' => '.',
                      '3182' => '.',
                      '3877' => '.',
                      '3647' => '.',
                      '3489' => '.',
                      '3419' => '.',
                      '2809' => '.',
                      '3488' => '.',
                      '1875' => 1,
                      '2543' => '.',
                      '3492' => '.',
                      '3485' => '.',
                      '3186' => '.',
                      '3487' => '.',
                      '3648' => '.',
                      '3674' => '.',
                      '3490' => '.',
                      '3486' => '.'
                    },
...
[download]

Values are stored in the hash as follows: $supermatrix{substrateID}{productID}, where substrateIDs name the rows, and productIDs name the columns.

The hash is first initialized using the data from LIST.txt, assigning 1 to each substrateID/productID 'location.' The next, nested for loops complete the matrix, assigning a '.' to undefined substrateID/productID 'locations' (the '.' was used so the matrix could be visualized).

Finally, the matrix is printed, followed by a dump of the hash.

Hope this helps!

Comment on Re^3: A complicated file parsing and 2D array/matrix problem. Select or Download Code

Replies are listed 'Best First'.
Re^4: A complicated file parsing and 2D array/matrix problem. by zing (Beadle) on Aug 27, 2012 at 08:12 UTC
Hello Kenosis. Now there's the last piece of puzzle. I have created 5 such matrices (with obviously same number of rows and column). Now the problem is that I have to concatenate (OR logic operation) two such matrices, INPUT = Two matrices A,B of same row and column saved in text files A.txt and B.txt OUTPUT = A single matrix C ( Ci j = Ai j OR Bi j ) `==============INPUT======= MAT - A 1875 2809 3182 3419 2809 - 1 1 - 3182 1 - - - 3186 1 1 - - 3485 - - - - 3486 - - - - MAT - B 1875 2809 3182 3419 2809 1 - - 1 3182 - - - - 3186 - 1 1 - 3485 - - - - 3486 - 1 - 1 ========== OUTPUT=========== MAT - C 1875 2809 3182 3419 2809 1 1 1 1 3182 1 - - - 3186 1 1 1 - 3485 - - - - 3486 - 1 - 1` [download] I.e. an element of matrix will be one if either of the corresponding element of A or B is one.	[reply] [d/l]
Re^5: A complicated file parsing and 2D array/matrix problem. by Kenosis (Priest) on Aug 27, 2012 at 18:18 UTC
Hi, zing! What have you tried so far to solve this puzzle?	[reply]
Re^6: A complicated file parsing and 2D array/matrix problem. by zing (Beadle) on Aug 27, 2012 at 19:20 UTC
Kenosis, This is what Im trying, but is throwing a lot of errors. `open FILE, "Matrix.txt" or die $!; my @lines = <FILE>; my $size = scalar @lines; my @matrix = (1 .. 3); my $i = 0; my $j = 0; my @micro; foreach ($matrix) { foreach ($lines) { push @{ $micro[$matrix]}, $lines; } }` [download] CONTENTS OF matrix.txt 1 2 3 4 1 5 6 8 1 7 8 0 I need to be able to access each element of the matrix thus created on a "one by one basis".	[reply] [d/l]
Re^7: A complicated file parsing and 2D array/matrix problem. by Kenosis (Priest) on Aug 27, 2012 at 20:15 UTC
Re^4: A complicated file parsing and 2D array/matrix problem. by zing (Beadle) on Sep 04, 2012 at 07:36 UTC
Kenosis, Theres a small problem. I tried to check whether the code is giving desired output,but it isnt giving the complete result.Consider my LIST.txt substrate[s]: 1 2 product[s]: 3 substrate[s]: 6 9 product[s]: 8 10 substrate[s]: 3 product[s]: 6 substrate[s]: 9 product[s]: 5 substrate[s]: 5 product[s]: 2 substrate[s]: 3 product[s]: 9 substrate[s]: 8 product[s]: 9 substrate[s]: 8 product[s]: 1 substrate[s]: 7 product[s]: 11 substrate[s]: 19 product[s]: 17 substrate[s]: 14 product[s]: 13 substrate[s]: 14 product[s]: 11 substrate[s]: 18 product[s]: 19 substrate[s]: 7 14 product[s]: 15 substrate[s]: 7 16 product[s]: 7 17 substrate[s]: 5 product[s]: 6 substrate[s]: 18 15 product[s]: 7 substrate[s]: 7 8 product[s]: 8 18 substrate[s]: 6 product[s]: 9 substrate[s]: 11 product[s]: 12 [download] SUPERLIST_SUBSTRATE `1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19` [download] SUPERLIST_PRODUCT `1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19` [download] ******OUTPUT****** p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11 p12 p13 p14 p15 p16 p17 p18 p19 s1 . . 1 . . . . . . . . . . . . . . . . s2 . . . . . . . . . . . . . . . . . . . s3 . . . . . 1 . . 1 . . . . . . . . . . s4 . . . . . . . . . . . . . . . . . . . s5 . 1 . . . 1 . . . . . . . . . . . . . s6 . . . . . . . 1 1 1 . . . . . . . . . s7 . . . . . . 1 1 . . 1 . . . 1 . 1 1 . s8 1 . . . . . . . 1 . . . . . . . . . . s9 . . . . 1 . . . . . . . . . . . . . . s10 . . . . . . . . . . . . . . . . . . . s11 . . . . . . . . . . . 1 . . . . . . . s12 . . . . . . . . . . . . . . . . . . . s13 . . . . . . . . . . . . . . . . . . . s14 . . . . . . . . . . 1 . 1 . . . . . . s15 . . . . . . . . . . . . . . . . . . . s16 . . . . . . . . . . . . . . . . . . . s17 . . . . . . . . . . . . . . . . . . . s18 . . . . . . 1 . . . . . . . . . . . 1 s19 . . . . . . . . . . . . . . . . 1 . . [download] Consider first two lines of LIST.txt - `substrate[s]: 1 2 product[s]: 3` [download] . Then there is a "1" s1-p3, but there isn;t a "1" for s2-p3. ################DESIRED OUTPUT -- Places marked with "X" need to be "1" ################# p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11 p12 p13 p14 p15 p16 p17 p18 p19 s1 . . 1 . . . . . . . . . . . . . . . . s2 . . X . . . . . . . . . . . . . . . . s3 . . . . . 1 . . 1 . . . . . . . . . . s4 . . . . . . . . . . . . . . . . . . . s5 . 1 . . . 1 . . . . . . . . . . . . . s6 . . . . . . . 1 1 1 . . . . . . . . . s7 . . . . . . 1 1 . . 1 . . . 1 . 1 1 . s8 1 . . . . . . X 1 X . . . . . . . X . s9 . . . . 1 . . . . . . . . . . . . . . s10 . . . . . . . . . . . . . . . . . . . s11 . . . . . . . . . . . 1 . . . . . . . s12 . . . . . . . . . . . . . . . . . . . s13 . . . . . . . . . . . . . . . . . . . s14 . . . . . . . . . . 1 . 1 . X . . . . s15 . . . . . . X . . . . . . . . . . . . s16 . . . . . . X . . . . . . . . . X . . s17 . . . . . . . . . . . . . . . . . . . s18 . . . . . . 1 . . . . . . . . . . . 1 s19 . . . . . . . . . . . . . . . . 1 . . [download]	[reply] [d/l] [select]
Re^5: A complicated file parsing and 2D array/matrix problem. by Kenosis (Priest) on Sep 05, 2012 at 14:59 UTC
Hi, zing. Was this issue resolved? I noticed a new posting where a blank line in a file was mentioned...	[reply]
Re^6: A complicated file parsing and 2D array/matrix problem. by zing (Beadle) on Sep 05, 2012 at 23:17 UTC
Kenosis it was resolved. Im facing another issue. I need to pick list.txt files one by one from each 5 subdirectories(d1,d2,d3,d4,d5) in the present directory. Here's the relevant snippet from the code `#!/usr/bin/perl use strict; use warnings; use List::Util qw/ max /; open my $fh, "<", 'SUPERLIST_PRODUCT' or die $!; my $spr_prod = do {local $/; <$fh>}; close $fh or die $!; my @spr_prod = $spr_prod =~ /\d+/g; open $fh, "<", 'SUPERLIST_SUBSTRATE' or die $!; my $spr_substr = do {local $/; <$fh>}; close $fh or die $!; my @spr_substrate = $spr_substr =~ /\d+/g; my @matrix; my $path = '.'; # (current directory - '.') or path to data files my @file = qw/list.txt/;` [download]	[reply] [d/l]
Re^7: A complicated file parsing and 2D array/matrix problem. by Kenosis (Priest) on Sep 06, 2012 at 01:31 UTC

In Section Seekers of Perl Wisdom