perlquestion
Anonymous Monk
<p>My input is a text file that I created by copying the contents of a PDF and pasting to notepad and saving (which dropped unicode). I then FTPd the text file to my Linux box where I am running the code below. I am simply trying to read each line of the text file, split each line into words and load each word into a hash key with a value of '1' attached to it. Running the map version only loads my hash with LOW, RES and PDF while the for loop version seems to work fine. Why? Does it have something to do with the <> in the map?
<p>The input looks like this, for example...
<code>LOW-RES PDF
NOT PRINT-READY
MY BIG TOE
BOOK 1:
A WAKENING
Section 1
Delusion or Knowledge:
Is This Guy Nuts, or What?
Section 2
Mysticism Demystified
The Foundations of Reality
LOW-RES PDF
NOT PRINT-READY
The My Big TOE reality model will help
you understand your life, your purpose,
</code>
<p>This seems to work:
<code>#!/usr/bin/perl -w
use strict;
use Data::Dumper;
my %hash;
for my $line ( <> ) {
for my $word ( split /(\s+|\W+)/, $line ) {
chomp $word;
$hash{$word} = '1';
}
}
print Dumper(%hash);
dbmathis@bamboo [~/mbt_index]# cat new_ib1.txt | head -100 | ./validation_poc.pl | head -20
$VAR1 = '';
$VAR2 = '1';
$VAR3 = 'you';
$VAR4 = '1';
$VAR5 = ' ';
$VAR6 = '1';
$VAR7 = 'put';
$VAR8 = '1';
$VAR9 = 'dust';
$VAR10 = '1';
$VAR11 = 'my';
$VAR12 = '1';
$VAR13 = 'delivered';
$VAR14 = '1';
$VAR15 = 'business';
$VAR16 = '1';
$VAR17 = 'power';
$VAR18 = '1';
$VAR19 = 'Seeburg';
$VAR20 = '1';</code>
<p>But this doesn't:
<code>#!/usr/bin/perl -w
use strict;
use Data::Dumper;
my %hash;
%hash = map { chomp; $_ => '1' } split /(\s+|\W+)/, <>;
print Dumper(%hash);
dbmathis@bamboo [~/mbt_index]# cat new_ib1.txt | head -100 | ./validation_poc.pl | head -20
$VAR1 = '';
$VAR2 = '1';
$VAR3 = '-';
$VAR4 = '1';
$VAR5 = 'LOW';
$VAR6 = '1';
$VAR7 = ' ';
$VAR8 = '1';
$VAR9 = 'PDF';
$VAR10 = '1';
$VAR11 = 'RES';
$VAR12 = '1';</code>
7