comment on

Hi,
I'd use the $/ (a.k.a. $INPUT_RECORD_SEPARATOR) variable to set to the line that separates the html pages and read one "page" at a time:

#!/usr/bin/perl

use strict;
use warnings;

$/ = '---this line is the separator---';

while (<DATA>) {
    $_ =~ s#$/##; # strip the separator line
    print "Data to process: \n$_\n";
}


__DATA__
<html>
  <body>file 1</body>
</html>
---this line is the separator---
<html>
  <body>file 2</body>
</html>
---this line is the separator---
<html>
  <body>file 3</body>
</html>
---this line is the separator---
<html>
  <body>file 4</body>
</html>
---this line is the separator---
<html>
  <body>file 5</body>
</html>
---this line is the separator---
[download]

Regards,
svenXY

PS: --who on earth puts 65GB of HTML pages in one file?

In reply to Re: Slurping a large (>65 gb) into buffer by svenXY
in thread Slurping a large (>65 gb) into buffer by downer

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


The stupid question is the question not asked
	PerlMonks