perlquestion Jim A Concordance DAT file is simply a CSV text file that uses the following metacharacters: <ul> <li><tt>U+0014</tt> Field Separator ("Comma") <tt>[DEVICE CONTROL FOUR]</tt></li> <li><tt>U+00FE</tt> String Delimiter ("Quote") <tt>[LATIN SMALL LETTER THORN]</tt></li> <li><tt>U+00AE</tt> Newline Placeholder ("Newline") <tt>[REGISTERED SIGN]</tt></li> </ul> What's the best way to parse a Concordance DAT file using Modern Perl? Assume the following: <ul> <li>The file is in the UTF-8 character encoding form of Unicode</li> <li>The file has the Unicode byte order mark in it (<tt>U+FEFF</tt>), which must be handled properly</li> <li>Records are terminated by <tt><CR><LF></tt> pairs</li> <li>Despite the newline placeholder convention, fields can have literal <tt><CR></tt>, <tt><LF></tt>, and paired <tt><CR><LF></tt> characters in them</li> <li>The text in fields can be arbitrarily large (many megabytes)</li> </ul> Thanks! Jim