Re: How to reverse a (Unicode) string

Replies are listed 'Best First'.
Re^2: Repurposing reverse by ikegami (Patriarch) on Jan 24, 2011 at 06:50 UTC
It reverses Unicode code points No. It doesn't know anything about Unicode and there's no requirement for the string to be Unicode text. not characters in the usual, well-understood sense of the word. In my experience, "character" is the constituent element of a string, and never a grapheme except by happenstance. Let's just say there is no such consensus. Regardless, that's the definition used here. If I understand the design principles of Perl correctly, the reverse function should properly reverse extended grapheme clusters No. `reverse` provides a vital string operation. It should not assume the string is Unicode text. Reversing text is also a useful function, but it is not provided by `reverse`. Same goes with `substr` and `length`. when the thing being reversed is Unicode text (and Perl understands it is Unicode text), and it should reverse bytes otherwise. Perl doesn't have a means of "understanding a string is Unicode text".	[reply] [d/l] [select]
Re^3: How to reverse a (Unicode) string by Jim (Curate) on Jan 31, 2011 at 08:10 UTC
The documentation of Perl's `reverse` function states: "In scalar context, [the reverse function] ... returns a string value with all characters in the opposite order." No. It doesn't know anything about Unicode and there's no requirement for the string to be Unicode text. The documentation is quite clear: In scalar context, the reverse function operates on strings. If the string is Unicode, it reverses Unicode code points. If the string is in some single-byte character encoding such as ISO 8859-1 (Latin 1), then it reverses those characters. It's really very straightforward. You're once again trying to make some esoteric point about the distinction between strings and bytes, and what is Unicode and what is not Unicode. But your peculiar, persistent point isn't relevant here. Nothing in my post is incorrect or inaccurate, yet the supercilious tone of your response wrongly implies that something is incorrect. The topic of this discussion is Unicode text, so of course I'm talking about Unicode text in it. In my experience, "character" is the constituent element of a string, and never a grapheme except by happenstance. Let's just say there is no such consensus. What is a character in a language is well-understood and rarely, if ever, subject to debate. In the case of Unicode, "character" is well-defined, too: It's a "grapheme." It's as simple as that. Read the Unicode Standard. There are four characters in the word "Café", not five. When you arrange the four characters in the opposite order, you get "éfaC". This fact is the very basis of this tutorial and discussion. No. reverse provides a vital string operation. It should not assume the string is Unicode text. Your insistence that there's a difference between "string" and "text" may have some strange basis in the arcane details of the internals of Perl, but it has no relevance to this discussion. The whole premise of this discussion is that we're trying to reverse Unicode strings (Unicode text). And the salient point about Perl's reverse function is that it fails to reverse properly an infinite number of possible Unicode strings. Reversing text is also a useful function, but it is not provided by reverse. This is a bizarre and incomprehensible statement. What's the difference between a "string" and "text" to someone writing a Perl program? Explain why you think this… use utf8; binmode STDOUT, ':encoding(UTF-8)'; my $Moonshine = "Rươňu đêě"; my $enihsnooM = reverse $Moonshine; print "$Moonshine\n"; print "$enihsnooM\n"; …should produce different output than this… use utf8; binmode STDOUT, ':encoding(UTF-8)'; my $Moonshine = "Rươňu đêě"; my $enihsnooM = join '', reverse $Moonshine =~ m/\X/g; print "$Moonshine\n"; print "$enihsnooM\n";	[reply] [d/l]
Re^4: Repurposing reverse by ikegami (Patriarch) on Jan 31, 2011 at 08:56 UTC
The documentation is quite clear: In scalar context, the reverse function operates on strings Yes. You're once again trying to make some esoteric point about the distinction between strings and bytes, No. Quite the opposite, I'm saying there is no distinction. `reverse` doesn't know or care what the string is, and has no way of knowing. It will reverse the characters (elements?) of the string. What is a character in a language is well-understood and rarely, if ever, subject to debate You opened the debate! Again, a common CS definition is used here: A string is a sequence of elements named characters. Would you care to suggest an alternative? What is a character in a language is well-understood and rarely, if ever, subject to debate. In the case of Unicode, "character" is well-defined, too: It's a "grapheme." It's as simple as that. Read the Unicode Standard. Unicode has four definitions for "character", and none correspond exactly to that of "grapheme". But it's irrelevant. Again, `reverse` function isn't to manipulate text. There are four characters in the word "Café", not five. Yes, but irrelevant. `reverse`'s function isn't to manipulate words. There are five characters in the string chr(0x43).chr(0x61).chr(0x66).chr(0x65).chr(0x301). Your insistence that there's a difference between "string" and "text" may have some strange basis in the arcane details of the internals of Perl, Again, quite the opposite. It has nothing to do with Perl internals. It's not even specific to Perl. A string is a data type. Text is one of many things that can be stored in a string. `my $x = "abcd"; # String? yes. Text? my $host = inet_ntoa($x); # No, "packed" IP address` [download] `my $x = "abcd"; # String? yes. Text? print("The password is $x\n"); # Yes.` [download] You're suggesting that Perl should reverse strings as if they're text. For example, you say `chr(0x65).chr(0x301)` [download] should return `chr(0x65).chr(0x301)` [download] But that's wholly inappropriate for water level measurements or for anything else the string might be. There is need for a function that reverses strings (`chr(101).chr(769) ⇒ chr(769).chr(101)`). There is also a need for a function that reverses text (`chr(101).chr(769) ⇒ chr(101).chr(769)`). `reverse` does the former.	[reply] [d/l] [select]
A reply falls below the community's threshold of quality. You may see it by logging in.
Re^4: Repurposing reverse by ikegami (Patriarch) on Jan 31, 2011 at 09:01 UTC
As for the question you added, Explain why you think this……should produce different output than this… I agree that there should be a function that does that, but it's not `reverse`. Explain why you think `my $water_samples = join '', map chr, 113, 101, 769; my $last_sample = substr($water_samples, -1, 1); print(ord($last_sample), "\n");` [download] should produce different output than `my $water_samples = join '', map chr, 113, 101, 769; $water_samples = reverse($water_samples); my $last_sample = substr($water_samples, 0, 1); print(ord($last_sample), "\n");` [download] Update: Corrected my numbers.	[reply] [d/l] [select]
A reply falls below the community's threshold of quality. You may see it by logging in.
Re^2: How to reverse a (Unicode) string by Anonymous Monk on Jan 24, 2011 at 03:56 UTC
One or the other is wrong perlbug	[reply]


No such thing as a small change
	PerlMonks