Yes, it's plain Perl syntax, but e.g. the classic Perl Best Practices by Damian Conway as well as the corresponding Module Perl::Critic (which you can use as a code quality tool for your own code) are against such postfix contructs for readability and maintainability reasons, the sole exception being postfix if as in your example for simple control statements. (You can change the behaviour of Perl::Critic if you want to use it but disagree with this, see the documentation!)
in reply to Are there any other statements that are like return if...?
Personally I use postfix only in case the whole block fits in one line.