Illegal character CTRLCHAR code 27

[ultranerds]

Hi,

I'm working on a perl script to insert records into a Solr (lucine) install. However, for some of the records I'm getting an error about a "code 27"

Request error : 400 Illegal character CTRLCHAR code 27  at rowcol unknownsource 1778 at /home/user/domain.com/www/admin/Plugins/Solr/Users/Update.pm line 164.

I've done a little searching on google, and it seems like a "code 27" is the "excape" charachter.

Is there a simple way of filtering out these "control" charachters, so this doesn't even happen again?

At the moment, I'm doing it with a regex + tr{}

        $user->{$col} =~ s/\n+/\./sig;;
        $user->{$col} =~ tr{&[]ÀÂÄàâäÇçÉÊÈËéêèëÏÌÎïìîÖÔÒöôòÜÛÙüûùA-Z?!
+;,.«»()" '}{   aaaaaacceeeeeeeeiiiiiioooooouuuuuua-z           __};

...but thats obviously not filtering out those "special charachters" :(

Any suggestions are much appreciated :)

TIA

Andy

[moritz]

ultranerds,

You have 108 writeups here at perlmonks - you still don't know how to write a regex/substitution to remove a character from a string? Or if you don't remember how to do it, you don't know how to find the documentation that explains it?

Then let me point you at http://perldoc.perl.org/ and hope that you bookmark and/or remember the address.

[ultranerds]

Hi,

I know how to remove a charachter, but wasn't sure what to use for the control charachter (as I've never had to do that)

This seems to do the trick though:

$user->{$col} =~ tr/\000-\037/ /;

Cheers

Andy

[moritz]

I think you're not testing your code properly:

$ perl -wE '$_="\01\02"; say length; tr/\000-\007//; say length'
2
2

Nothing removed. (Update: But replaced, see Re^5: Illegal character CTRLCHAR code 27) Still you're on the right track. For deleting with tr///, you need a trailing /d:

$ perl -wE '$_="\01\02"; say length; tr/\000-\007//d; say length'
2
0

[CountZero]

You are adressing the symptoms but did you check where exactly those escapes were in your file / records? Perhaps there was a very good reason for them to be there?