tags:

views:

32

answers:

2

i need to remove all multibyte characters from a file, i dont know what they are so i need to cover the whole range.

I can find them using grep like so: grep -P "[\x80-\xFF]" 'myfile'

Trying to do a simular thing with sed, but delete them instead.

Cheers

A: 

you can use iconv to convert from one encoding to another

ghostdog74
doesnt seem to work? :s
odtf
A: 

Give this a try:

LANG=C sed 's/[\x80-\xFF]//g' filename
Dennis Williamson
this worked a treat, you are a gent sir!
odtf