ansaurus

Question

Repair bad character due to encoding problem

Answer 1

A:

As far as I know, the only means to fix is to use Replace:

Update Table
Set Column = Replace(Column, N'Ã¦', N'æ')

In this case, I'm assuming that the column is now Unicode (i.e. nvarchar or nchar).

Thomas 2010-05-27 15:35:34

I konw how to do a replace, here I want to deal with every weird character : "ó" became "Ã³". I 'd like to do something that'll handle every case (as I said in my post there is a logical connection between the expected character and the bad one, so there must be a way to go back).

remi bourgarel 2010-05-27 15:40:09

@remi bourgarel - That's my point. There is no silver bullet solution other than manually correcting the data through a series of calls to Replace. You will not get a 1:1 matching because in some cases, Unicode might have encoded your text as two characters instead of one character.

Thomas 2010-05-27 15:47:50

Answer 2

A:

if you read it in ascii you'll get "Ã¦".

ASCII only assigns characters to the bytes 00-7F. There are, however, several "extended ASCII" encodings in which C3 A6 represents "Ã¦", including the popular Western European encodings ISO-8859-1 and windows-1252, and Turkish ISO-8859-9 and windows-1254.

To fix your encoding problem, simply:

Encode the string to a byte array using code page 1252 (or 1254 for Turkish). This should produce the UTF-8 bytes.
Decode the byte array to a string using UTF-8.

dan04 2010-05-29 03:49:05

Do you have any idea if i can do it with sql ?

remi bourgarel 2010-05-31 07:38:41

ansaurus

tags:

views:

answers:

Repair bad character due to encoding problem

related questions