How can I deal with this encoding?

Question

Hi all,

I'm now trying to parse chrome bookmarks, but I encounter a problem. the bookmarks snippet is presented as follow:

    {
        "date_added": "12915566290018721",
        "id": "16",
        "name": "hao123\uFF0D\uFF0D\u6211\u7684\u4E0A\u7F51\u4E3B\u9875",
        "type": "url",
        "url": "http://www.hao123.com/"
     }

the string coding corresponding to name field is stored as "hao123\uFF0D\uFF0D\u6211\u7684\u4E0A\u7F51\u4E3B\u9875", but it should be "hao123--我的上网主页" to provide to users. How can I transform "hao123\uFF0D\uFF0D\u6211\u7684\u4E0A\u7F51\u4E3B\u9875" to "hao123--我的上网主页"?

thanks!

Answer 1

What you're looking at are UTF-16 code points in the string. Unless you have a JSON library that handles Unicode for you, consider iterating the string and looking for the escape sequence that denotes the UTF-16 code point "\u". From there you can transform the string to whatever encoding is necessary for it to output properly.

Answer 2

As far as I can tell from looking at the Jsoncpp source code, it looks like it should decode the string properly and you'll get a UTF-8 string back. If that is not what you're seeing, please post the code that you're actually using, and what you're getting back instead.

Answer 3

Thanks codeka, I solve the problem.

 std::string name = root.get("name","").asString(); 
 cout<<name<<endl;

 int len=strlen(name.c_str())+1;
 WCHAR outName[MAX_PATH];
// MultiByteToWideChar(CP_UTF8, 0, name.c_str(), len, outName, len);


 char outch[MAX_PATH];
 WCHAR * wChar=new WCHAR[len];
 wChar[0]=0;
 MultiByteToWideChar(CP_UTF8, 0, name.c_str(), len, wChar, len);
 WideCharToMultiByte(CP_ACP, 0, wChar, len, outch , len, 0, 0);
 delete [] wChar;




  cout<<outch<<endl;

Thanks codeka & fbrereto again.