ansaurus

Question

Answer 1

+1 A:

GB 2312 is mostly compatible with GB 18030, so any tool able to deal with the latter should treat GB 2312 correctly as well. There are many tools for converting GB 18030 to UTF-8 (or some other Unicode encoding form), but I can't recommend any specific one for Windows, because I work on Unix. If you're wanting to write a bit of code, the iconv library, or ICU, springs to mind: you'll find all the conversion data readily available in these libraries.

Conversion from GB 2312 to UTF-8 is completely safe and lossless, you shouldn't worry about it.

Arthur Reutenauer 2008-12-18 23:13:49

Answer 2

+1 A:

I might be thinking a bit too simple here, but if it's just this one plain text file, you could try the following:

Replace all & by &, all < by < and all > by > (to be on the safe side)
Prepend the following to the text file:

<html><head><meta http-equiv="Content-Type" content="text/html; charset=gb2312" /></head><body><pre>
Open the file in your favorite browser
Select and copy all text
Paste it in Notepad and save as UTF-8.

You'd be done with this before you could have written any code to do the conversion or downloaded any programs that would do the conversion for you.

Of course, I'm not a hundred percent sure this'll work, and your browser would need the correct fonts and everything, but considering you're working with these kinds of files I'm assuming you already have those.

mercator 2008-12-19 01:18:29

Answer 3

+3 A:

You can try this online service that uses the Open Source iconv utility.
You can also install Charco, a command-line version of it on your machine.

For GB2312, you can use CP936 as the encoding.

If you are a .Net developer you can make a small tool that does just that.
I've struggled with this as well and found that it was actually simple to solve from a programmatic point of view.

All you need is something like this (I tested it and it works):

In C#

static void Main(string[] args) {
    string infile = args[0];
    string outfile = args[1];

    using (StreamReader sr = new StreamReader(infile, Encoding.GetEncoding(936))) {
        using (StreamWriter sw = new StreamWriter(outfile, false, Encoding.UTF8)) {
            sw.Write(sr.ReadToEnd());
            sw.Close();
        }
        sr.Close();
    }
}

In VB.Net

Private Shared Sub Main(ByVal args() As String)
    Dim infile As String = args(0)
    Dim outfile As String = args(1)
    Dim sr As StreamReader = New StreamReader(infile, Encoding.GetEncoding(936))
    Dim sw As StreamWriter = New StreamWriter(outfile, false, Encoding.UTF8)
    sw.Write(sr.ReadToEnd)
    sw.Close
    sr.Close
End Sub

Renaud Bompuis 2008-12-19 02:05:55

ansaurus

tags:

views:

answers:

Convert GB2312 to UTF-8

related questions