shift-jis

Are there any problems converting between SHIFT_JIS and Unicode encodings?

I've heard there are (used to be?) ambiguous mappings between Unicode and SHIFT_JIS codes. This KB article somewhat proves this. So the question is: will I lose any data if I take SHIFT_JIS-encoded text, convert it to Unicode and back? Details: I'm talking about Windows (XP and on) and .NET (which in theory relies on NLS API). ...

Japanese COBOL code on IBM mainframe in Shift-JIS; represented after transfer to a PC how?

We have a Japanese client that has source code in COBOL on an mainframe. He claims the code on the mainframe is represented in Shift-JIS2 (and we think we understand that pretty well). When that code is transferred to an PC, what is the most common encoding used? We've sent him a program to process that COBOL code and it seems to cho...

how to open a URL with non utf-8 arguments

Hello, Using Python I need to transfer non utf-8 encoded data (specifically shift-jis) to a URL via the query string. How should I transfer the data? Quote it? Encode in utf-8? Thanks ...

How do I process lines with CRLF, NEL line terminators?

I need to process a file with shift_jis encoding. However the line terminators are in a format that im not familar with. > file record.CSV record.CSV: Non-ISO extended-ASCII text, with CRLF, NEL line terminators Im using the general: open my $CSV_FILE, "<:encoding(shift_jis)", $filename or die "Could not open: $CSV_FILE : $!"; whil...

Open a SHIFT_JIS file in Ruby 1.8.7

This is one of those things that seems like it should be laughably easy but I'm stuck... I need to open a CSV file that is stored in SHIFT_JIS encoding and decode it to Unicode and also encode in UTF-8. It sounds like this is pretty straightforward in ruby 1.9 but I'm not feeling particularly adventurous on my production Rails app, so I...

Using SHIFT_JIS text in PHP

I am building a form that needs to accept characters encoded in SHIFT_JIS and then send those results via email to a recipient. I've tried to simply capture the results from the $_POST variable and then to insert them into a block of text like this: $NameJp = $_POST['NameJp']; $contents = <<<TEST Name: $NameJp ... TEST but that does...

How to detect the character encoding of a file in Java?

Good day, Our application receives files from our users, and those files must be validated if they are of the encoding type that we support (i.e. UTF-8, Shift-JIS, EUC-JP), and once that file is validated, we would also need to save that file in our system and its encoding as meta-data. Currently, we're using JCharDet (which is a java ...

problem passing Japanese characters(UTF-8) via json_encode

Having problems returning a list of Japanese terms from an MSSql database as JSON. If I return them as a bunch of list items all is ok, but I can not seem to get json encode to work for me. Any pointers much appreciated. $prefs = array(); while($row = mssql_fetch_array($result)) { $prefs[] = mb_convert_encoding($row["Pref"] , "UTF-8", ...