utf-8

iphone sqlite3_column_text issue

I have a column in sqlite3 table. Column has values like 1 ½” 1 ¾” 2 ½” etc. Column has VARCHAR datatype. I am using this code. pref_HoseDiameter = [NSString stringWithUTF8String:(char *)sqlite3_column_text(compiledStatement, 2)]; Now, when I am fetching these values from database, I am getting pref_HoseDiameter string values li...

php regex word boundary matching in utf-8

Hi, I have the following php code in a utf-8 php file: var_dump(setlocale(LC_CTYPE, 'de_DE.utf8', 'German_Germany.utf-8', 'de_DE', 'german')); var_dump(mb_internal_encoding()); var_dump(mb_internal_encoding('utf-8')); var_dump(mb_internal_encoding()); var_dump(mb_regex_encoding()); var_dump(mb_regex_encoding('utf-8')); var_dump(mb_regex...

Is UTF-8 enough for all common languages?

I just wanted to develop a translation app in a Django projects which enables registered users with certain permissions to translate every single message it appears in latest version. My question is, what character set should I use for database tables in this translation app? Looks like some european language characters cannot be stored...

the characters except 0x00-0x7F are not been shown when converted to "UTF-8" from "ISO-8859-1"

I need to get a string from URL request of brower, and then create a text image by requested text. I know the default encoding of the Java net transmission is "ISO-8859-1", it can works normally with all characters what defined in "ISO-8859-1". But when I request a multi-byte Unicode character (e.g. chinese or something like ¤ж), then I ...

the characters except 0x00-0x7F are not been shown when converted to “UTF-8” from “ISO-8859-1”

Possible Duplicate: the characters except 0x00-0x7F are not been shown when converted to UTF-8 from ISO-8859-1 I need to get a string from URL request of brower, and then create a text image by requested text. I know the default encoding of the Java net transmission is "ISO-8859-1", it can works normally with all characters wh...

Eclipse CDT: hieroglyphs in console and problem list

Recently, I switched from Visual Studio to Eclipse CDT. I've set it up beautifully such that the G++ compiler from my Cygwin installation can locate and compile my code without ado. There is a minor grievance, however. Each time G++ reports a warning or error, the curly single quotes ‘ and ’ appear as ‘ respectively ’. It seems like...

OS X: Terminal output of javac is garbled.

I've got my computer set up in Japanese (hey, it's good language practice), and everything is all fine and dandy... except javac. It displays localized error messages out to the console, but they're in Shift-JIS, not UTF8: $ javac this-file-doesnt-exist.java javac: ?t?@?C??????????܂???: this-file-doesnt-exist.java ?g????: javac <option...

pound sign in CSV file are not read during PHP fopen

Hi, I am having a problem, pound signs and single quotes are being read from a file as � My code is below: $fh = fopen($_FILES['importFile']['tmp_name'], "r"); $contents = fread($fh, filesize($_FILES['importFile']['tmp_name'])); var_dump($contents); Does anybody know how to fix this issue. I know its an encoding issue but unsure as...

Delphi 10, .NET, how do I convert a hex UTF-8 string to its unicode character?

Hi all, I am trying to make my web app compatible with international languages and I am stuck with trying to convert escaped characters in my Delphi .NET DLL. The front end code is passing the UTF-8 hex notation with an escape character e.g for お I pass \uE3818A. In my DLL I capture this and constract the following string '$E3818A'. ...

UTF-8 HTML and CSS files with BOM (and how to remove the BOM with Python)

First, some background: I'm developing a web application using Python. All of my (text) files are currently stored in UTF-8 with the BOM. This includes all my HTML templates and CSS files. These resources are stored as binary data (BOM and all) in my DB. When I retrieve the templates from the DB, I decode them using template.decode('utf...

How to normalize text content to UTF 8 in java

We have a CMS which has several thousand text/html files in it. It turns out that users have been uploading text/html files using various character encodings (utf-8,utf-8 w BOM, windows 1252, iso-8859-1). When these files are read in and written to the response our CMS's framework forces a charset=UTF-8 on the response's content-type at...

XML UTF-8 checksum highscore change

Hello, I am trying to manually change my paper-toss highscore for my ipod touch. I have gotten into the filesystem and seem to have found the file where the highscores are held. I change the value but the only problem is, is when i go back into the game all highscores are reset. I figure it is because of the checksum in the code. I do no...

Windows to Linux utf-8 file

I have a file UTF-8 encoding in windows, and when i use it under windows it shows everithing right, but when i copy the file in Linux, the Unicode characters are giberish. The file is plain textfile. How can i get this file to be readable in linux, or how can i copy it properly?? thanks in advance ...

How does CouchDB handle UTF-8?

I'm quite puzzled by CouchDB: if I send a PUT request with some JSON string fields encoded as UTF-8, the non 7 bit ASCII characters get converted to the "\uXXXX" escape sequence. Is there any way to tell it not to escape UNICODE? ...

How to read.table with "Hebrew" column names (in R)?

Hi all, I am trying to read a .txt file, with Hebrew column names, but without success. I uploaded an example file to: http://www.talgalili.com/files/aa.txt And am trying the command: read.table("http://www.talgalili.com/files/aa.txt", header = T, sep = "\t") This returns me with: X.....ª X...ª...... X...œ.... 1 12 ...

JQuery AJAX is not sending UTF-8 to my server, only in IE.

I am sending UTF-8, japanese text, to my server. It works in Firefox. My access.log and headers are: /ajax/?q=%E6%BC%A2%E5%AD%97 Accept-Charset ISO-8859-1,utf-8;q=0.7,*;q=0.7 Content-Type application/x-www-form-urlencoded; charset=UTF-8 Howeer, in IE8, my access.log says: /ajax/?q=?? For some reason, IE8 is turning my AJAX cal...

Python utf-8, howto align printout

Hi, I have a array containing japanese caracters as well as "normal". How do I align the printout of these? #!/usr/bin/python # coding=utf-8 a1=['する', 'します', 'trazan', 'した', 'しました'] a2=['dipsy', 'laa-laa', 'banarne', 'po', 'tinky winky'] for i,j in zip(a1,a2): print i.ljust(12),':',j print '-'*8 for i,j in zip(a1,a2): print...

Why can I not view foreign language characters in my mysql DB?

I am inserting the following characters into my DB: 汉字 / 漢字 This is the meta tag on the page that is inserting the characters: <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> I have altered all the columns in my table that is holding the characters to be utf8_unicode_ci The foreign characters show up like so in...

example of a utf-8 format octet string

I'm working w/ a function that expects a string formatted as a utf-8 encoded octet string. Can someone give me an example of what a utf-8 encoded octet string would look like? Put another way, if I convert 'foo' to bytes, I get 112, 111, 111. What would these char codes look like as a utf-8 encoded octet string? Would it be "0x70 0...

Possible to repair garbled Chinese filenames?

I'm downloading via FTP some files with chinese names (BIG5 encoded), and Filezilla displays those filenames as garbage (as FTP cannot handle any encoding other than ASCII and UTF-8, as least the standard compliant ones). Given a filename with garbled characters, is it possible for me to repair the encoding and get a proper filename St...