utf-8

utf8 and unicode getting warning messages in mysql

I have a mysql table. When I try to insert, I get this: Warning: Incorrect string value: '\xAE</...' for column 'value' at row 1 mysql> show create table Configurations; | Configurations | CREATE TABLE `Configurations` ( `id` int(11) NOT NULL AUTO_INCREMENT, `title` varchar(255) NOT NULL, `ckey` varchar(255) NOT NULL, `value` ...

export and import utf8 data in mysql: best practices

We're often faced with the need to send a data file to one of our clients with data from the database he/she needs to translate. Most of the time this export is CSV or XLS. Most of the time we create a csv dump with phpmyadmin and get an xls file in return with the translated data. The problem is that most of the time the data is UTF8 an...

Ruby On Rails and UTF-8

I have an Rails application with SayController, hello action and view template say/hello.html.erb. When I add some cyrillic character like "ю", I get an error: ArgumentError in SayController#hello invalid byte sequence in UTF-8 Headers: {"Cache-Control"=>"no-cache", "X-Runtime"=>"11", "Content-Type"=>"text/html; charset=utf-8"} ...

latin1/unicode conversion problem with ajax request and special characters

Server is PHP5 and HTML charset is latin1 (iso-8859-1). With regular form POST requests, there's no problem with "special" characters like the em dash (–) for example. Although I don't know for sure, it works. Probably because there exists a representable character for the browser at char code 150 (which is what I see in PHP on the serve...

al32utf8 in oracle and SQL Server and DB2 pulling data

I have a non-utf8 oracle database running on 11.1.0.7. We need to support greek characters. So we have two options: use nvarchar, nclob fields for those fields that need greek (it is not all fields). We have tested this and gotten it to work with java coding. convert Oracle to AL32UTF8 database. I am not asking how to do this. I got t...

ASP.NET 3.5 Page character encoding problem

Hello everyone. I have a problem in my asp.net 3.5 application (C#) when I try to render in my pages characters like 'è' which are shown in a very strange manner (if i'm lucky i get a ? mark in my web page). in fact Expression Web, when i open my web site, substitutes the è char with �... How can I tell asp.net that I want to use a parti...

json_encode with mysql content and umlauts in utf-8

Hey, i feel my beard growing while trying to find out the Problem here. Basic the Problem is, that Umlauts/Special Signs äöß ... don't work. I guess everyone is sick and tired of that questions but all the solutions found online don't seem to work. Im having utf-8 content in a utf-8 Mysql Database. I feel the Problem ist somewhere in ...

Running cUrl cmd from Win7 doesn't work, but on Linux it does.

Like the title says. I'm sending a simple cUrl cmd from Win7 to CouchDB on my Linux box, and it doesn't work. But if I run the same command in Linux, it works. I'm sending this: curl -X POST 192.168.2.5:5984/test/testdoc -d '{"owner":{"fname":"test","lname":"ing"}}' From windows, it keeps giving me a "error: bad request, reason:invali...

MalformedByteSequenceException while trying to pars XML

Hey guy, maybe someone can help: I have the following .gpx data from wikipedia: <?xml version="1.0" encoding="UTF-8" standalone="no" ?> <gpx xmlns="http://www.topografix.com/GPX/1/1" creator="byHand" version="1.1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.topografix.com/GPX/1/1 http://www.to...

utf8 format in xml

i want to know how to store this è (this type of symbols) in xml file if i store this symbol in xml file.. the file shows this symbol like � i was inserted in front of xml file is <?xml version="1.0" encoding="UTF-8"?> but that doest not shows correct thanks and advance ...

Django WebServices returning '\u' codes

Hey there, I have a Django database & backend and my WebService is returning \u codes in place of what should be UTF-8 characters. For example, the bullet mark character is '•' returned as '\u00ae'. My front end (an iPhone App) doesn't understand this as a bullet mark (•), and prints the UTF-8 code. I understand I need to somehow deco...

How to transcode Windows-1251 to UTF-8?

How to transcode Windows-1251 to UTF-8? Will such function do it? function win_to_utf($s) { for($i=0, $m=strlen($s); $i<$m; $i++) { $c=ord($s[$i]); if ($c<=127) {$t.=chr($c); continue; } if ($c>=192 && $c<=207) {$t.=chr(208).chr($c-48); continue; } if ($c>=208 && $c<=239) {$t.=chr(208).chr($c-48); continue; } if ($c>=240 && ...

How to encode into\decode from UTF-8 string in WPF ?

So I have a string like &#1056;&#1091;&#1089;&#1089;&#1082;&#1086;&#1077; &#1048;&#1084;&#1103; how to represent it as real string with wcf textBox? And How to encode for example russian string inputed into textInput into UTF-8? ...

What is better for PHP developers - Unicode or UTF-8?

What is better for PHP developers - Unicode or UTF-8? I am going to create an international CMS. So I am going to have clients all over the world. They will speak all possible languages. What encoding format is better for browser recognition and for DB data storage? ...

How do I read Unicode characters from an MS Access 2007 database through Java?

In Java, I have written a program that reads a UTF8 text file. The text file contains a SQL query of the SELECT kind. The program then executes the query on the Microsoft Access 2007 database and writes all fields of the first row to a UTF8 text file. The problem I have is when a row is returned that contains unicode characters, such as...

string recieve with utf8 format but have problem in java

hi i want to know how to receive the string from file in java... that file have different language letters... i used UTF-8 format... this can receive some language letters correctly... but Latin letters cant display correctly... so how can i receive all language letters... or any other format for receive all language letters... t...

Converting a file to UTF8 format using Perl

How do I convert a file to its utf-8 format using Perl? and how do I check whether the converted file is in utf-8 format? ...

Words issues with UTF8: What should content staff use?

Hello, Word is giving me alot of issues with UTF8 content, it usually comes out garbled and is alot of hassle converting. What editor would you advise content staff to use that is web safe? Regards Aaron ...

How to convert any possible format to UTF-8 using Iconv?

so for example this will turn 1251 into utf-8. $utf8 = iconv('windows-1251', 'utf-8', $ansi); But how to turn unknown (when it comes to us we do not know yet what format it is) ( in general any ) format (possibly known by Iconv ) to utf-8? (code sample) ...

Python file input string: how to handle escaped unicode characters?

In a text file (test.txt), my string looks like this: Gro\u00DFbritannien Reading it, python escapes the backslash: >>> file = open('test.txt', 'r') >>> input = file.readline() >>> input 'Gro\\u00DFbritannien' How can I have this interpreted as unicode? decode() and unicode() won't do the job. The following code writes Gro\u00DFbr...