encoding

UTF-8 vs Latin1 mysql, indexes not used on utf-8

Hi, I have tried creating my mysql tables with both UTF-8 and Latin1 Char sets. When I use Latin1 my indexes are used, when I use UTF-8 indexes are not used when selecting/limiting records. Is there something I am missing with the Char sets that causes this to happen? Cheers Ke ...

Django legacy database encoding

Hello, I'm sure this question is not specific to django, but since I couldn't find any solution for my problem in other questions about python and encodings, I'm going to ask this. I need to add new features to existing website which is written in PHP using MySQL as backend. I inspected the database and created models for tables I am goi...

Encoding Problems With ID3 Tags

I have an ID3v1 tag that shows up in iTunes like: "It's Been A While". But when I read the tags with the libtag library "It¹s Been A While" comes out. Now when I open the file with a hex editor, I can see that it actualy is 0xB9 which is ¹ on Latin-1 and UTF-8/16. So how does Itunes get a ’ from 0xB9? Any ideas? Is there any character en...

Pure C# Silverlight video encoding lib?

Is out there any Pure C# Silverlight video encoding lib? By video I mean not only pictures compressor but also audio compressor... So to say I'm looking for some kind of lib not only for compressing but also for sinchronisation etc... so to say I give it a web cam it gives me a conteiner!) ...

Python UTF-16 WAVY DASH encoding question / issue

Hi. I was doing some work today, and came across an issue where something "looked funny". I had been interpreting some string data as utf-8, and checking the encoded form. The data was coming from ldap (Specifically, Active Directory) via python-ldap. No surprises there. So I came upon the byte sequence '\xe3\x80\xb0' a few times, which...

Encode East Asian languages using Python

This may not really be a Python related question, but pertains to language encoding in general. I'm mining tweets from Twitter, and it appears that there is a large Japanese user community (with messages in Japanese). When I tried encoding the tweets for an XML file I used utf-8. e.g tweet=tweet.encode('utf-8') and none of the Japanese t...

Issue while encoding a string

Hello All I'm developing an application where at some point i need an encoded stream of bytes based on the given user output. Something like Encoding sysEncode = System.Text.Encoding.GetEncoding(850); byte[] dataToEncrypt = sysEncode.GetBytes(m_oStrActivation); However when i extract the string from the byte stream i get the encryp...

Google fusion tables api url encoding

This example code and more specific the runUpdate(String updateQuery) function is not working with non-english characters in the updateQuery. After the execution of this query i see in my fusion tables question marks where non-english chars should be. Any ideas? Thank you ...

Changing default encoding of python ?

I have many "can't encode" and "can't decode" problems with python when I run my applications from console. But in Eclipse Pydev IDE, default character encoding is set to utf-8 and I'm fine. I searched around for setting default encoding, and people say that python deletes the sys.setdefaultencoding function on startup and we can not us...

Reading file with cyrillic

Hi guys, I have to open file with cyrillic symbols. I've encoded file into utf8. Here is example: en: Couldn't your family afford a costume for you   ru: Не ваша семья позволить себе костюм для вас How do I open file: ifstream readFile(fileData.c_str()); while (!readFile.eof()) { std::getline(readFile, buffer); ... } T...

How do I url unencode in Python?

GIven this: It%27s%20me%21 Unencode it and turn it into regular text? ...

Weird symbols from NSXMLParser

I'm stuck with a problem; everything I try to parse with the NSXMLParser ends up with "†Êá"(name of element, elementText ...) I tried different sources (the one I'd like to parse from my server, simple NSString, and from different sources from the web which deliver XML) and every time "†Êá". //prepar request //NSString *urlString = [NS...

URI encoding in UNICODE for apache httpclient 4

I am working with apache http client 4 for all of my web accesses. This means that every query that I need to do has to pass the URI syntax checks. One of the sites that I am trying to access uses UNICODE as the url GET params encoding, i.e: http://maya.tase.co.il/bursa/index.asp?http://maya.tase.co.il/bursa/index.asp?view=search&co...

Jsp form encoding

I have a jsp page(let's say page1.jsp) which have an html form with action="page2.jsp". In page1.jsp and page2.jsp i have <%@page contentType="text/html;charset=UTF-8" pageEncoding="UTF-8"%> outside the head section and <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> in the head section. If i write greek letters in t...

What's the difference between encoding and charset?

I am confused about the text encoding and charset. For many reasons, I have to learn non-Unicode, non-UTF8 stuff in my upcoming work. I find the word "charset" in email headers as in "ISO-2022-JP", but there's no such a encoding in text editors. (I looked around the different text editors.) What's the difference between text encoding a...

How do I accurately insert a sql script into a SqlServer table.

I'd like to insert a sql script into a table. I'm pretty sure this is more complicated than just wrapping the script in quotes and throwing it in an insert statement (scripts with quotes and more complicated escaping seem problematic for example) So, how can I safely store arbitrary tsql in a SqlServer table? I can use either sql or c#...

django: Processing encoded post request

Hi! I am sending POST request from client to the application. On the server side it processed this way: def report(request): if request.method == "POST": dict = request.POST idea = dict["idea"] print idea return HttpResponse("Success") If idea = "binding" (or any English word) I get http 200 OK but on the other hand...

How can I convert a cp1251 byte array to a utf8 String?

We don't have the cp1251 code page available on a phone, so new String( data, "cp1251" ) doesn't work. We need a function with signature something like String ArrayCp1251toUTF8String(byte data[]); ...

Problem encoding string to ISO8859-1

Hi I'm using this code to convert string to ISO8859-1 baseurl = "http://myurl.com/mypage.php" client = New WebClient client.Headers.Add("user-agent", "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.0.3705;)") client.QueryString.Add("usuario", user) client.Qu...

Encode double quotes inside XML element using LINQ to XML

I'm parsing a string of XML into an XDocument that looks like this (using XDocument.Parse) <Root> <Item>Here is &quot;Some text&quot;</Item> </Root> Then I manipulate the XML a bit, and I want to send it back out as a string, just like it came in <Root> <Item>Here is &quot;Some text&quot;</Item> <NewItem>Another item</NewItem> ...