hello, in my web site, using google language api , i type malayalam language in text box and text area , ഇതു ഒരു നല്ല സിനിമ ആണ് like this, but when i look in to the mySQL database, in the table, it is ഇതു ഒരു നല്ല സിനിമ ആണ&#...
What is the best type, in C++, for storing UTF-8 string? I'd like to avoid rolling my own class if possible. My original thought was std::string -- however, this uses char as the underlying type. char may be unsigned or signed - it varies. On my system, it's signed. UTF-8 code units, however, are unsigned octets. This seems to indicate ...
I have a query string passed in through an HTTP request that has this character in it: %u54E6 And I'd like to generate a string that contains the actual Chinese character so I can use it in a different part of the application, I've tried using this code: String foo = "%u54E6"; String ufoo = new String(foo.replaceAll("%u([a-zA-Z0-9]{4}...
I have an old project that I am trying to Unicode enable. I am trying to put Unicode data into an msflexgrid, but it comes out as question marks. Is there some trick to getting MSFlexGrid to work with Unicode data? Will it work at all? If not, is there a good OCX replacement that I could use? ...
I'm working on writing some libraries that will be used both internally and by customers and was wondering what the best method of supporting both Unicode and ASCII. It looks like Microsoft (in the MFC Libraries) writes both the Unicode and ASCII classes and does something similar to this in the header files using macros: #ifdef _UNICO...
how can i extract only the characters in a particular language from a file containing language characters, alphanumeric character english alphabets ...
Honestly, I just don't get the following design decision in C++ Standard library. When writing wide characters to a file, the wofstream converts wchar_t into char characters: #include <fstream> #include <string> int main() { using namespace std; wstring someString = L"Hello StackOverflow!"; wofstream file(L"Test.txt"); ...
I would like to get a list of the VB.net/C# "wide" functions for unicode - i.e. AscW, ChrW, MessageBoxW, etc. Is there a list of these somewhere? ...
I am working on an application that searches text using regular expressions based on input from a user. One option the user has is to include a "Match 0 or more characters" wildcard using the asterisk. I need this to only match between word boundaries. My first attempt was to convert all asterisks to (?:(?=\B).)*, which works fine for mo...
The json spec allows for escaped unicode in json strings (of the form \uXXXX). It specifically mentions a restricted codepoint (a noncharacter) as a valid escaped codepoint. Doesn't this imply parsers should generate illegal unicode from strings containing noncharacters and restricted codepoints? An example: { "key": "\uFDD0" } decodi...
In our application we use VerQueryValue() API call to fetch version info such as ProductName etc. For some applications running on a machine in Traditional Chinese (code page 950), the ProductName which has Unicode sequences that span multiple code pages, some characters are not translated properly. For instance,in the sequence below, 5...
I set the culture to Hungarian language, and Chr() seems to be broken. System.Threading.Thread.CurrentThread.CurrentCulture = "hu-US" System.Threading.Thread.CurrentThread.CurrentUICulture = "hu-US" Chr(254) This returns "ţ" when it should be "þ" However, Asc("ţ") returns 116. This: Asc(Chr(254)) returns 116. Why would Asc() and ...
Hello, I am quite new to the C++ 'area' so I hope this will not be just another silly 'C++ strings' question. Here is my problem. I want to integrate TagLib (1.5, 1.6 as soon as I manage to build it for Windows) into an existing Windows MFC VS2005 project. I need it to read audio files metadata (not write). The problem is that the pr...
Hi guys, I currently working on a library for the NekoVM to create a binding to Freetype 2. It is written in plain c and it all works really nice, except when the user enters some unicode chars like "ü", "Ä" or "ß" they will be transformed into to some ugly square-like letters. When I recieve the data from the NekoVM you use val_string ...
Hello, I am creating a service that could "go international" to non-English speaking markets. I do not want to restrict a username to the ASCII range of characters but would like to allow a user to specify their "natural" username. OK, use UNICODE (and say UTF-8 as my username text encoding). But! I don't want users to create "non-...
I assumed that any data being sent to my parameter strings would be utf-8, since that is what my whole site uses throughout. Lo-and-behold I was wrong. For this example has the character ä in utf-8 in the document (from the query string) but proceeds to send a B\xe4ule (which is either ISO-8859-1 or windows 1252) when you click submit. ...
So I know about String#codePointAt(int), but it's indexed by the char offset, not by the codepoint offset. I'm thinking about trying something like: using String#charAt(int) to get the char at an index testing whether the char is in the high-surrogates range if so, use String#codePointAt(int) to get the codepoint, and increment the...
Hi all, This line of code, which decodes an encoded Chinese word: URLDecoder.decode("%E4%BB%BB%E4%BD%95%E8%BD%A6%E8%BE%86%E5%BA%94", "UTF-8").getBytes().length When I run it in a JSP page (on Jboss) it prints 5: <%= URLDecoder.decode("%E4%BB%BB%E4%BD%95%E8%BD%A6%E8%BE%86%E5%BA%94", "UTF-8").getBytes().length %> Running...
Hi there. My question would be what's wrong with the next code? I'm trying with j2ee to read some unicode from a database and some characters are returned as the famous question mark. try { Class.forName("com.mysql.jdbc.Driver"); String connectionUrl = "jdbc:mysql://localhost/hortimart?" + ...
I'm slowly converting my existing code into Delphi 2010 and read several of the articles on Embarcaedro web site as well as Marco Cantú whitepaper. There are still some things I haven't understood, so here are two functions to exemplify my question: function RemoveSpace(InStr: string): string; var Ans : string; I : Word; ...