encoding

What bitrate can I expect with MPEG?

What bit-rate (approximately) can I expect MPEG encoders to produce for 160x120 "ok-quality" webcam stream? How much CPU-demanding will the encoding be? The decoding? Are there any better encoding formats for that purpose? (In terms of bit-rate or CPU) ...

any good alternative to Iconv library for encoding conversion?

i was using Iconv library on Ruby to convert encoding from UTF-8 to UTF-32, UTF-16 etc and it was quite good. However, I do see an issue when converting from Big5 to UTF-8 -- an exception is thrown for invalid sequence... and the problem goes away when it is converting from CP950 to UTF-8, of which CP950 is essentially Big5... so I wo...

Why does the .NET Framework StreamReader / Writer default to UTF8 encoding?

I'm just looking at the constructors for StreamReader / Writer and I note it uses UTF8 as default. Anyone know why this is? I would have presumed it would have been a safer bet to default to Unicode. ...

XmlWriter encoding issues

I have the following code: MemoryStream ms = new MemoryStream(); XmlWriter w = XmlWriter.Create(ms); w.WriteStartDocument(true); w.WriteStartElement("data"); w.WriteElementString("child", "myvalue"); w.WriteEndElement();//data w.Close(); ms.Close(); string test = UTF8Encoding.UTF8.GetString(ms.ToA...

Getting null terminated string from System.Text.Encoding.Unicode.GetString

I have an array of bytes that I receive from an external entity. It is a fixed size. The bytes contain a unicode string, with 0 values to pad out the rest of the buffer: So the bytes might be: H \0 E \0 L \0 L \0 \0 \0 \0 \0 \0 ... etc I'm getting that buffer and converting it to a string like so: byte[] buffer = new byte[buffSize...

What could go wrong in switching HTML encoding from UTF-8 to UTF-16?

What are the implications of a change from UTF-8 to UTF-16 for HTML encoding? I would like to know your thoughts on the issue. Are there things I need to think of before making such a change? Note: Interested due to enormous amounts of japanese and chinese text I need to handle. ...

Performance issues in FileStream.Write while writing bytes decoded using AsciiEncoding.GetBytes and Convert.FromBase64String

I am facing a performance problem while using the FileStream.Write function. I have a console application that i use to read a Base64 string from a file (~ size is 400 KB) using a StreamReader object. I convert this string to a byte array using Convert.FromBase64String. I then write this byte array to a file using the FileStream obj...

International Fonts Display Issue with UTF-8

Hi We have developed a PHP-MySQL application in two languages - English and Gujarati. The Gujarati language contains symbols that need unicode UTF-8 encoding for proper display. The application runs perfectly on my windows based localhost and on my Linux based testing server on the web. But when I transfer the application to the clie...

Fast JPEG encoding library

Hi, anyone know of a free open-source jpeg encoding library for C/C++? Currently I'm using ImageMagick, which is easy to use, but it's pretty slow. I compared it to an evaluation of Intel Performance Primitives and the speed of IPP is insane. Unfortunately it also costs 200$, and I don't need 99% of the IPP). Also it will only work f...

Problem with processing "specific" characters in text (in Java, using XML parser)

Hi, I have problems when processing "specific" characters in texts using the DOM API in Java. The files are in XML format. I was told in a previous post what the situation with the ampersand (&) symbol in XML is (and several more characters such as < and >). Here is the post: http://stackoverflow.com/questions/871963/special-characters-...

how to get file system encoding by php

not file encoding , but file system. why I ask this is because that I find functions like rename,copy use the same encoding as file system,And I don't know how to change that,so the only thing I know I can do is using iconv to change it to encoding of file system. Better if you know how to set encoding of rename,copy! ...

decode a file stream using UTF-8

Hello everyone, I have an input file and it is very big (about 120M), and I do not want to load it into memory at once. My purpose is to check whether this file is using valid UTF-8 encoding encoded file. Any ideas to have a quick check without reading all file content into memory in the form of byte[]? Simple sample code appreciated. ...

Windows cmd encoding change causes Python crash.

First I chage Windows CMD encoding to utf-8 and run Python interpreter: chcp 65001 python Then I try to print a unicode sting inside it and when i do this Python crashes in a peculiar way (I just get a cmd prompt in the same window). >>> import sys >>> print u'ëèæîð'.encode(sys.stdin.encoding) Any ideas why it happ...

How can I find extended ASCII characters in a file using Perl?

How can I find extended ASCII characters in a file using Perl? Can anyone get the script? .....thanks in advance..... ...

How to base64 encode on the iPhone

I have found a few examples that looked promising, but could never get any of them to work on the phone. ...

Encoding Conversion problem

Hi all, I've got a little problem changing the ecoding of a string. Actually I read from a DB strings that are encoded using the codepage 850 and I have to prepare them in order to be suitable for an interoperable WCF service. From the DB I read characters \x10 and \x11 (triangular shapes) and i want to convert them to the Unicode for...

Why do real-world servers prefer gzip over deflate encoding?

We already know deflate encoding is a winner over gzip with respect to speed of encoding, decoding and compression size. So why do no large sites (that I can find) send it (when I use a browser that accepts it)? Yahoo claims deflate is "less effective". Why? I maintain HTTP server software that prefers deflate, so I'd like to know if ...

How to determine if a String contains invalid encoded characters

Usage scenario We have implemented a webservice that our web frontend developers use (via a php api) internally to display product data. On the website the user enters something (i.e. a query string). Internally the web site makes a call to the service via the api. Note: We use restlet, not tomcat Original Problem Firefox 3.0.10 se...

Encoding of ... some sort?

Forgive me if this has been asked before, but I assure you I've scoured the internet and have turned up nothing, probably because I don't have the right terminology. I would like to take an integer and convert it to a little-endian(?) hex representation like this: 303 -> 0x2f010000 I can see that the bytes are packed such that the 16'...

Which encoding uses the \x (backslash x) prefix?

I'm attempting to decode text which is prefixing certain 'special characters' with \x. I've worked out the following mappings by hand: \x28 ( \x29 ) \x3a : e.g. 12\x3a39\x3a03 AM Does anyone recognise what this encoding is? ...