compression

MSDN C# DeflateStream sample code issue

Hello everyone, Any ideas why in the below sample, we need to add 100 (buffer.Length + 100)? buffer.Length should be the same as decompressed buffer length, so no need to add 100 more. :-) http://msdn.microsoft.com/en-us/library/bc2dbwea.aspx thanks in advance, George ...

Which browsers claim to support HTTP compression but are actually flaky?

Are there any known issues with older/buggy browsers that claim to support gzip/deflate compression but don't handle it very well? I'm obviously only turning it on for browsers that claim to support it, but for the best user experience, I want to know if there are any browsers I should blacklist. For some reason, I remember hearing p...

Sql Server Backup Sizes

Does anyone have real world experience of backup compression in Sql 2008, I'd like to know how it performs compared to Sql 2005 + winrar. Currently when I back up a I get a 14G file. Using rar shrinks it to <400M, a massive saving. Most of the data is similar, being figures from the stock market so I guess that makes it easy to compress....

Is there a safe way to run a diff on two zip compressed files?

Seems this would not be a deterministic thing, or is there a way to do this reliably? ...

Relation of Entropy to Lossless Compression Rate

From Shannon's Source Coding Theorem we know that the entropy of a compressed string is bounded by the entropy of the original string like so: H(X) <= L < H(X) + 1/N where H(X) is entropy of the source string, N is the length of the source string, and L is the expected length of the compressed string. This necessarily means that ther...

Is there a built-in zip library in .NET 3.5?

Is there a built-in zip library in .NET 3.5? If not, what are the popular open source .net zip libraries. ...

Documentation on compression / decompression techniques

I've finished my current "part-time" project and am looking for something new. I've decided to have a crack at writing my own compression / decompression utility. I'm not planning on selling it or anything - it's more for my own interest. Preferably, it will be be in C# but Java or C is OK. Can anyone suggest some good sources on comp...

How to check programatically whether web server has http compression enabled?

I want to check whether web server has http compression enabled, and a particular compression (i.e. Gzip, Deflate, Compress) is enabled? Or If I request data through WebClient Object in .net by setting Accept-Encoding to "gzip, deflate" how can I know whether the retrieved data is compressed before I process it? ...

How does MPEG4 compression work?

Can anyone explain in a simple clear way how MPEG4 works to compress data. I'm mostly interested in video. I know there are different standards or parts to it. I'm just looking for the predominant overall compression method, if there is one with MPEG4. ...

What do you use to minimize and compress JavaScript libraries?

What do you use to minimize and compress JavaScript libraries? ...

Determining best compression algorithm to use for a series of bytes

For a personal project of mine, I'm writing up a small class to compress to and decompress from a rather obscure format. I've got the full spec, but that's not where the problem is. First, this 'format' uses a set of 6 different compression types as well as uncompressed blocks of byte data. The formats are RLE, an offshoot of RLE wher...

Issues with HTTP Compression?

We are investigating the use of HTTP Compression on an application being served up by JBoss. After making the setting change in the Tomcat SAR, we are seeing a compression of about 80% - this is obviously great, however I want to be cautious... before implementing this system wide, has anyone out there encountered issues using HTTP Compr...

Encrypt and compress html-codes in iPhone app bundle, unpack on first start

My client wants to encrypt/compress the html-code for their medical books in the iPhone bundle, to protect their IP. Whats is a good way to prepare this file for the app bundle, and what complementary libraries (C, Obj-C) should I use to do the decryption and decompressing on the first launch of the app? Copying the file to ~/Documen...

Writing a JavaScript zip code validation function

I would like to write a JavaScript function that validates a zip code, by checking if the zip code actually exists. Here is a list of all zip codes: http://www.census.gov/tiger/tms/gazetteer/zips.txt (I only care about the 2nd column) This is really a compression problem. I would like to do this for fun. OK, now that's out of the w...

Java lib to compress html file?

Does anyone know any good java library (or single method) that can strip extra spaces (line breaks, tabs, etc) from an html file? So html file gets turned into 1 line basically. Thanks. UPDATE: Looks like there is no library that does that so I created my own open source project for solving this task: http://code.google.com/p/htmlcompr...

Compressing/decompressing audio data

hi, i am using the win32 waveform api's in a C# app to make a voip system. all is going well, however i need some way of compressing the audio data on the fly. so basically the audio data comes into a 'record' buffer of size 150 bytes, and then this buffer is sent over udp, and at the remote end, the 150 bytes are received and put into...

Which compression method to use in PHP?

I have a large amount of data to move using two PHP scripts: one on the client side using a command line PHP script and other behind Apache. I POST the data to the server side and use php://input stream to save it on the web-server end. To prevent from reaching any memory limits, data is separated into 500kB chunks for each POST request....

Algorithm to find string matches in a sliding window

One of the core steps in file compression like ZIP is to use the previous decoded text as a reference source. For example, the encoded stream might say "the next 219 output characters are the same as the characters from the decoded stream 5161 bytes ago." This lets you represent 219 characters with just 3 bytes or so. (There's more to Z...

ASP.NET MVC compression options in IIS6

For now I'm stuck with IIS6 for ASP.NET-MVC (as in I cant upgrade to Server 2008 yet). It doesnt seem to know that my RESTful URLS are dynamic files and isn't compressing them. All my old .aspx files are compressed (as seen in Fiddler), but not the '/products/1001' type URLS. Is there any way to get IIS6 to compress my ActionResults in...

Shannon's entropy formula. Help my confusion.

Hi, my understanding of the entropy formula is that it's used to compute the minimum number of bits required to represent some data. It's usually worded differently when defined, but the previous understanding is what I relied on until now. Here's my problem. Suppose I have a sequence of 100 '1' followed by 100 '0' = 200 bits. The al...