compression

best compression algorithm with the following features

What is the best compression algorithm with the following features: should take less time to decompress (can take reasonably more time compress) should be able to compress sorted data (approx list of 3,000,000 strings/integers ...) Please suggest along with metrics: compression ratio, algorithmic complexity for compression and decomp...

Why use deflate instead of gzip for text files served by Apache?

What advantages do either method offer for html, css and javascript files served by a LAMP server. Are there better alternatives? The server provides information to a map application using Json, so a high volume of small files. See also Is there any performance hit involved in choosing gzip over deflate for http compression? ...

Real-time multiplayer game (concept question)

I've been reading this article from Valve that seems to explain the architecture of their multiplayer system. It seems they delay rendering by a couple ticks on the client so they can handle dropped packets, but they also send packets as "delta snapshots" (the difference between two adjacent states). Suppose we have times A, B, C, and t...

WiX generated MSI is not compressed

I use WiX3 to generate MSI installation package. I have specified comression flag on in both the <Package> and <Media> elements: <Package InstallerVersion="200" Compressed="yes"/> <Media Id="1" Cabinet="MySetup.cab" EmbedCab="yes" CompressionLevel="high" /> but the resulting MSI is not compressed at all - WinZip compressed it from 2M...

Compression algorithm for JSON encoded packets?

Hi I was just wondering what would be the best compression algorithm to use to compress packets before sending them over the wire? The packets are encoded using JSON. Would LZW be a good one for this or is there something better? ...

How do I compress multiple files into a single archive with Delphi

I need to compress multiple files into a single archive using Delphi. I'd prefer to use freeware components or open-source components because I am very very cheap :-) My primary requirements are: Possible to encrypt the archive Can create common archives that can be opened by anyone with a copy of WinZip Does anyone have suggestions...

How to reduce the size of an sqlite3 database for iphone?

edit: many thanks for all the answers. Here are the results after applying the optimisations so far: Switching to sorting the characters and run length encoding - new DB size 42M Dropping the indexes on the booleans - new DB size 33M The really nice part is this hasn't required any changes in the iphone code I have an iphone applica...

iPhone Unzip code

Hi There, Really stuck on trying to write code to unzip a file or directory on the iPhone. Below is some sample code that Im using to try and unzip a simple text file. It unzips the file but its corrupt. Would be really grateful is someone has an example or any pointers. Thanking you Tony (void)loadView { NSString *DOCUMENTS_FOLD...

What are my options to store and query huge amounts of data where a lot of it is repeating ?

I am evaluating options for efficient data storage in Java. The data set is time stamped data values with a named primary key. e.g. Name: A|B|C:D Value: 124 TimeStamp: 01/06/2009 08:24:39,223 Could be a stock price at a given point in time, so it is, I suppose, a classic time series data pattern. However, I really need a generic RDBMS...

Image compression for webcomics

As probably many people around here I read a few webcomics. Drowtales is my favorite, but that's besides the point. For a long time a thought has been nagging me at the back of my head: webcomics are drawn pictures. They are not photographs. There should be a lot of redundancy (less colors, more flat colored areas, etc.) and thus they s...

Compression issues with JQuery file in YUI Compressor

I am trying to minify a few files with YUI compressor. However, I seem to be getting an error on 2 lines of code, which prevents compression. The .js file for jcarouselLite contains 1 error, and my own code contains the other. I have narrowed it down and in both occasions it looks like the the float property used in jQuery is causing t...

J2ME Reduce Image color-depth/ Compress Image size

Hi, I need to transmit the image from the mobile phone to the server. I am able to reduce the image screen size but not the memory size. I understand i have to deal with the color depth. J2ME does not seem to offer any scaling method which is available in J2SE: image rescaled = image.getScaledInstance(thumbWidth, thumbHeight, Image.SC...

Compression to Improve Harddisk Write Performance

On a modern system can local harddisk write speeds be improved by compressing the output stream? This question derives from a case I'm working with where a program serially generates and dumps around 1-2GB of text logging data to a raw text file on the hard disk and I think it is IO bound. Would I expect to be able to decrease runtimes ...

Free compression library for C# which supports 7zip (LZMA)

I have a programm (written in C#) which reads/writes it's data direct (direct file access without server) to firebird database files. For a better exchange I want to (un)compress them on import/export for a better exchange over the internet without the need of an external programm to (un)compress them. I know #ziplib which supports Zip,...

Programming Problem - Fax Compression

I'm preparing to go to a computer science contest by completing problems from past contests. Most of them are pretty easy, but this one is bugging me...it seems simple but I'm just not being able to do it. If you have a string of ones and zeros: 100111010001111100101010 What would be the code to take that as an input and then output ...

Compression library using Nvidia's CUDA

Does anyone know a project which implements standard compression methods (like Zip, GZip, BZip2, LZMA,...) using NVIDIA's CUDA library? I was wondering if algorithms which can make use of a lot of parallel tasks (like compression) wouldn't run much faster on a graphics card than with a dual or quadcore CPU. What do you think about the ...

Does SVN Compress the binary content?

I was wondering whether SVN actually compresses the binary content on the server during Commits? I know that the binary store the diffgrams for comparison and versioning but wondered whether a new file commited would occupy the same volume on the server as it does on the client pc? ...

What is the easiest way to convert a compressed wav file to an uncompressed wav file in C# or C++?

What is the easiest way to programatically convert a compressed wav file (MPEG codec for example, but could be any installed codec) to an uncompressed wav file (16 bit PCM)? I've heard that using direct show and writing the code in native C++ would do it, but I've not had much experience with direct show. Is there an easier way to do ...

WAV compression help

How do you programmatically compress a WAV file to another format (PCM, 11,025 KHz sampling rate, etc.)? ...

garble javascript code before sending to client side

How can I garble javascript code before sending it to client side. I don't want to expose functionalities. The code is already compressed using jsmin. ...