compression

Dealing with large number of text strings

My project when it is running, will collect a large number of string text block (about 20K and largest I have seen is about 200K of them) in short span of time and store them in a relational database. Each of the string text is relatively small and the average would be about 15 short lines (about 300 characters). The current implementati...

Possible to compress SQL Server network traffic?

I have a .NET client that needs to connect to a remote SQL Server over the WAN, is it possible to compress SQL traffic between the client and the server? I am using .NET 3.5 and SQL Server 2005 and greater. ...

Create normal zip file programmatically

Hi All I have seen many tutorials on how to compress a single file in c#. But I need to be able to create a normal *.zip file out of more than just one file. Is there anything in .NET that can do this? What would you suggest (baring in mind I'm under strict rules and cannot use other libraries) Thank you ...

What are the benefits of the PHP the different PHP compression libraries?

I've been looking into ways to compress PHP libraries, and I've found several libraries which might be useful, but I really don't know much about them. I've specifically been reading about bcompiler and PHAR libraries. Is there any performance benefit in either of these? Are there any "gotchas" I need to watch out for? What are the r...

How to compress the responses to reduce page weight in .net

Hi Can anyone suggest the ways we can choose to reduce the size of the rendered html or response to reduce page weight in .net so that the client can experience a faster loading of the UI i've heard of JSON and GZip but don't have much idea about how to use it or even better ways are there ...

How can I do compression in assembly?

Is there any code that I can look at to see how compression would be done in assembly? ...

Set compression level when generating a ZIP file using RubyZip

Hi, I have a Ruby program that zips a directory tree of XML files using the rubyzip gem. My problem is that the file is starting to be heavy and I would like to increase the compression level, since compression time is not an issue. I could not find in the rubyzip documentation a way to specify the compression level for the created ZIP...

JSON webservice response compression in IIS 7

Hello! I have trouble with JSON response compression. I look to response headers after uploading website to production server (Windows 2008, IIS 7) and found uncompressed response. Turning on "Enabled static compression" and ""Enable dynamic compression" in IIS control panel does not effect. ASPX pages was responsed gzipped, but webservi...

Using LZMA SDK in C++

I am trying to use LZMA SDK to compress a file in my program. I have download the SDK but I don't know how to use it. Can anyone tell me what steps I need to take to make this work? Any help would be highly appreciated I am almost a newbie to C and C++ world ...

Does SQL Server 2008 compress the results sent back to my web server?

I have a typical reporting application: Large report <-- HTTP Compression --> ASP.NET Web Server <-- ??? --> SQL Server 2008 Since I have so much (repetitive) data to send to the client, I would like both network hops to have compression. Is there a transport-level compression setting for SQL Server? ...

When should I use MySQL compressed protocol?

I've learned that MySQL can compress communication between servers and clients. Compression is used if both client and server support zlib compression, and the client requests compression. (from MySQL Forge Wiki) The most obvious pros and cons are pros: Reduced payload size cons: Increased computation time So, is compresse...

iis7 compress dynamic content from custom handler

I am having trouble getting dynamic content coming from a custom handler to be compressed by IIS 7. Our handler spits out json data (Content-Type: application/json; charset=utf-8) and responds to url that looks like: domain.com/example.mal/OperationName?Param1=Val1&Param2=Val2 In IIS 6, all we had to do was put the edit the MetaBase.x...

How to reduce latency of data sent through a REST api

I have an application which obtains data in JSON format from one of our other servers. The problem I am facing is, there is is significant delay when when requesting for this information. Since a lot of data is passed (approx 1000 records per request where each record is pretty huge) is there a way that compression would help reducing th...

Machine Learning Algorithm for Predicting Order of Events?

Simple machine learning question. Probably numerous ways to solve this: There is an infinite stream of 4 possible events: 'event_1', 'event_2', 'event_4', 'event_4' The events do not come in in completely random order. We will assume that there are some complex patterns to the order that most events come in, and the rest of the event...

Random access gzip stream

I'd like to be able to do random access into a gzipped file. I can afford to do some preprocessing on it (say, build some kind of index), provided that the result of the preprocessing is much smaller than the file itself. Any advice? My thoughts were: Hack on an existing gzip implementation and serialize its decompressor state every,...

Java Deflater strategies - DEFAULT_STRATEGY, FILTERED and HUFFMAN_ONLY

I'm trying to find a balance between performance and degree of compression when gzipping a Java webapp response. In looking at the Deflater class, I can set a level and a strategy. The levels are self explanatory - BEST_SPEED to BEST_COMPRESSION. I'm not sure regarding the strategies - DEFAULT_STRATEGY, FILTERED and HUFFMAN_ONLY I can...

Any reasons not to gzip documents delivered via HTTP?

I remember someone telling me that gzipped content is not cached on some browsers? is this true? Are there any other reasons why I shouldn't gzip my content (pages, javascript and css files) with htaccess? ...

SequenceMatcher for multiple inputs, not just two?

Hi everyone, wondering about the best way to approach this particular problem and if any libraries (python preferably, but I can be flexible if need be). I have a file with a string on each line. I would like to find the longest common patterns and their locations in each line. I know that I can use SequenceMatcher to compare line one...

Help with writing a php code that repeats itself per array value

Hi I'm using Closure Compiler to compress and join a few JavaScript files the syntax is something like this; $c = new PhpClosure(); $c->add("JavaScriptA.js") ->add("JavaScriptB.js") ->write(); How could I make it systematically add more files from an array lets say for each array element in $file = array('JavaScriptA.js','JavaScri...

How to enable GZIP with gSOAP?

I want to enable GZIP compression on my gSOAP client. How can I do it? ...