i have a task to compress a stock market data somehow...the data is in a file where the stock value for each day is given in one line and so on...so it's a really big file. Eg, 123.45 234.75 345.678 889.56 ..... now the question is how to compress the data (aka reduce the redundancy) using standard algorithms like Huffman or Arith...
Just like javascript compressor, i use the same technique for css. First, i merge all the file into a single file and then compressor. But, the behaviour of HTML is not same as earlier with multiple css file. What is the best way to minimize the the no of CSS File? ...
In my application I have a simple XML formatted file containing structured data. Each data entry has a data type and a value. Something like <entry> <field type="integer">5265</field> <field type="float">34.23</field> <field type="string">Jorge</field> </entry> Now, this formatting allow us to have the data in a human readable f...
Can I safely store a .Net compressed memory stream (System.IO.Compression) in an SQLServer 2005 NVARCHAR(MAX) field? SQLServer 2008 is not an alternative. ...
I recently created a script that parses several web proxy logs into a tidy sqlite3 db file that is working great for me... with one snag. the file size. I have been pressed to use this format (a sqlite3 db) and python handles it natively like a champ, so my question is this... what is the best form of string compression that I can use...
Hi all, I have a web application developed in Adobe Flex 3 and Python 2.5 (deployed on Google App Engine). A RESTful web service has been created in Python and its results are currently in an XML format which is being read by Flex using the HttpService object. Now the main objective is to compress the XML so that there is as less a tim...
It used to be that disk compression was used to increase storage space at the expense of efficiency but we were all on single processor systems back then. These days there are extra cores around to potentially do the decompression work in parallel with processing the data. For I/O bound applications (particularly read heavy sequentia...
I'm looking for a good book on data compression algorithms (huffman, LZW etc), preferably with example code (on CD or website) in C, C++ or python. Found these on Amazon: they both look pretty good but pricey (so I'd only buy one). Introduction to Data Compression, Third Edition Data Compression: The Complete Reference Any recommend...
Hey everybody I'm stuck with a basic problem in my MPEG-1 compression. I have to produce macroblocks within a image. A macroblock consists of 16 x 16 pixels - where 4 x 8x8 is luminance, 1 x 8x8 is Cb and 1 x 8x8 Cr. In MATLAB I want to produce a cell matrix containing this. Any suggestions? ...
say I want to store ID's in a cookie: 123,1232,3443,2343,2344422,2342 seeing that a cookie has a 4kb limit (or whatever), would encrypting the value allow for more storage somehow? if so, which encryption would be best? (not really worried about security, just want to store more with less footprint) ...
I am using the ExternalInterface on Flex 3. We are actually using flex to compress a large amount of DOM data, so this is specifically being used with LARGE data. To further investigate, if there is a limitation, is this universal? (IE. Silverlight) First, let me state that this is being done with an application that was made by inexp...
Is it possible to compress data being sent from the client's browser (a file upload) to the server? Flash, silverlight and other technology is ok! ...
Hi to everyone, I have a problem I would like to compress all my javascript, but inside of my javascript code I use php stuff... like php if, php variables. How can I manage that? Thank you so much ...
We need to compress (or rather uncompress) some data we send to a pda client using a webservice. Below I have a simple concept that will work if consumed by a regular .net app. Unfortuantly, as the compact framework doesn't have the IO.Compression classes we can't see how this is possible without writing our own compression algorithms...
I am looking as a new file format specification and the specification says the file can be either xml based or a zip file containing an xml file and other files. The file extension is the same in both cases. What ways could I test the file to decide if it needs decompressing or just reading? ...
http://en.wikipedia.org/wiki/Data%5Fcompression#Lossless%5Fdata%5Fcompression For any given compression scheme, one can provide sample input that would result in no savings in space, right? ...
So I just spent a week running a simulation, but the computer had to be turned off to move it (terrible, I know). The data that was being produced was being zipped due to it's size by piping it into gzip, but since the simulation wasn't finished, I can't unzip the .gz file. We have since started the simulation over, but I was wondering...
Google has the very nice JavaScript compressor called "Closure" http://closure-compiler.appspot.com/home But it's a pain to use for inline JavaScript within an HTML file. Question: Does an online tool exist where I simply give the input "uncompress.html" and it spits out the compressed version of that HTML with all inline JavaScript c...
I can do basic regex alright, but this is slightly different, namely I don't know what the pattern is going to be. For example, I have a list of similar strings: lst = ['asometxt0moretxt', 'bsometxt1moretxt', 'aasometxt10moretxt', 'zzsometxt999moretxt'] In this case the common pattern is two segments of common text: 'sometxt' and 'mo...
I work a lot with directed graphs resulting from heap dumps of Java programs. One thing that characterizes them is that they contain lots of repeating patterns. I would like to find a way of compressing such patterns whilst still retaining the essential structure of the graph. For instance consider the following "molecules": | ...