Lets say I have project A on SVN server, and it has some large file. Lets say I create a new project B, but it is actually a copy of project A. I create it, import it on the SVN server (different folder / URL), and I start with a new revision history. The problem is, that new project has that same large file - can I somehow reuse that...
I have a file which contains around 1 crore rows and size is around 400mb , my system is just not able to handle it . when i try opening the file using gedit , it just gets stuck . Is there any way to handle such large files of data. ...
Consider a normal PHP image upload functionality (not using AJAX) and there occurs this problem of large image upload failing occasionally - less frequently on one test server and more frequently on another test server. Assuming the debugger has not yet started debugging the problem and there are no file/folder permission issues, how to ...
I need to parse a large trace file (up to 200-300 MB) in a Flex application. I started using JSON instead of XML hoping to avoid these problems, but it did not help much. When the file is bigger than 50MB, JSON decoder can't handle it (I am using the as3corelib). I have doing some research and I found some options: Try to split the fi...
Hello everybody, I am using Erica Sadun's method of Asynchronous Downloads (link here for the project file: download), however her method does not work with files that have a big size (50 mb or above). If I try to download a file above 50 mb, it will usually crash due to a memory crash. Is there anyway I can tweak this code so that it w...
I am attempting to port a small data analysis program from a 64 bit UNIX to a 32 bit Windows XP system (don't ask :)). But now I am having problems with the 2GB file size limit (long not being 64 bit on this platform). I have searched this website and others for possible sollutions but cannot find any that are directly translatable to m...
Hi All, About Application I am working on an e-commerce application in PHP. To keep URL's secure, product download links are kept behind PHP. There is a file, say download.php, which accepts few parameter via GET and verifies them against a database. If all goes well, it serves file using readfile() function in PHP. About Problem Now...
I have reduced the problem to the following basic function which should simply print the number of bytes in the file. When I execute it for a file of 83886080 bytes (80 MB) it prints the correct number. However for a file of 4815060992 bytes (4.48 GB) it prints 520093696 which is way to low. It seems to have something to do with the SE...
I have a large XML document (50G+) to process. Loading this to normal dom (saxon) require more than 160G. Not that much RAM or swap space. Is there any library that provides h a disk based DOM tree? Any thing for Java? ...
Hi, I am trying to process somewhat large (possibly up to 200M) JSON files. The structure of the file is basically an array of objects. So something along the lines of: [ {"property":"value", "property2":"value2"}, {"prop":"val"}, ... {"foo":"bar"} ] Each object has arbitrary properties and does not necessary share them with...