I wrote my own PageStatePersister class based on SessionPageStatePersister which writes the most recent 10 Viewstates for a session to a shared disk. I figure this will scale better than keeping Viewstate in session since all web servers have access to it, they won't have to deal with expiration, and use less memory. When a user close...
Hi, I am developing an app on Android that will randomly pick and display an inspirational quotation (or verse) from a large collection of quotations. On Android I can choose between a flat file and an SQLite database. The app should satisfy the following conditions: Be scalable to 10^6 quotations and/or verses Be very fast (i.e. re...
Is there a standard or open format which can be used to describe the formating of a flat file. My company integrates many different customer file formats. With an XML file it's easy to get or create an XSD to describe the XML file format. I'm looking for something similar to describe a flat file format (fixed width, delimited etc). S...
I'm creating and app that will rely on a database, and I have all intention on using a flat file db, is there any serious reasons to stay away from this? I'm using mimesis (http://mimesis.110mb.com) it's simpler than using mySQL, which I have to admit I have little experience with. I'm wondering about the security of the db. but the fil...
What's the best way to strip out characters from flat files in SSIS? In my case, I need to remove all quotes from the file before processing. EDIT: How can I run an executable against some files from SSIS? Can I somehow use the source connection as an input or would I have to pass in the file names as parameters? ...
SSIS is great at handling flat files where all the records are the same, but not so good when there is a little complexity. I want to import a file similar to this - Customer: 2344 Name: John Smith Item Description Price Qty 543455 Widget 1 4.00 2 543556 Widget 2 8.00 1 I want to ...
Hello All I hope you can help find an answer to a problem that will become a recurring theme at work. This involves denormalising data from RDBMS tables to flat file formats with repeating groups (sharing domain and meaning) across columns. Unfortunately this is unavoidable. Here's a very simplified example of the transformation I'd re...
I want to make a class for parsing flat-file database information into one large analogous multidimensional array. I had the idea of formatting the database in a sort of python-esque format as follows: "tree #1": "key" "value" "sub-tree #1": "key" "value" "key #2" "value" "key #3" "value" I am trying to make it ...
What's the best way to store large JSON files in a database? I know about CouchDB, but I'm pretty sure that won't support files of the size I'll be using. I'm reluctant to just read them off of disk, because of the time required to read and then update them. The file is an array of ~30,000 elements, so I think storing each element separ...
Has any one ever seen a backspace delimited flat file? My requirement is to parse such a file but I am not able to put a backspace character into a file to check if I am able to detect it. ...
I'm pretty familiar with SSIS parsing of regular delimited text data files, however, I'm looking for some advice on an approach to tackle a file that looks like this test file: ISA*00* *00* *01*220220220 *ZZ*RL CODE 01*060327*1212*U*00300*000008859*0*P*:~ GS*RA*CPA-BPT*LOCALUTILITY*060319*1212*970819003*X*003030~ ST*820*000000001~ BPR*C...
I would like to see some examples of simple flat file databases and how they are accessed through a data layer. I've written to and read from a flat file before, but I have not ever created a data layer that accessed the data for an application using text files. If possible, it would be nice to see a tutorial that had a data layer that ...
Initially I was thinking to use SSIS to parse an EDI file, however I've seen a few manual EDI parsers (field mapping), and would like to use automate this functionality in C#. EDI file - ie: http://www.altova.com/images/shots/edi_source3.gif Tips appreciated. Thanks. ...
Can somebody shed some lights on how SQL Server 2005 deals with may request issued by a client using ADO.NET 2.0. Below is the shortend output of SQL Trace. I can see that connection pooling is working (I believe there is only one connection being pooled). What is not clear to me is why we have so many sp_reset_connection calls i.e a ser...
I hope you will bear with me. I wanted to provide as much information as I can. The main problem is how to create a structure (like a stack) that will be used by multiple threads that will pop a value and use it to process one big flat file and possibly do cycling again and again until the whole file is processed. If a file has 100.000...
Hi, i couldn't find the advantages and disadvantages would you please help me? thanks. ...
If I have a static database consisting of folders and files, would access and manipulation be faster than SQL server type databases, considering this would be used in a CGI script? When working with files and folders, what are the tricks to better performance? ...
Any detached/independent Session Library in PHP using Flat File or MySQL? ...
I have been tasked with setting up a flat-file SKU database for use on embedded devices with limited storage and processor speed. Basically the data I need to store consists of the following: SKU Description Location Price Qty The file will consist of several million records. The most important considerations are storage space and re...
Hi, I have a longitudinal data set generated by a computer simulation that can be represented by the following tables ('var' are variables): time subject var1 var2 var3 t1 subjectA ... t2 subjectB ... and subject name subjectA nameA subjectB nameB However, the file generated writes a data file in a format similar to the f...