flat-file

Most supported way to protect flatfiles (sqlite db) from HTTP access?

I am developing a PHP application that uses SQLite as database management system, MySQL and PostgreSQL etc. is not an alternative (although I would really like to use pgsql), because I want the setup to be very beginner-friendly and zero-headache alike. Now many people use a shared hosting, and alot of them only offer direct FTP access t...

Is there any way to reorder fields in an SSIS flat file source?

I have an SSIS package using a tab delimited flat file source with a TON of fields. Recently the provider of the tab delimited flat file has decided to change the format of the flat file by sprinkling a couple dozen new fields at random into the file. Needless to say, this hosed the package. Rather than rebuild another flat file source ...

Unicode string to flat file from vba

I want to store a unicode string in a flat file on a windows box from an excel/vba macro. The macro converts normal string to unicode representation, need to store it in a file and retrieve later. ...

Dumping blob rows to files from MySQL

I have a table with a few thousand rows in it that has a few integer columns and a blob column. I want to dump each row out as its own file with the blob being the content and the integers being used to form the file name. This is a one time op so quick and dirty is OK. One constraint is that I have almost no tools installed in this envi...

Is it really helpful to store content in flat-file than a database for better google/yahoo/bing searches?

I just came across few articles, while selecting a wiki for my personal site. I am confused, as i am setting a personal wiki for my personal projects, i think a flat file system is good, even to maintain revisions of the design documents, design decisions, and comments/feedbacks from peers. But the internet gives a mixed bag of response...

make a nested file from a flat file data

I am newbie for coding and I looking for simple solution for conversaton of the flat file (4 columns) like A-data//A-ID//B-data//B-ID sample1//123//sample2//456 where A-ID have a direct connection to the B-ID (like a directed graph A => B). I need to make the new flat file according to the algorithm: if the B-ID (row1) matches A-ID...

How to import to SQL Server 2005 from flat file with data transformations

I have a flat data file that I need to import into my SQL Server 2005 DB. Many of the fields need to be split off into different, related tables. For example, the flat file has names, addresses and telephone numbers, all in one record. In my DB, the Person table has many Telephones and Addresses. Is there a one-step process whereby I...

Importing big (and corrupt?) plaintext files into mysql broken my lamp install

I was importing data from txt files into mysql (via php script). This dump is huge, it's splitted into 10 files. I imported first and second one and everything was ok - I could see all entries in phpmyadmin, etc. There were about 700 000(?) of entries. When i started to import third one something weird happened - import script loaded for...

Converting Flat File to Java Objects

Does anybody know of any good libraries to convert a flat file to Java objects? I found flatworm but I am looking for alternatives. ...

Looking for a very simple file-based CMS

I'm building a site for a friend for free, and am trying to work out a good way for her to be able to easily make updates. I haven't used any CMSs before. I was browsing the web today looking at some, and they all seem way too complicated for what I'm after. Basically, all I want is a really simple CMS that pulls together HTML snippets ...

Many to one join help for flat file

I’m not sure if this has already been asked – I looked around for quite a bit but couldn’t find anything. My end result is to get data from several of my SQL database tables into a comma delimited flat file. Normally this would not be a problem but due to their many to one relationship and the format I’m forced to put it in it’s proving...

What is the best way to store downloaded files?

Sorry for the bad title. I'm saving web pages. I currently use 1 XML file as an index. One element contains file created date (UTC), full URL (w. query string and what not). And the headers in a separate file with similar name but appended special extension. However, going at 40k (incl. header) files, the XML is now 3.5 MB. Recently I ...

Using SSIS to read flat files with multiple record types

We are evaluating SSIS to see if it will be appropriate for a new project that is coming up. One of the processes will have to process a flat file with delimited records. The file will contain orders. There is a header line, an (optional) shipping address line, and one or more detail lines. Each line's fields are delimited but are no...

SQL and Flat Files... In harmony?

I was just thinking, how quick it would be to store the actual data of an application in a flat file. Now, you can't just go storing everything in a flat file... sometimes sorts and searches are required, and to go through directories and files recursively could be a pain. Now, imagine, you stored all your search-able data in a datab...

What is faster, flat files or a MySQL RAM database?

I need a simple way for multiple running PHP scripts to share data. Should I create a MySQL DB with a RAM storage engine, and share data via that (can multiple scripts connect to the same DB simultaneously?) Or would flat files with one piece of data per line be better? ...

Remove first line from a text file using xlst.

I'm working with a system (Maximo) that generates a text file. I need to remove just the first line of the file. The way to do that is using XSLT. Any idea? ...

How do I retrieve only the top x rows from a flatfile in SSIS

I have a flatfile connection and I'm only interested in the first 10 rows of data. How can I just import the first 10 rows? Row sampling is random so I can't use that. Is there some way I can have some sort of derived column which is an automatic row number or something and then data-split to only keep rows with that id <= 10? Any help ...

Biztalk - processing a flat file receives "no subscribers found" message

I've created a flat file schema in Visual Studio from an instance of a CSV file I have, and it validates fine, and I've hooked up an orchestration to send and receive ports set to expect a file of that schema. When I publish the orchestration and use it to pick up a file, it's immediately suspended, with the following error: The publ...

SSIS: How to read flatfile and add a new row to the file.

Hi! I have a text file and needs to read it and change some text and add some new text in a new row. How do I add e new row with some text in it? I now use a script component to read existing rows and change in them but I can't add a new row :-( Thanks in advance Regards Brno ...

locating a flat file from SQL server 2005

I have built an SSIS job in visual studio 2005 that accesses a flat file and updates a table in SQL Server 2005. This works perfectly. I then store a copy on SQL Server by using the server storage option in the protection level property. When I try to run this it cannot locate the flat file. The flat file is located on a server and I use...