flat-file

Storing SAS data (including table structure) in a single flat file

I need to convert SAS data tables into flat files (or "ASCII files" as they were called once, as opposed to binary files). And only 1 flat file for each original SAS table. The challenging thing is that I want the flat file to contain some structural information of the original SAS table also, specifically: Variable/Column name Variabl...

C#: Convert COMP-3 Packed Decimal to Human-Readable Value

I have a series of ASCII flat files coming in from a mainframe to be processed by a C# application. A new feed has been introduced with a Packed Decimal (COMP-3) field, which needs to be converted to a numerical value. The files are being transferred via FTP, using ASCII transfer mode. I am concerned that the binary field may contain wh...

Why do we still program with flat files?

Why are flat text files the state of the art for representing source code? Sure - the preprocessor and compiler need to see a flat file representation of the file, but that's easily created. It seems to me that some form of XML or binary data could represent lots of ideas that are very difficult to track, otherwise. For instance, you ...

Java: Save objects in a textfile? Are there readymade solutions?

Hello, I want to save the objects I generated in a program. After restart the App should load automaticly all Objects in an Array. I want to write them in a file and parse them after restart. Are the other smarter possibilities than do it by hand? Thank you ...

Append newline to flat-file schema in BizTalk 2006 R2

I have a flat-file schema that has a header and detail records. It looks something like this: HDR**2401*XX0062484*22750***20081006000000*000******* LIN**001*788-0538-001*4891-788538010*20000*EA**0000*** I need to append two blank lines at the end of the message. Right now, if I have multiple records I get the following output: HDR*...

Going through a text file line by line in vb 2005

So my program needs to go through a plain text file line by line essentially: Read line 1: Do commands loop Read line2: Do Commands loop etc until its done with the entire file does anyone know any good coding examples for this, all the tutorials seem to show open and writing/reading textfiles but nothing on how to do it line by line. ...

Appropriate data structure for flat file processing?

Essentially, I have to get a flat file into a database. The flat files come in with the first two characters on each line indicating which type of record it is. Do I create a class for each record type with properties matching the fields in the record? Should I just use arrays? I want to load the data into some sort of data structure...

Transforming flat file to XML using XSLT-like technology

I'm designing a system which is receiving data from a number of partners in the form of CSV files. The files may differ in the number and ordering of columns. For the most part, I will want to choose a subset of the columns, maybe reorder them, and hand them off to a parser. I would obviously prefer to be able to transform the incoming d...

Output SQL query results to flat-file with Java

Is there an easy or straightforward way in Java to output the results of a DB Query to a file (either csv, tab, etc). Perhaps even in Hibernate? I know that a query results can be dumped to a flat file on the DB Server. I am looking for a way that an application can run a query and get those results into a file. I realize one option ...

The most elegant way to import flatfiles into SQL server 2005 without using SSIS

For some reasons, SSIS is not avalialble. I read about OPENROWSET, but I will have others problem from on the format file and path of file. How can I do it in a elegant way? ...

Writing email messages to flat files in Outlook with VBA

I have written a VBA app that opens a folder in outlook and then iterates through the messages. I need to write the message bodies (with some tweaking) to a single flat file. My code is as follows... Private Sub btnGo_Click() Dim objOutlook As New Outlook.Application Dim objNameSpace As Outlook.NameSpace Dim objInbox As MA...

Can't Separate Text File By Delimiter |

Hello, I am using C#. I am trying to pull in a text file to an object. I am using an ODBC connection and it looks like this Driver={Microsoft Text Driver (*.txt; *.csv)};Dbq=C:\Users\Owner\Desktop\IR\IR_Files\Absolute;Extensions=asc,csv,tab,txt; I am able to make the connection but I can't get my columns separated. I'm using a schema...

How to Convince Programming Team to Let Go of Old Ways?

This is more of a business-oriented programming question that I can't seem to figure out how to resolve. I work with a team of programmers who have been working with BASIC for over 20 years. I was brought in to help write the same software in .NET, only with updates and modern practices. The problem is that I can't seem to get any of ...

Iterate through search results by column

Is there a way in Vim (or a plugin) to search for a term and iterate through the search results (as per n in Vim), by column, rather than row? So if my file was this: foo1 bar bar baz baz foo3 baz baz foo4 foo2 bar bar If I search for foo I want to iterate through the results in order 1,2,3,4. Normally n would move me ...

Looking for an open-source flatfile/xml database C++ library

I'm looking for a light-weight database library that I can compile into a C++ application. Does any such exist? ...

How do I do a full-text search search of flat files with Perl?

We have a Perl-based web application whose data originates from a vast repository of flat text files. Those flat files are placed into a directory on our system, we extensively parse them inserting bits of information into a MySQL database, and subsequently move those files to their archived repository and permanent home (/www/website/a...

Help required with ancient, unknown storage system.

Morning all, I've gone and told a customer I could migrate some of their old data out of a DOS based system into the new system I've developed for them. However I said that without actually looking at the files that stored the data in the old system - I just figured a quick google would solve all the problem for me... I was wrong! Anyw...

Recommend a flat-file blog engine?

Has anyone had success with a flat-file blog engine? I'm trying to arrange a very basic, bare bones blog setup on an intranet site. Unfortunately, the usual solutions rely on MySQL, which is not available on this server. In fact, no database is available. I may be able to do SQLlite, but would prefer a flat-file solution. DokuWiki has ...

Can NHibernate persist to flat files instead of database?

Here is a curiousity question. I have an application that must support both flat files and the database as a place to persist data. I was thinking maybe using a .csv or tab-delimited set of files as input ... Is it possible to use NHibernate to write to do both persistance tasks? ...

Create flat file that 'flattens' multiple rtansaction rows into one line in SQL*PLus

As the title says, I need a method of flattening multiple rows into a one luine output per account. For example table looks like this: Account Transaction 12345678 ABC 12345678 DEF 12346578 GHI 67891011 ABC 67891011 JKL I need the output to be: 12345678|ABC|DEF|GHI 67891011|ABC|JKL The amount of transactions ...