data

How to get scientific results from non-experimental data (datamining?)

I want to obtain maximum performance out of a process with many variables, many of which cannot be controlled. I cannot run thousands of experiments, so it'd be nice if I could run hundreds of experiments and vary many controllable parameters collect data on many parameters indicating performance 'correct,' as much as possible, for th...

How would you go about reverse engineering a set of binary data pulled from a device?

A friend of mine brought up this questiont he other day, he's recently bought a garmin heart rate moniter device which keeps track of his heart rate and allows him to upload his heart rate stats for a day to his computer. The only problem is there are no linux drivers for the garmin USB device, he's managed to interpret some of the data...

Storing SAS data (including table structure) in a single flat file

I need to convert SAS data tables into flat files (or "ASCII files" as they were called once, as opposed to binary files). And only 1 flat file for each original SAS table. The challenging thing is that I want the flat file to contain some structural information of the original SAS table also, specifically: Variable/Column name Variabl...

What powers Google Charts?

Does any body know what powers Google Charts? I have been using it for a while but not sure what Google used to build it. ...

Change datatype when importing Excel file into Access

Is there any way to change the defaulted datatype when importing an Excel file into Access? (i'm using Access 2003, by the way) I know that I sometimes have the freedom to assign any datatype to each column that is being imported, but that could only be when I'm importing non-Excel files. EDIT: To be clear, I understand that there is ...

Easy data conversion tool

I often have data in Excel or text that I need to get into SqlServer. I can use ODBC to query the Excel file and I can parse the text file. What I want though is some tool that will just grab the data and put it into tables with little / no effort. Does anyone know of such a tool? ...

Unit Testing data?

Our software manages a lot of data feeds from various sources: real time replicated databases, files FTPed automatically, scheduled running of database stored procedures to cache snapshots of data from linked servers and numerous other methods of acquiring data. We need to verify and validate this data: has an import even happened i...

Data Comparison

We have a SQL Server table containing Company Name, Address, and Contact name (among others). We regularly receive data files from outside sources that require us to match up against this table. Unfortunately, the data is slightly different since it is coming from a completely different system. For example, we have "123 E. Main St." a...

Client/JS Framework for "Unsaved Data" Protection?

Hey all- we have a typical web application that is essentially a data entry application with lots of screens some of which have some degree of complexity. We need to provide that standard capability on making sure if the user forgets to click the "Save" button before navigating away or closing their browser they get a warning and can ca...

User Control Public Shared Variables in ASP.NET 1.1 Not Working As Expected

Let's say I have a web form that includes some user controls. The title tag for my "main" web form is generated in one of the user controls. Passing this data to the web form is currently done like this. Public Sub SetPageValues(ByVal sTitle As String, ByVal sKeywords As String, ByVal sDesc As String) MySystem.Web.UI.Main.PageSett...

How do you truncate all tables in a database using TSQL?

I have a test environment for a database that I want to reload with new data at the start of a testing cycle. I am not interested in rebuilding the entire database- just simply "re-setting" the data. What is the best way to remove all the data from all the tables using TSQL? Are there system stored procedures, views, etc. that can be u...

Garbage with pointers in a class, C++.

I am using Borland Builder C++. I have a memory leak and I know it must be because of this class I created, but I am not sure how to fix it. Please look at my code-- any ideas would be greatly appreciated! Here's the .h file: #ifndef HeaderH #define HeaderH #include <vcl.h> #include <string> using std::string; class Header { public: ...

Separating Demo data in Live system

If we put aside the rights and wrongs of putting demo data into a live system for a minute (that's a whole separate discussion!), we are being asked to store some demo data in our live system so that it can be credibly demonstrated without the appearance of smoke + mirrors (we want to use the same login page for example) Since I'm sure ...

Do you like writing your own Data Access Layer and Business Object Layer?

You find alot of hype around frameworks like The Entity Framework, and other frameworks like it. I wrote a data access layer and business object model layer of my own for a recent project and I seem to like it more than what I have read about the Entity Framework. Is it "better" to conform to a framework rather than writing one yoursel...

How do you post to an Iframe?

How do you post data to an iframe? ...

Looking for tools to export a set of specific rows of data, creating insert scripts

I'm looking for a good tool to script specific data from my database. In phpmyadmin I was able to write a query and just hit the "export" button to generate insert scripts. I have not yet found anything for MS SQL server that will do this. It would be great if the tool also offered me the option to do identity inserts or even do delete...

What are some best practices for handling sensitive information?

I'm currently creating an application for a customer that will allow them to automatically bill their customers credit cards. I'm curious as to what are some best practices to safely store and access the credit card information, and for that matter, any other sensitive information, like social security numbers, account numbers and so ...

Random distribution of data

How do I distribute a small amount of data in a random order in a much larger volume of data? For example, I have several thousand lines of 'real' data, and I want to insert a dozen or two lines of control data in a random order throughout the 'real' data. Now I am not trying to ask how to use random number generators, I am asking a st...

Application design for processing data prior to database

I have a large collection of data in an excel file (and csv files). The data needs to be placed into a database (mysql). However, before it goes into the database it needs to be processed..for example if columns 1 is less than column 3 add 4 to column 2. There are quite a few rules that must be followed before the information is persiste...

Should I only store fixed-size data elements in a database?

If the amount of data stored within a given field of a database is unknown, and could be very large, should I store it in an external file rather than within a field in the database? ...