Fast cleaning DataSet - reading xml files (C#)

Question

I use a DataGrid to show a xml file. The Grid's DataSource is a DataSet.(using schema)

            Assembly assembly = Assembly.GetExecutingAssembly();
            Stream stream = assembly.GetManifestResourceStream("XML_Reader.Resources.schema.xsd");
            XmlSchemaSet schemas = new XmlSchemaSet();
            XmlReaderSettings settings = new XmlReaderSettings();
            settings.ValidationType = ValidationType.Schema;
            settings.Schemas.Add(null, XmlReader.Create(stream));
            using (XmlReader reader = XmlReader.Create(xmlFile, settings))
            {
                newDataSet.ReadXml(reader);
            }
            dataGrid.DataSource = newDataSet;

But when reading a new xml file, i need to clear the DataSet.(newDataSet.Clear();)
Because i read 'large' (40 Mb) xml files, clearing the DataSet is very slow.

How can i speed up this clearing?
Reading the file is also slow !

On a: Intel i7 950, 8 Gb, Win7 64-bit.

Answer 1

Why can't you just create new dataset and use that instead clearing old one? The old one will be garbage collected by .NET.

Answer 2

I suggest you use a new DataSet object for each file and avoid using DataSet.Clear() altogether. Just leave the old datasets to be cleared up by the garbage collector.

Answer 3

i think , if you employ this startgey , you may face some outofmemory exceptions also.

The size of for dataset is large more than 85K and GC will store these objects in the Large Heap and there is no way to clean this large heap.

and once you started creating new Dataset with 40 MB of data than you will face OutOfMemoryException soon.

i wouyld suggest use paging in datagrid and read lesser data and store in your memory.

Answer 4

Let me answer my own question ;-))

A typed DataSet is simply a class you can instantiate like any other class.
There is no magic to anything generated by tools, those tools simply generate classes and you can use those classes the same way you use other classes.

Do NewDataSet d1 = new NewDataSet(); where you put the right class name there instead of "NewDataSet".