File size restriction or limitation in C#

Question

I want to generate XML file from one object (Contains nested collection) with large amount of data. but there is a limitation with XML that it can't exceed 50MB.

Are there any good way to do this?

Update : speed is not important, the main thing is split into 50MB for each file

Answer 1

So what do you want to do when it does? How will you determine what to leave out?

Answer 2

Have you considered writting the XML file like a string instead of using the XML support in .NET.

I was writing ~10GB of data to XML, as it was the only way a tool could consume it.

I had a problem like this but my XML was so simple I just used a TextWriter and nested for loops to write the XML.

Worked a charm, plus was a lot faster than the XML object.

Answer 3

You can write big xml file with XmlWriter or XDocument without any problem.

Here a sample example. This example generates a 63MB xml file in less than 5 seconds. For this example, I use the class XmlWriter.

using (XmlWriter writer = XmlWriter.Create("YourFilePath"))
{
    writer.WriteStartDocument();

    writer.WriteStartElement("Root");

    for (int i = 0; i < 1000000; i++) //Write one million nodes.
    {
        writer.WriteStartElement("Root");
        writer.WriteAttributeString("value", "Value #" + i.ToString());
        writer.WriteString("Inner Text #" + i.ToString());
        writer.WriteEndElement();
    }
    writer.WriteEndElement();

    writer.WriteEndDocument();
}