In C# What is the best way to parse Large XML (Size of 1GB)...?

Question

I am having a 1GB XML File and want to parse it.If i use XML Textreader or XMLDocument ,result is very slow and some times hangs ...Your answers are welcome

Answer 1

You'll have to implement custom logic using xmlreader. xmlreader does not load the full XML into memory before using it, which means you can read it from a stream and process it as such.

Answer 2

XMLTextreader isn't supposed to hang as it's stream based and just works on junks of the data.

If it hangs, it may well be that you are doing something wrong when loading the file.

Answer 3

XmlDocument is not feasible in this scenario as it will attempt to suck that gigabyte into main memory. I'm surprised that you're finding XmlTextReader to be too slow. Have you tried something like the following?

using (XmlTextReader rdr = new XmlTextReader("MyBigFile.txt"))
{
     // use rdr to advance through the document.
}

Answer 4

I'm not very familiar with this topic, but afaik the XmlReader-classes ought to work fine for your specific problem. They are, after all, optimized for exactly this.

Answer 5

I would just like to back up everyone who promotes XmlReader with a performance comparison that I found:

http://www.nearinfinity.com/blogs/joe_ferner/performance_linq_to_sql_vs.html