Best way to compare two large string lists, using C# and LINQ?

Question

I have a large list (~ 110,000 strings), which I need to compare to a similar sized list.

List A comes from 1 system. List B comes from a SQL table (I can only read, no stored procs, etc)

What is the best way to find what values are in list A, that no longer exists in list B?

Is 100,000 strings a large number to be handled in an array?

thanks

Answer 1

Stealing from this question, it looks like you could use the Except<T>() method.

Answer 2

So you have two lists like so:

List<string> listA;
List<string> listB;

Then use Enumerable.Except:

List<string> except = listA.Except(listB).ToList();

Note that if you want to, say, ignore case:

List<string> except = listA.Except(listB, StringComparer.OrdinalIgnoreCase);

You can replace the last parameter with an IEqualityComparer<string> of your choosing.

Answer 3

With LINQ:

var missing = listA.Except(listB).ToList();

Answer 4

List<string> A = //get from file
List<string> B = //get from db

var C = A.Except(B);

Answer 5

Hi there,

If you are using SQL Server, then you might want to give a try to Volpet's Table Diff:

http://www.volpet.com/

You can try a fully-functional copy for 30 days.

Please let me know for anything.

Thank you,

Giammarco

Disclosure: I am the founder of Volpet Software.

Answer 6

Out of interest, do you HAVE to use List<string>? Because in .net 3.5 SP1, you can use the HashSet and it's ExceptWith method. To my understanding, HashSets are specifically optimized for comparisons between two Sets.