comparing csv files

Question

I want to write a shell script to compare two .csv files. First one contains filename,path the second .csv file contains filename,paht,target. Now, I want to compare the two .csv files and output the target name where the file from the first .csv exists in the second .csv file.

Ex.

a.csv

build.xml,/home/build/NUOP/project1  
eesX.java,/home/build/adm/acl

b.csv

build.xml,/home/build/NUOP/project1,M1
eesX.java,/home/build/adm/acl,M2
ddexse3.htm,/home/class/adm/33eFg

I want the output to be something like this.

M1 and M2

Please help Thanks,

Answer 1

If you don't necessarily need a shell script, you can easily do it in Python like this:

import csv

seen = set()

for row in csv.reader(open('a.csv')):
  seen.add(tuple(row))

for row in csv.reader(open('b.csv')):
  if tuple(row[:2]) in seen:
    print row[2]

Answer 2

if those M1 and M2 are always at field 3 and 5, you can try this

awk -F"," 'FNR==NR{
    split($3,b," ")
    split($5,c," ")
    a[$1]=b[1]" "c[1]
    next
}
($1 in a){
    print "found: " $1" "a[$1]
}' file2.txt file1.txt

output

# cat file2.txt
build.xml,/home/build/NUOP/project1,M1 eesX.java,/home/build/adm/acl,M2 ddexse3.htm,/home/class/adm/33eFg
filename, blah,M1 blah, blah, M2 blah , end

$ cat file1.txt
build.xml,/home/build/NUOP/project1 eesX.java,/home/build/adm/acl

$ ./shell.sh
found: build.xml M1 M2

Answer 3

try http://sourceforge.net/projects/csvdiff/

Quote: csvdiff is a Perl script to diff/compare two csv files with the possibility to select the separator. Differences will be shown like: "Column XYZ in record 999" is different. After this, the actual and the expected result for this column will be shown.