I am trying to combine the items from several files (1.20.1_Indel_allEff.vcf,1.20.2_Indel_allEff.vcf....1.200.1_Indel_allEff.vcf) in a folder in order to get a matrix that looks something like this.
Fm Chromosome Position Ref Alt Gene X1.20.1 X1.20.2 X1.20.3
Fm chrI 100007 AT A CAR2 0 0 0
Fm chrX 3000676 G T HYM1 0 0 0.5
where, X1.20.1, X1.20.2, X1.20.3.....X1.200.3 are individual file names and their frequency values contained in the folder.
I wrote a code in python (F1_comparison.py)
snps = defaultdict(lambda: defaultdict(str))
myfiles=listdir(str(sys.argv[1]))
for f1 in myfiles:
f = open(f1)
tpp = f1.split("_")[0].split(".")
tp=tpp[0]+'.'+tpp[1]+'.'+tpp[2]
for l in f:
ls = l.split()
if l.find("#") == -1 and len(ls) > 6:
chrom = ls[0]
pos = ls[1]
ref = ls[2]
alt = ls[3]
freq = ls[4]
typ = ls[5]
gene = ls[6]
if len(alt) == 1:
snps[pos+"_"+ref+"-"+alt+"_"+chrom+"_"+gene+"_"+typ][tp] = freq
elif len(alt) > 1:
for k in range (0,len(alt.split(","))):
snps[pos+"_"+ref+alt.split(",")[k]+"_"+chrom+"_"+gene+"_"+typ][tp] = freq.split(",")[k]
f.close()
traj = 1
tp_list = ['1.20.1','1.20.2','1.20.3','1.30.1','1.30.2','1.30.3','1.40.1','1.40.2','1.40.3','1.50.1','1.50.2','1.50.3','1.60.1','1.60.2','1.60.3','1.90.1','1.90.2','1.90.3','1.100.1','1.100.2','1.100.3','1.130.1','1.130.2','1.130.3','1.200.1','1.200.2','1.200.3']
print "Fermentor\tTrajectory\tChromosome\tPosition\tMutation\tGene\tEffect\t1.20.1\t1.20.2\t1.20.3\t1.30.1\t1.30.2\t1.30.3\t1.40.1\t1.40.3\t1.50.1\t1.50.2\t1.50.3\t1.60.1\t1.60.2\t1.60.3\t1.90.1\t1.90.2\t1.90.3\t1.100.1\t1.100.2\t1.100.3\t1.130.1\t1.130.2\t1.130.3\t1.200.1\t1.200.2\t1.200.3"
for pos in sorted(snps.keys()):
pos1 = pos.split("_")[0]
mut = pos.split("_")[1]
chrom = pos.split("_")[2]
gene = pos.split("_")[3]
typ = pos.split("_")[4]
tp_string = ""
for tp in tp_list:
if len(snps[pos][tp])>0:
tp_string += "\t"+str(snps[pos][tp])
else:
tp_string += "\t"+str("0/0")
print "F1"+"\t"+str(traj)+"\t"+chrom+"\t"+pos1+"\t"+mut+"\t"+gene+"\t"+typ+"\t"+tp_string
traj += 1
However, I am getting an error, where the code does not recognize some of the files in the folder, though they are all of the same format.
My command and the error I get:
python F1_comparison.py Fer1 > output.csv
Traceback (most recent call last):
File "Fer1_comparison.py", line 18, in <module>
f = open(f1)
IOError: [Errno 2] No such file or directory: '1.30.2_INDEL_allEff.vcf'
Can someone help me figure out this problem please? It will be a great help. Thanks