Skip to main content
Unix & Linux

Questions tagged [csv-simple]

Ask Question

Text files containing simple comma separated values. Use this for data that is a subset of real CSV without newlines in (quoted) field content, that can be handled with line oriented tools without the need for a real parser.

107 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
6 votes
6 answers
1k views

I have a CSV file with thousands of lines like these 1664;4;5;35;37;43;5;6 1663;21;23;32;40;49;8;11 1662;16;17;34;35;44;5;10 1661;2;9;23;32;40;6;7 1660;23;25;30;44;47;9;12 1659;3;5;9;32;43;6;10 1658;4;...
Duck's user avatar
  • 4,814
5 votes
2 answers
11k views

Is it possible to convert this json: [ { "bytes": 276697, "checked": false }, { "bytes": 276697, "checked": false ...
Daniel Krajnik's user avatar
  • 381
7 votes
6 answers
2k views

I am using Ubuntu and I want to split my csv file into two csv files based on the value in the second column (age). The first file for patients under 60 (<60) and the second for patients over 60(&...
Solomon123's user avatar
  • 131
-3 votes
2 answers
496 views

I have two different csv files ,one file contain extended columns names while the other contain a shortcut of the same columns names. For example : csv file 1 is : gender,aciclovir drug,aclidinium ...
Solomon123's user avatar
  • 131
2 votes
7 answers
795 views

I have a big csv file ( around 1000 columns ) and I want to extract to a new file only columns that contain the word "chronic" in their header name. How can I do that ? For example if I have:...
Solomon123's user avatar
  • 131
-1 votes
1 answer
250 views

File1 has data as below , is the field separator 1,T_EXIT,9053.0,10325.0,, , 2,V_TURN,120.0,11334.0,,GOAL,RECK 3,Q_ENTRY,122.0,190.0,, , 4,Q_ENTRY_RUN,130.0,569.0,, , File2 has data SYNC CLK T_EXIT ...
Shreya's user avatar
  • 139
0 votes
1 answer
444 views

I have a CSV file that looks like this: 0 1 2 3 I'd like to use Miller to append an empty column x to every row so that the output file looks like this: 0,x 1, 2, 3, How do I do that?
Mateusz Piotrowski's user avatar
  • 5,023
-1 votes
2 answers
173 views

Given a file like this value,value,value,value value1,value1,value,value1 value2,value2,value,value2 How can I transform it to look like this: value,value,value,value value1,value1, ,value1 value2,...
ayush's user avatar
  • 1
-2 votes
5 answers
116 views

ABC,1234.5333,5733.9374,5673.352,352,2.346374,-0.6686874 XYZ,5463.674,93773.683,5734.874,432,-5.683423,-10.38393 AES,7436874.5743,937.6843,8464.5634,564,6.35739,10.6834 PQR,784945.464,57484.8647,57484....
John's user avatar
  • 73
2 votes
2 answers
3k views

Im building a script to load from a file content and then use to cat and grep in another file. The problem is that is not showing any values while executing the grep. If i do the command manually it ...
macieira's user avatar
  • 123
2 votes
2 answers
143 views

I want to merge mulpiple files based on common column and want to add 0 when any file does not have that common column. For example see below: a1.txt 111,222,444,5.5 121,321,555,1.2 a2.txt 111,222,...
Rachna Choudhary's user avatar
  • 23
2 votes
3 answers
139 views

I have a large flat file which is tab separated and look like this: APP SRC HITS App1 SRC1 202 App1 SRC1 101 App1 SRC13 90 App1 SRC2 3169 App1 SRC4 1 App1 SRC2 ...
DAP P's user avatar
  • 61
1 vote
1 answer
166 views

I want find patterns from csv1 (column1) in csv2 (anywhere) and exchange them with patterns from csv1 (column2). Like following: -csv1- column1 column2 AA edc BB ysc CC cds DD erg ...etc -csv2- ...
jkaymanm's user avatar
  • 11
0 votes
5 answers
261 views

How can I rollup multiple rows from a csv file into 1 row ? I have tried working out the query in SQL and it works but I am not sure how can I achieve the same in Linux. This is how my current file ...
Aayush Jain's user avatar
  • 93
0 votes
1 answer
114 views

I am looking for an awk solution which would fetch lines which are unique based on 2nd column when the 1st & 3rd and 4th columns are the same. constraints : column 3 and column 4 has to be same ...
Nadia Alice's user avatar
  • 27
0 votes
7 answers
727 views

My input is the following sorted CSV file (using : as the field delimiter instead of the usual comma): version:device 1.0.0:dev1 1.0.0:dev2 1.2.3:dev3 1.3.4:dev4 1.3.4:dev5 I want to aggregate it so ...
Gavriel's user avatar
  • 135
2 votes
3 answers
2k views

A file data.csv has the following data 1,avocado,mexican green fruit 1,kiwi,green fruit 1,banana,yellow fruit 1,mango,yellow fruit To organize data into fruit catagories, I've done awk -F ',' '{print ...
GypsyCosmonaut's user avatar
  • 4,329
0 votes
2 answers
98 views

I have a CSV file with a list like this: URL,Domain,anchor https://example1.com,Example1,Category1 I need to reformat this into HTML, like this: <li><a href="https://example1.com" ...
asker0012's user avatar
  • 3
-1 votes
2 answers
427 views

I am trying to find an example of how I may effeciently use sed or awk to manipulate csv data in a specific column (col 1 for instance) if the data in col 2 AND col 5 are not equal to "null"....
Todd Telle's user avatar
  • 11
0 votes
2 answers
353 views

I have a csv (in which firt and second column are separeted by ",") file like this: Column1,Column2 4e,info1 4t,info2 45t,info3 3,info4 I would like to obtained 4 different file, one for ...
Tommaso's user avatar
  • 167
0 votes
5 answers
464 views

I have this input file on a CentOS system: 1,,,,ivan petrov,,67, 2,2,,,Vasia pupkin,director,8, 3,,,,john Lenon,,, The task is to change it to: 1,,,,Ivan Petrov,,67, 2,2,,,Vasia Pupkin,director,8, 3,,...
QwertyBot's user avatar
  • 11
0 votes
4 answers
103 views

I have a CSV file as below : I want to remove the "INITIAL OFFER" block from this file and remain with only "FINAL OFFER" block I also want to remove comma(,) from the first field ...
Mayank Kulshrestha's user avatar
  • 13
2 votes
3 answers
1k views

I have copied a partial csv file. publish_date,headline_text,likes_count,comments_count,shares_count,love_count,wow_count,haha_count,sad_count,thankful_count,angry_count 20030219,aba decides against ...
jixubi's user avatar
  • 35
0 votes
3 answers
427 views

I have a csv that looks as follows: column1, column2, column3, column4, column5, 1,,,,5, 1,2,3,,, 1,2,3,4,5 1,2,3,4,5, 1,2,,,5, Using awk I want to print the number of all the rows and a comment &...
user469692's user avatar
  • 11
0 votes
1 answer
339 views

I am trying to add two new columns to a csv file, that contain the multiplication of the last column to a constant. This last column is formed by the pound symbol and followed by a number. Input: id,...
Llem Colop's user avatar
  • 145
4 votes
3 answers
963 views

I had a csv file of data such like that when read into shell: name,income,reward,payment Jackson,10000,2000,1000 Paul,2500,700,200 Louis,5000,100,1800 and I want to find the net earning for each ...
Polsop's user avatar
  • 43
0 votes
1 answer
1k views

I have a CSV file with the general format shown in the picture below. In that CSV there are multiple rows that belong to a certain column (desc) and I would like to to extract those items and add them ...
not2qubit's user avatar
  • 1,797
0 votes
3 answers
6k views

I have a csv file in below format 1311,0008,a131,a131,7039 1311,0008,a131,a132,7039 1711,2046,a626565,a626566,7099 1711,2048,a626565,a626565,7035 What I want is to compare column 3 and 4 only and if ...
Aayush Jain's user avatar
  • 93
4 votes
3 answers
372 views

I am trying to write awk for a file I have. Example of the dataset is S,CV0110,1235 S,1234 D,CQ120,3245 P,7894 Desired outcome is as follows (added empty field when the number of fields in a row is 2)...
mike's user avatar
  • 69
1 vote
2 answers
793 views

I have a csv file containing a,b,c d,e,f g,h,i now using this I want to create 3 separate files a.txt, d.txt, g.txt (named after the first field) for each record of that csv. Each file will ...
Amit10504's user avatar
  • 13
1 vote
4 answers
1k views

Need some quick help as I am not able to get the desired output: 2020-05-19 19:03:07,135 INFO [Container : 8504] [HttpUtil.java]requestXML: <?xml version="1.0"? ><COMMAND><TYPE>...
amit10504's user avatar
  • 17
0 votes
1 answer
40 views

We have a data like below Column1,|Column2,|Col|Abc|Column3,&TableName --- ( Here my delimiter is "&" ) Is there any way i can make an output as below Column1,Column2,Column3,&...
Arya's user avatar
  • 336
1 vote
2 answers
153 views

I have a csv where the first few rows look like this c("4288", "57534"),MIB1 c("2272", "2385"),FHIT c("5550", "10531", "56239"),PREP c("25809", "23669"),TTLL1 I want to manipulate the number of ...
Ctat41's user avatar
  • 23
0 votes
1 answer
2k views

I have a CSV that was exported with double quotes around every header and value and I need them gone but without removing double quotes that might actually exist as values. For example: "HEADER1","...
Xtremefaith's user avatar
  • 153
0 votes
3 answers
3k views

I have a CSV file that looks like this format: text1,text2,string1,string2 text3,text3,string3,string2 text4,text5,string1,string2 text6,text6,string6,string7 I want to extract rows when column1 and ...
user9371654's user avatar
  • 871
2 votes
5 answers
5k views

Input file: AAA, BBB:XXX, CCC, DDD, EEE, FFF, GGG, HHH Output should be: AAA, BBB, BBB:XXX, CCC, DDD, EEE, FFF, GGG, HHH I thought about something like: awk -F, '{n=split($2,a,":"); a[n]} {$2=$NF","...
T-One's user avatar
  • 157
0 votes
2 answers
2k views

There is a csv file ip,time,name 1.1.1.1,2018-08-31 10:01:03,postgres 2.1.1.1,2018-08-31 12:51:13,oracle 3.1.1.1,2018-08-31 14:32:53,sql I need output as below ip,time,name 1.1.1.1,2018-08-31 10:01:...
Syed Rizvi's user avatar
  • 43
0 votes
3 answers
1k views

If i have two input file with contents like below: How i can replace network_name (eg:P1MSVmgmtvM replace with /rest/ethernet-networks/2bf8bc44-5b31-4e6c-99ed-d68b1e9acf9e). File1: (input file) ...
Prajith P's user avatar
  • 57
0 votes
1 answer
65 views

Currently my csv input looks like below: network_name,network_set P1MSVmgmtvM,Data_NetworkSet_A P1MSVvMotion,Data_NetworkSet_A P2MSVmgmtvM,Data_NetworkSet_B P2MSVvMotion,Data_NetworkSet_B ...
Prajith P's user avatar
  • 57
1 vote
3 answers
697 views

How do I remove duplicated entries within each separate fields with below sample as data. 0x,9.4,,,#0,#UNIX#unix,#cli#L#فا#0#فا#0#L#SE#Cli#SE,#فارسی#فارسی#۱#1#١#1,bsh,#V & v expected output(...
αғsнιη's user avatar
  • 41.9k
0 votes
3 answers
2k views

I have a .CSV file that I need to extract numbers from. Example of file: #File of numbers 1,2,3,4,5 6,7,8,9,10 I want to use awk (or another utility) to extract the first number and second number and ...
Saad's user avatar
  • 101
10 votes
4 answers
13k views

I have written a program that outputs the result to the standard output in strict pure CSV form (every line represents a single record and contain the same set of comma-separated fields, fields only ...
Ivan's user avatar
  • 18.5k
3 votes
1 answer
216 views

I'm analyzing some packetfilter logs and wanted to make a nice table of some output, which normally works fine when I use column -t. I can't use a tab as my output field separator (OFS) in this case ...
Dan's user avatar
  • 436
0 votes
2 answers
547 views

I have a file that is like this 0001;4;5;30;33;41;52 0002;9;37;39;41;43;49 0003;10;11;29;30;36;47 0004;1;5;6;27;42;59 0005;1;2;6;16;19;46 0006;7;13;19;22;40;47 0007;3;5;20;21;38;56 ... etc The first ...
Duck's user avatar
  • 4,814
1 vote
3 answers
2k views

I have a comma seperated csv file as a sample like: 1,92345,92345,Dear user, this is your amount , 2016-10-10 2,92345,92345,Dear user, this is your amount , 2016-10-09 I need to replace 4th comma , ...
adnan noor's user avatar
  • 31
6 votes
7 answers
2k views

I have a tab delimited column text like below A B1 B1 C1 B B2 D2 C C12 C13 C13 D D3 D5 D9 G F2 F2 how could I convert the above table ...
desu's user avatar
  • 119
0 votes
2 answers
698 views

I'm stuck with a particular requirement which requires the conversion of dynamic row data to column fields. Suppose I am having a file "output.csv" with the contents like: TimeStamp,Block,...
SohomB's user avatar
  • 3
8 votes
1 answer
12k views

I was playing with IFS today and created a quick text file with a list of numbers separated by commas on 1 line. 1,2,3,4,5 I then tried to write a script to print each number on a newline. I was able ...
Keith Shannon's user avatar
  • 83
-1 votes
3 answers
2k views

I want to add filename (without extension) at the end for all the lines for all the csv files in a folder. All the files are having the same header. Let's say I have two files a.csv and b.csv in a ...
Thomas's user avatar
  • 39
2 votes
5 answers
5k views

I have a large .csv file where I need to split a specific column by string length. I'm trying to take the last 6 characters of column 2 and move them into a new column. Current: 3102017,90131112,0,...
sortinousn's user avatar
  • 147

1
2 3