How to Read large size csv file and split each line to string array in java

Question

i have GB of size csv file , i'am able to read this but when splitting it to an array then printing cause ArrayIndexOutOfBoundsException this is my program

FileInputStream inputStream = null;
Scanner sc = null;
try {
inputStream = new FileInputStream("file.csv");
sc = new Scanner(inputStream, "UTF-8");
int j=0;
while (sc.hasNextLine()) {
String[] data=new String[4]; 
String line=sc.nextLine();
data=line.split(",");
System.out.println(data[0]+" "+data[1]+" "+data[2]+" "+data[3]);
}
if (sc.ioException() != null) {
throw sc.ioException();
}
}       
catch (IOException ex) {
Logger.getLogger(TestPrintingAllLine.class.getName()).log(Level.SEVERE, null, ex);
} finally {
if (inputStream != null) {
inputStream.close();
}
if (sc != null) {
sc.close();
}
}

After executing 536 lines then, it caused ->

Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 3 at enterdatatosql.TestPrintingAllLine.main(TestPrintingAllLine.java:45) Java Result: 1.

45th line is-> System.out.println(data[0]+" "+data[1]+" "+data[2]+" "+data[3]);

Your error is not reproducible so it cannot get a reasonable answer. — Marko Topolnik
– Marko Topolnik, Commented Sep 22, 2014 at 12:00
check the length of your list "data" i.e: data.size(); before printing it's content — mkazma
– mkazma, Commented Sep 22, 2014 at 12:32
sorry if my answer was unclear, but that is what i meant from saying check the data has four parts first — user3913686
– user3913686, Commented Sep 22, 2014 at 12:43
thanks everyone now i added this line before printing array it give success if(data.length==4){ System.out.println(data[0]+" "+data[1]+" "+data[2]+" "+data[3]); } — Ayman
– Ayman, Commented Sep 22, 2014 at 16:07

score 2 · Accepted Answer · 2014-09-22 12:48:55Z

2

I would post this as a comment, but it might get messy.

You should check you have '4 parts' on each split, as some lines may only have three/two/etc.

System.out.println(data[0]+" "+data[1]+" "+data[2]+" "+data[3]);

Just before this line, check the data has four parts first.

EDIT

I think your problem is on line 536, you only have two commas instead of three. This means that your data array wiould look like:

|----|----|----| 0 1 2 <--indexes

where as usually you would have:

|----|----|----|----| 0 1 2 3 <--indexes

Since your print line will be looking to print the index 3, you will get an index out of bounds error since there is no such 'part' on this line with an index of 3.

edited Sep 22, 2014 at 12:48

answered Sep 22, 2014 at 11:40

user3913686

Sign up to request clarification or add additional context in comments.

3 Comments

Ayman Over a year ago

anyway thanks for your suggestion. i think it may be problem with my code.that's why i post here. No one found any error with this code , so need to check file

user3913686 Over a year ago

I thought there was an error with you not checking if there was a third index? As there may not be 3 commas in every line (as you might expect). And so check the data has a length of 4 before you ask to print them.

user3913686 Over a year ago

if this answer works/the most helpful, you could always accept it on left hand side)

nirajkumar · Accepted Answer · 2014-09-22 11:38:56Z

1

Before print data[0], data[1], data[2] and data[3] check whether its null or not .. they may be the case in few rows data[1] or data[2] or data[3] will be null and it is generating this error

answered Sep 22, 2014 at 11:38

nirajkumar

3301 gold badge3 silver badges14 bronze badges

4 Comments

Ayman Over a year ago

the error occurred at line 536th line , but there is no such problem

nirajkumar Over a year ago

open the file and check the line 535 and 536 there must be some difference. The data would not be available. Print the line here ... from 530 to 540 of the csv file

Ayman Over a year ago

i copied that that line and its former line and latter upto 20. and executed but no error

nirajkumar Over a year ago

better you post first 600 lines :) to find the root cause

Ram72119 · Accepted Answer · 2014-09-22 12:17:48Z

0

try this code :

import java.io.FileInputStream;
import java.io.IOException;

import org.apache.commons.io.IOUtils;

public class ReadValues {

    public static void main(String[] args) throws IOException {
        FileInputStream stream = new FileInputStream("D:\\jointIndustry\\Test\\src\\input.csv");
        String data = IOUtils.toString(stream);
        String data1[] = data.split(",");
        for(String str : data1){
            System.out.println(str);
        }
    }
}

You need to download commons-io-1.3.2.jar from maven/apache site and set it into the classapth

answered Sep 22, 2014 at 12:17

Ram72119

1071 silver badge20 bronze badges

1 Comment

Ayman Over a year ago

thanks ram :), thanks for your co-operation i got success with moe tricks

Collectives™ on Stack Overflow

How to Read large size csv file and split each line to string array in java

3 Answers 3

3 Comments

4 Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

4 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related