How to split the rows and import into database in a big .CSV file

Question

I have very big .csv file, it's consists of 1000 rows. While importing into my database it's taking too much time and sometimes it display error like Time Out.

To avoid this I want read first 100 rows and import into database, and so on. How to do in PHP ?. Is there any easy method available?

I have imported CSV with over 100,000 rows using LOAD DATA INFILE query. It's pretty fast. But if PHP times out, then increase your max_execution_time — Buttle Butkus
– Buttle Butkus, Commented Jul 28, 2016 at 18:10

berty · Accepted Answer · 2016-07-28 18:08:58Z

1

You sould probably consider using MySQL LOAD DATA syntax. It allows you, from a SQL query, to import data from a CSV in a table. You can parameter delimiter, line endings, etc... It could be much faster than parsing the file in PHP and generating INSERT's. Note that you have two options : LOAD DATA INFILE (file must be readable by mysql deamon) and LOAD DATA LOCAL INFILE (file must be readable from mysql client).

answered Jul 28, 2016 at 18:08

berty

2,20612 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

suresh · Accepted Answer · 2016-07-28 18:14:34Z

0

 while (($data = fgetcsv($handle,1000, ",")) != FALSE) 
                {
                    $num = count($data); 
                    for ($c=0; $c < $num; $c++) 
                    {
                      $col[$c] = $data[$c];
                    }
     }

this code will be help for you

answered Jul 28, 2016 at 18:14

suresh

12 bronze badges

Collectives™ on Stack Overflow

How to split the rows and import into database in a big .CSV file

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related