Insert large records quickly in mysql? [duplicate]

Question

I have a csv file more than one lakhs ( 100,000 ) records. when I'm using these file for inserting records into my database it will be take more than half an hour. Is there any other way increase the efficiency and speed for these process or any frameworks are available?

How often do you have to add these records, and how are you currently doing it? — Tim Biegeleisen
– Tim Biegeleisen, Commented Oct 30, 2015 at 7:24
how are you trying to insert using the csv? If you are using phpmyadmin you can import a csv into a table, and it wouldn't take more than 30 seconds. — ambe5960
– ambe5960, Commented Oct 30, 2015 at 7:26
Add some more info. Are you inserting the csv data like firstname and lastname into the database like firstname='firstname', lastname='lastname'? — Wim Pruiksma
– Wim Pruiksma, Commented Oct 30, 2015 at 7:27

Ninju · Accepted Answer · 2015-10-30 09:03:34Z

2

Use "mysqlimport" command. It works fast and is suited for large CSV files.

mysqlimport --ignore-lines=1 \
            --fields-terminated-by=, \
            --local -u root \
            -p Database \
             TableName.csv

answered Oct 30, 2015 at 9:03

Ninju

2,5322 gold badges16 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Alexander Elgin · Accepted Answer · 2015-10-30 07:28:52Z

1

Convert the CSV file into a file containing a SQL request in a text editor. Execute in console the request using:

mysql -u user -ppassword db_name < file_path.sql

answered Oct 30, 2015 at 7:28

Alexander Elgin

6,9954 gold badges44 silver badges53 bronze badges

Collectives™ on Stack Overflow

Insert large records quickly in mysql? [duplicate]

2 Answers 2

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Linked

Related