In my system I have database in Mysql. I want to import that to hadoop file system. I found something about Sqoop, but i'm not getting command to do that.
-
Here is the answer on other thread.: stackoverflow.com/questions/10631957/…Durga Viswanath Gadiraju– Durga Viswanath Gadiraju2015-12-03 11:21:39 +00:00Commented Dec 3, 2015 at 11:21
Add a comment
|
4 Answers
sqoop import --connect jdbc:mysql://mysql-server-name/db_name --username user --password password --table table_name --target-dir target_directory_name -m1
Hope it helps..
Comments
You need to install mysql jdbc/java connector and run sqoop command.
sudo yum install mysql-connector-java
ln -s /usr/share/java/mysql-connector-java.jar /var/lib/sqoop/mysql-connector-java.jar
You can run sqoop command from Save data into mysql from hive hadoop through sqoop?
answered Dec 3, 2015 at 11:26
Durga Viswanath Gadiraju
3,9662 gold badges18 silver badges22 bronze badges
Comments
1) Install & configure MySQL first. Create database in MySQL
2) sqoop import --connect jdbc:mysql://localhost/databasename --username $USER_NAME --password $PASSWORD$ --table tablename --m 1 command will import data.
e.g.
sqoop import --connect jdbc:mysql://localhost/testDb --username root --password hadoop123 --table student --m 1
In above command, values of various parameters database:‘testDb’ , username: ‘root’, password: ‘hadoop123’, and table student.
Have a look at this article 1 and article 2 for better understanding in step-by-step manner
Comments
There are multiple ways to achieve this,
The old way is to use Sqoop
Another way is to use Shell Script,
a. Connect with MySQL(
mysql -h<host> -u<username> -p<password>)b. Open connectivity with HDFS(
hadoop fs)c. Run
SELECTon table and doput hdfsRecommended way is to use Apache Nifi
a. Use ExecuteSQL, PutHDFS processors