I have no experience dealing with nosql databases such as Amazon AWS DynamoDB.
I have some data stored in Amazon AWS DynamoDB.
Is it possible to export data from DynamoDB to MySQL Server ? If so, how to go about accomplishing that ?
Thanks,
1
-
@Attilah Did you ever resolve this , I am looking to export form a TitanDb into a MySQL DB and possibly vice versa .. I hope you found a solution that is helpful to me as well. I need ti to not require operator intervention.Ken– Ken2016-11-15 22:22:29 +00:00Commented Nov 15, 2016 at 22:22
Add a comment
|
3 Answers
I would extract the data in CSV format. This "DynamoDBtoCSV" tool seems promising. Then you can import this CSV file into your MySQL database with LOAD DATA INFILE.
The drawback is that you 1. need to create the receiving structure first and 2. repeat the process for each table. But it shouldn't be too complicated to 1. generate a corresponding CREATE TABLE statement from the first line output by DynamoDBtoCSV, and 2. run the operation in a loop from a batch.
Now I am asking myself if MySQL is your best call as a target database. MySQL is a relational database, while DynamoDB is NoSQL (with variable length aggregates, non-scalar field values, and so on). Flatenning this structure into a relational schema may not be such a good idea.
Comments
Even though it is pretty old question, still leaving it here for future researchers.
Dynamodb supports streams which can be enabled on any table (from overview section in dynamodb table), which then can be taken via a lambda function (look for trigger tab in dynamodb table) to any storage including but not limited to mysql.
Data flow: Dynamodb update/insert > Stream > Lambda > Mysql.
Comments
To be a bit more exact you can actually use this Data flow:
DynamoDB->Kinesis DataStreams->Lambda(to invoke the data) -> Mysql(or Aurora)
