Dockerfile create image with both python and mysql

Question

I have two containers "web" and "db". I have an existing data file in csv format.

The problem is I can initialize the MySQL database with a schema using docker-compose or just run with parameters but how can I import the existing data? I have Python script to parse and filter the data and then insert it to db but I cannot run it in the "db" container due to the single image is MySQL.

Update1

version: '3'
services:
  web:
    container_name: web
    build: .
    restart: always
    links:
      - db
    ports:
      - "5000:5000"
  db:
    image: mysql
    container_name: db
    command: --default-authentication-plugin=mysql_native_password
    restart: always
    environment:
      MYSQL_DATABASE: "test"
      MYSQL_USER: "test"
      MYSQL_PASSWORD: "test"
      MYSQL_ROOT_PASSWORD: "root"
      MYSQL_ALLOW_EMPTY_PASSWORD: "yes"
    ports:
      - "33061:3306"

There is a Python script for read data from a csv file and insert them to database, which works fine. Now I want to running the script once the MySQL container is set up. (I have done connection with Python and MySQL in container)

Otherwise, anyone has a better solution to import existing data?

You could probably spin up a third, transient container just to run the import once. Share your docker-compose.yml and we can take it from there! — Max
– Max, Commented Mar 8, 2019 at 20:57
Do you have an existing Docker Compose setup you can share? This sounds like a pretty typical setup connecting a Python script to a database in a different container. — David Maze
– David Maze, Commented Mar 8, 2019 at 22:11
@Max I have succeeded in the same method as you suggest. But would that be a little be redundant? Since once the data imported, there is no need for the third container existing. — Yabo Lee
– Yabo Lee, Commented Mar 8, 2019 at 22:35
@DavidMaze I coonect them with Python script but I want to set up them with existing data. — Yabo Lee
– Yabo Lee, Commented Mar 8, 2019 at 22:36

Mostafa Hussein · Accepted Answer · 2019-03-09 14:37:44Z

2

MySQL docker image has the ability to execute shell scripts or sql files if these script/sql files mounted under /docker-entrypoint-initdb.d for a running container as described in here and here. So I suggest you to write an SQL file that reads the CSV file (which you should mount to your container so the sql file can read it) in order to restore it to MySQL maybe something similar to this answer or write a bash script to import csv into mysql whatever works for you.

You can check Initializing a fresh instance at the official dockerhub page for mysql

edited Mar 9, 2019 at 14:37

answered Mar 8, 2019 at 22:45

Mostafa Hussein

12.2k3 gold badges43 silver badges65 bronze badges

Sign up to request clarification or add additional context in comments.

10 Comments

Yabo Lee Over a year ago

In your solution, it is not possible to modify the data in the container before importing to the database. I am really a fresh hand on Docker. Is it the best way to make the separation of data and application?

Mostafa Hussein Over a year ago

Can you elaborate more ? You said that you already have the data as a CSV right ?

Yabo Lee Over a year ago

Yep. I have a csv file which is in someone's github. I want to git clone it and modify some formats of the data before importing to the database like converting % to decimal.

Mostafa Hussein Over a year ago

So in this case you can add a bash script that clone the data and modify it then importing it into MySQL

Yabo Lee Over a year ago

Do you mean modify the data with bash?

|

heyitsvajid · Accepted Answer · 2019-03-08 22:23:07Z

0

From Dockerfile, you can call a script (Entrypoint). In this script you can call your python script. For example:

DockerFile:

FROM php:7.2-apache

RUN apt-get update    
COPY ./entrypoint.sh /entrypoint.sh

ENTRYPOINT ["/entrypoint.sh"]

This will run your entrypoint script in the App container. Make sure you've depends on attribute in you app container compose description.

answered Mar 8, 2019 at 22:23

heyitsvajid

1,2311 gold badge11 silver badges20 bronze badges

1 Comment

Yabo Lee Over a year ago

I want to make separation of data and application. The data should be in the "db" container but I am looking for a method to import the data to MySQL.

Collectives™ on Stack Overflow

Dockerfile create image with both python and mysql

2 Answers 2

10 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

10 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related