191

I am trying to run a container. I already have the image uploaded to private Docker registry. I want to write a compose file to download and deploy the image. But I want to pass the TAG name as a variable from the docker-compose run command.My compose file looks like below. How can I pass the value for KB_DB_TAG_VERSION as part of docker-compose up command?

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"

8 Answers 8

230

You have two options (option 2. overrides 1.):

  1. Create the .env file as already suggested in another answer.

  2. Prepend KEY=VALUE pair(s) to your docker-compose command, e.g:

    KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0 docker-compose up
    

    Exporting it earlier in a script should also work, e.g.:

    export KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0
    docker-compose up
    

Keep in mind that these options just pass an environment varible to the docker-compose.yml file, not to a container. For an environment variable to be actually passed to a container you always need something like this in your docker-compose.yml:

  environment:
    - KB_DB_TAG_VERSION=$KB_DB_TAG_VERSION
Sign up to request clarification or add additional context in comments.

6 Comments

KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0 docker-compose up, Only works if in docker-compose.yml in environment: KB_DB_TAG_VERSION=$KB_DB_TAG_VERSION
How wierd that the -e flag is missing. It's there for docker-compose run. Well well.
Prepending a variable seems to override the version given in the .env. (So prepending can be used to do try ad hoc changes without changing the .env)
This doesn't work on Windows CMD or PowerShell
@KarlPokus "How wierd that the -e flag is missing" - I guess that's because up applies to all containers and there could be arbitrary numbers of containers you're passing the same env var to. For an alternative where you can still use the command line, see my answer: stackoverflow.com/a/74069689/28190
|
72

You can create a .env file on the directory where you execute the docker-compose up command (and your docker-compose.yml file is located) with the following content:

KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0

Your docker-compose.yml file should look like the following (added { and }):

version: '3'
services:
   db:
     user: "1000:50"
     volumes:
       - /data/mysql:/var/lib/mysql
     container_name: k-db
     environment:
       - MYSQL_ALLOW_EMPTY_PASSWORD=yes
     image: XX:${KB_DB_TAG_VERSION}
     image: k-db
     ports:
       - "3307:3306"

After making the above changes , check whether the changes are reflected or not using the command docker-compose config. The variable will be replaced by the variable value. Please refer to the page here to understand more about variable replacement.

6 Comments

When I try this option I see that additional "+" is being added. XX:+kb-1.3.20-v1.0.0
You don't want to set the additional +? Which value should be set?
I want it to be XX:kb-1.3.20-v1.0.0 not XX:+kb-1.3.20-v1.0.0. I dont want the "+".
Quick hint, in my case I had the .env file named .env.dev and referenced inside the env_file attribute in docker-compose.yml and could not use ${variable} option inside docker-compose. Renaming my .env.dev file to just .env as stated here did the trick.
This is really This is really weird, ${XXX} doesn't work under my .env, $XXX does. Wait ...... It works now, if it doesn't, restart your shell ......
|
24

Just to supplement what has been outlined by others, in particular by @JakubKukul

For security purposes you probably wouldn't want to keep vulnerable information such as username/password in your docker-compose files if they're under version control. You can map environment variables that you have on your host to environment variables inside container as well. In this case it could be something like the following:

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
      - MYSQL_PASSWORD=${MYSQL_PASSWORD}
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"

where MYSQL_PASSWORD would be both:

  1. An environment variable on your host (maybe just in the current shell session)
  2. An environment variable inside the containers from the db service

Comments

16
docker-compose  --env-file .\.env up

https://docs.docker.com/compose/environment-variables/

Comments

14

It's possible to pass environment variables to containers on the command line without specifying the values in files. Add an environment key with the variable's name only (no value or assignment operator) on the container's service definition in the docker-compose file:

db:
    ...
    environment:
        - KB_DB_TAG_VERSION

Used in that way, with no assignment, means that docker-compose will look up the environment variable in the current environment/shell:

KB_DB_TAG_VERSION=mytagversion docker-compose up

Ref: https://docs.docker.com/compose/environment-variables/#pass-environment-variables-to-containers

Comments

1

For Windows, instead of export, use:

$env.KB_DB_TAG_VERSION = "1.3.20-v1.0.0"
docker-compose up

Comments

1

The doc that you can declare the env file in compose -

web:
  env_file:
    - web-variables.env

Comments

-4

In your docker-compose.yml file add

env_file:
  - .env_file

to your db service where .env_file is your .env file (change its name accordingly).

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    env_file:
      - .env_file
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"

1 Comment

THIS IS WRONG! Read the docs. env_file: defines runtime envars, not build-time! By default, docker-compose will parse a .env file (HAS to be named .env this is not parametrable apparently) into build-time environment. In that case however, the fact that you declared it under env_file: .env or not is completely irrelevant - docker-compose looks for it anyways. So it will SEEM like your answer works, but in fact doesn't. Those looking for built-time envars should read the other answer.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.