AWS ECS cli command equivalent in boto3

Question

I'm trying to port in python an ECS services deployment that at the moment is done with a bunch of bash script containing commands like the following:

ecs-cli compose -f foo.yml -p foo --cluster bar --ecs-params "dir/ecs-params.yml" service up

I thought that the easiest/fastest way could be using boto3 (which I already extensively use elsewhere so It's a safe spot), but I didn't understand from the documentation what would be the instruction equivalent of the formerly written command.

Thanks in advance.

UPDATE: this is the content of foo.yml:

version: '3'
services:
  my-service:
    image: ecr-image:version
    env_file:
      - ./some_envs.env
      - ./more_envs.env
    command: python3 src/main.py param1 param2
    logging:
      driver: awslogs
      options:
        awslogs-group: /my-service-log-group
        awslogs-region: my-region
        awslogs-stream-prefix: my-prefix

UPDATE2: this is the content of dir/ecs-params.yml:

version: 1
task_definition:
  task_role_arn: my-role
  services:
    my-service:
      cpu_shares: my-cpu-shares
      mem_reservation: my-mem-reservation

mreferre · Accepted Answer · 2021-11-19 15:32:01Z

1

The ecs-cli is a high level construct that creates a workflow that wraps many lower level API calls. NOT the same thing but you can think of the ecs-cli compose up command the trigger to deploy what's included in your foo.yml file. Based on what's in your foo.yml file you can walk backwards and try to map to single atomic ECS API calls.

None of this answers your question but, for background, the ecs-cli is no longer what we suggest to use for deploying on ECS. Its evolution is Copilot (if you are not starting from a docker compose story) OR the new docker compose integration with ECS (if docker compose is your jam).

If you want / can post the content of your foo.yml file I can take a stab at how many lower level API calls you'd need to make to do the same (or suggest some other alternatives).

[UPDATE] Based on the content of your two files you could try this one docker compose file:

services:
  my-service:
    image: ecr-image:version
    env_file:
      - ./some_envs.env
      - ./more_envs.env
    x-aws-policies:
      - <my-role>
    deploy:
      resources:
        limits:
          cpus: '0.5'
          memory: 2048M

Some of the ECS params are interpreted off the compose spec (e.g. resource limits). Some other do not have a specific compose-ECS mapping so they are managed through x-aws extensions (e.g. IAM role). Please note that compose only deploy to Fargate so the shares do not make much sense and you'd need to use limits (to pick the right Fargate task size). As a reminder this is an alternative CLI way to deploy the service to ECS but it does not solve for how you translate ALL API calls to boto3.

edited Nov 19, 2021 at 15:32

answered Nov 19, 2021 at 12:05

mreferre

6,1733 gold badges26 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

ciurlaro Over a year ago

Hei @mreferre, I updated the answer. Unfortunately I am using docker compose so apparently Copilot is not a way I can choose to go.

mreferre Over a year ago

Actually that content should be pretty straightforward to deploy with "native" docker compose. You don't even need all the logging part because that is taken care automatically by the integration (the way the integration works is by taking the compose as input and spitting/applying a CFN template out of that - the CFN templates has everything you need including logging configuration).

ciurlaro Over a year ago

And how do you handle the ecs-params.yml file? Could you make an example since I didn't understand how should I do?

ciurlaro Over a year ago

Thanks, I definitively learned something new that I'll keep in mind in the future, but unfortunately this doesn't solve my use case since I don't really have the choice on which type on container to run, which is not Fargate.

Collectives™ on Stack Overflow

AWS ECS cli command equivalent in boto3

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related