compose: Docker Compose doesn't work when SSH connection used to remote Docker Engine

Any update on this?

Why is this issue closed? I am still unable to set a docker-compose context to a docker engine running on a remote server over ssh.

I dug into this a bit today. Compose via SSH only works if you:

• Connect with a password (user:password@host), or
• Connect with a private key that is in your ssh-agent

Compose does not support the IdentityFile parameter in your .ssh/config. This is an easy fix that I made locally; I can submit a PR if there’s enough interest.

Any update ? Docker-compose works through docker context and ssh-agent but not with ssh_config

Any news on this? I’m running this: docker-compose -H ssh://user@host down and I get the following:

Traceback (most recent call last): File “docker-compose”, line 6, in <module> File “compose\cli\main.py”, line 71, in main File “compose\cli\main.py”, line 124, in perform_command File “compose\cli\command.py”, line 42, in project_from_options File “compose\cli\command.py”, line 123, in get_project File “compose\cli\command.py”, line 94, in get_client File “compose\cli\docker_client.py”, line 127, in docker_client File “site-packages\docker\api\client.py”, line 166, in init File “site-packages\docker\transport\sshconn.py”, line 84, in init File “site-packages\docker\transport\sshconn.py”, line 94, in _connect File “site-packages\paramiko\client.py”, line 437, in connect File “site-packages\paramiko\client.py”, line 676, in _auth File “site-packages\paramiko\agent.py”, line 379, in init File “site-packages\paramiko\agent.py”, line 65, in _connect File “site-packages\paramiko\agent.py”, line 83, in _send_message File “site-packages\paramiko\agent.py”, line 91, in _read_all paramiko.ssh_exception.SSHException: lost ssh-agent [16740] Failed to execute script docker-compose

Tested this with docker-compose version 1.24.0-rc1 but it doesn’t look like it is reading my ~/.ssh/config. DOCKER_HOST=ssh://my.docker.host docker ps works fine while DOCKER_HOST=ssh://my.docker.host docker-compose ps gives me paramiko.ssh_exception.AuthenticationException: Authentication failed.

still an issue: (base) home@J django-on-docker % DOCKER_HOST=ssh://name@domain.com docker-compose -f docker-compose.staging.yml up -d --build Traceback (most recent call last): File “docker-compose”, line 6, in <module> File “compose/cli/main.py”, line 72, in main File “compose/cli/main.py”, line 125, in perform_command File “compose/cli/command.py”, line 76, in project_from_options File “compose/cli/command.py”, line 142, in get_project File “compose/cli/docker_client.py”, line 47, in get_client File “compose/cli/docker_client.py”, line 174, in docker_client File “site-packages/docker/api/client.py”, line 166, in init File “site-packages/docker/transport/sshconn.py”, line 111, in init File “site-packages/docker/transport/sshconn.py”, line 119, in _connect File “site-packages/paramiko/client.py”, line 349, in connect File “site-packages/paramiko/util.py”, line 283, in retry_on_signal File “site-packages/paramiko/client.py”, line 349, in <lambda> TimeoutError: [Errno 60] Operation timed out [61197] Failed to execute script docker-compose

Yep. Looks like docker-compose does not use ~/.ssh/config when using DOCKER_HOST variable, while docker does

In the meantime, this workaround works for me:

1. Launch socat in a terminal:

   ssh -t -L 8888:127.0.0.1:8888 remote-docker-host 'socat TCP4-LISTEN:8888,fork,bind=127.0.0.1 UNIX-CONNECT:/var/run/docker.sock'
   

2. Point compose to local port 8888

   docker-compose -H tcp://:8888 up
   

Any update?

Tested this with docker-compose version 1.24.0-rc1 but it doesn’t look like it is reading my ~/.ssh/config. DOCKER_HOST=ssh://my.docker.host docker ps works fine while DOCKER_HOST=ssh://my.docker.host docker-compose ps gives me paramiko.ssh_exception.AuthenticationException: Authentication failed.

settings sshd config to MaxSessions 30 helped as workaround

same problem here. On local context everything works like a charm. When I try to launch the docker-compose on a remote host via ssh the docker engine on the stops and restarts the services but doesn’t update it. command “trace”

• created context “remote” with docker endpoint ssh://[user]@[local ip]
• docker context use remote
• [rebuild solution] (gradle clean build) -> docker file for bootJar copy
• docker-compose up The service on remote starts but with an old version of the solution

I believe that most of the SSH related problems stem from the fact that docker-py (which is used by docker-compose) uses the paramiko ssh library instead of defaulting to the ssh binary like the docker cli.

There’s an issue in docker-py discussing this: https://github.com/docker/docker-py/issues/2289

Can confirm I am having the same issue as @raesene

I spent two days on this but… I got it working on GitLab CI

eval $(ssh-agent -s)`
echo "$SSH_PRIVATE_KEY" >> ~/.ssh/id_ci
chmod 400 ~/.ssh/id_ci
ssh-add -k ~/.ssh/id_ci  
export COMPOSE_PARAMIKO_SSH=1`

Run the ssh-agent, add the SSH private key from a file to the agent with the -k flag. And most importantly COMPOSE_PARAMIKO_SSH=1 this will use SSH client from compose version 1.27.x (i hope i remember correctly) and voila, it works.

compose.cli.docker_client.get_client: docker-compose version 1.29.1, build c34c88b2
docker-py version: 5.0.0
CPython version: 3.7.10
OpenSSL version: OpenSSL 1.1.0l  10 Sep 2019
compose.cli.docker_client.get_client: Docker base_url: http+docker://ssh

Confirm that using docker-compose -H ssh://user@my.host up gives me:

/var/folders/vn/5g8_6g0s63s0zzz8kcdnxx2c0000gn/T/_MEIub7S75/paramiko/ecdsakey.py:164: CryptographyDeprecationWarning: Support for unsafe construction of public numbers from encoded data will be removed in a future version. Please use EllipticCurvePublicKey.from_encoded_point Traceback (most recent call last): File “docker-compose”, line 6, in <module> File “compose/cli/main.py”, line 71, in main File “compose/cli/main.py”, line 124, in perform_command File “compose/cli/command.py”, line 42, in project_from_options File “compose/cli/command.py”, line 123, in get_project File “compose/cli/command.py”, line 94, in get_client File “compose/cli/docker_client.py”, line 127, in docker_client File “site-packages/docker/api/client.py”, line 166, in init File “site-packages/docker/transport/sshconn.py”, line 84, in init File “site-packages/docker/transport/sshconn.py”, line 94, in _connect File “site-packages/paramiko/client.py”, line 343, in connect File “site-packages/paramiko/util.py”, line 280, in retry_on_signal File “site-packages/paramiko/client.py”, line 343, in <lambda> TimeoutError: [Errno 60] Operation timed out [21295] Failed to execute script docker-compose

But with docker command docker -H ssh://user@docker.host ps works normally, using docker-compose version 1.24.1, build 4667896b on Mac OS and Docker version 19.03.1, build 74b1e89

Support for the SSH protocol will be added in the next version of Compose. https://github.com/docker/docker-py/issues/2159