rancher: Process environment.create fails with Timeout
When trying to create a stack from catalog (es in my case) the process creating it (named environment.create
) gets stuck indefinitely.
On a closer look, the rancher-compose-executor
fails with the error:
io.cattle.platform.async.utils.TimeoutException
at io.cattle.platform.async.retry.impl.RetryTimeoutServiceImpl$1.run(RetryTimeoutServiceImpl.java:51)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Rancher service spam this in logs:
time="2015-12-17T10:11:09Z" level=info msg="Starting rancher-compose-executor" version=v0.6.1
time="2015-12-17T10:11:11Z" level=info msg="Setting log level" logLevel=info
time="2015-12-17T10:11:11Z" level=info msg="Starting go-machine-service..." gitcommit="4c789a5"
time="2015-12-17T10:11:39Z" level=fatal msg="Unable to create event router" error="Get http://192.168.10.5:25001/v1: dial tcp 192.168.10.5:25001: i/o timeout"
time="2015-12-17T10:11:41Z" level=error msg="Unable to create EventRouter" Err="Get http://192.168.10.5:25001/v1: dial tcp 192.168.10.5:25001: i/o timeout"
time="2015-12-17T10:11:41Z" level=info msg="Exiting go-machine-service..."
time="2015-12-17T10:11:41Z" level=info msg="Starting rancher-compose-executor" version=v0.6.1
time="2015-12-17T10:11:43Z" level=info msg="Setting log level" logLevel=info
time="2015-12-17T10:11:43Z" level=info msg="Starting go-machine-service..." gitcommit="4c789a5"
192.168.10.5
is host’s IP. However it could happily use 127.0.0.1
instead.
Further research shows that I can’t ping 192.168.10.5 (host’s IP) from the Rancher container. Docker bug or Rancher’s?
About this issue
- Original URL
- State: closed
- Created 9 years ago
- Comments: 18 (1 by maintainers)
Now all services that are launch from cattle (go-machine-service, rancher-compose-executor), will use localhost by default. https://github.com/rancher/cattle/pull/1419