rancher: rancher healthcheck container stuck Initializing state

Describe your issue here Host info: system: centos7.2/centos7.3/redhat7.3 rancher: HA(two nodes) / loadbalance(nginx) docker version: Docker version 1.12.5, build 7392c3b / Docker version 1.13.0, build 49bf474

I use rancher to add three hosts, using the cattle vxlan, which healthcheck and scheduler containers have been stuck in the initializing state. they get the IP address, the other works fine. The rancher proxy logs no errors. Who can give guidance?

rancher proxy logs:

rancher proxy 01: time="2017-02-03T16:34:20+08:00" level=info msg="Request to refresh catalog" time="2017-02-03T16:34:20+08:00" level=info msg="Using catalog community=https://git.rancher.io/community-catalog.git" time="2017-02-03T16:34:20+08:00" level=info msg="Using catalog library=https://git.rancher.io/rancher-catalog.git" time="2017-02-03T16:34:22+08:00" level=fatal msg="Failed to configure cattle client: Get http://localhost:8080/v1: dial tcp [::1]:8080: getsockopt: connection refused" time="2017-02-03T16:34:22+08:00" level=info msg="Downloading key from http://localhost:8081/v1/scripts/api.crt" time="2017-02-03T16:34:22+08:00" level=info msg="Webhook service listening on 8085" time="2017-02-03T16:34:22+08:00" level=info msg="Starting websocket proxy. Listening on [:8080], Proxying to cattle API at [localhost:8081], Monitoring parent pid [9]." time="2017-02-03T16:34:22+08:00" level=info msg="Master config file: master.conf" time="2017-02-03T16:34:22+08:00" level=info msg="Master address: 10.50.131.132:8080" time="2017-02-03T16:34:23+08:00" level=info msg="Downloading certificate from http://localhost:8081/v1/credentials/1c1/certificate" time="2017-02-03T16:34:24+08:00" level=info msg="Starting Rancher Auth service" time="2017-02-03T16:34:24+08:00" level=info msg="No Auth provider configured" time="2017-02-03T16:34:24+08:00" level=info msg="Listening on :8090" time="2017-02-03T16:34:25+08:00" level=error msg="Failed to pull the catalog from git repo https://git.rancher.io/community-catalog.git, error: exit status 1" time="2017-02-03T16:34:28+08:00" level=error msg="Failed to pull the catalog from git repo https://git.rancher.io/rancher-catalog.git, error: exit status 1" time="2017-02-03T16:35:01+08:00" level=info msg="No Auth provider configured" time="2017-02-03T16:35:01+08:00" level=info msg="No Auth provider configured" time="2017-02-03T16:39:28+08:00" level=info msg="Refresh for this catalog community is already in process, skipping" time="2017-02-03T16:39:29+08:00" level=info msg="Refresh for this catalog library is already in process, skipping" time="2017-02-03T16:44:28+08:00" level=info msg="Refresh for this catalog community is already in process, skipping" time="2017-02-03T16:44:29+08:00" level=info msg="Refresh for this catalog library is already in process, skipping" time="2017-02-03T16:49:28+08:00" level=info msg="Refresh for this catalog community is already in process, skipping" time="2017-02-03T16:49:29+08:00" level=info msg="Refresh for this catalog library is already in process, skipping" time="2017-02-03T16:54:29+08:00" level=info msg="Refresh for this catalog community is already in process, skipping" time="2017-02-03T16:59:28+08:00" level=info msg="Refresh for this catalog community is already in process, skipping" time="2017-02-03T16:59:29+08:00" level=info msg="Refresh for this catalog library is already in process, skipping"

rancher proxy 02: time="2017-02-03T16:36:42+08:00" level=info msg="Stack Create Event Done" eventId=d82733a8-1bc1-455b-9f1b-9827c19b7e46 resourceId=1st6 time="2017-02-03T16:36:42+08:00" level=info msg="Stack Create Event Done" eventId=640412a7-6c10-451d-bb75-4a7c0a9c1daf resourceId=1st5 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:vxlan]: Created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:cni-driver]: Creating " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:cni-driver]: Created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:]: Project created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:]: Creating project " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:vxlan]: Creating " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:vxlan]: Created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:cni-driver]: Creating " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:cni-driver]: Created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="[vxlan:]: Project created " eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:36:42+08:00" level=info msg="Stack Create Event Done" eventId=43c7e528-27a3-4729-af10-0f3174b88a12 resourceId=1st7 time="2017-02-03T16:38:57+08:00" level=info msg="Creating Machine" eventId=150f46a8-3f3d-424a-ba06-06f5fcb42cd0 resourceId=1ph1 time="2017-02-03T16:38:57+08:00" level=info msg="Activating Machine" eventId=a2672f71-e70f-490e-beb0-cfbb4963a97d resourceId=1ph1 time="2017-02-03T16:38:59+08:00" level=info msg="Handling backend connection request." time="2017-02-03T16:38:59+08:00" level=info msg="Registering backend for host 26da2490-5ac7-4ce6-47f3-30f64e43ae9a with session ID 416032e6-4e8a-4d6b-b5ab-6a32d879e818." time="2017-02-03T16:39:19+08:00" level=info msg="Creating Machine" eventId=8513b970-12d5-4110-bb35-45db25b283ae resourceId=1ph2 time="2017-02-03T16:39:19+08:00" level=info msg="Activating Machine" eventId=ab1a135c-42a0-4fa4-9b52-330420208563 resourceId=1ph2 time="2017-02-03T16:39:24+08:00" level=info msg="Handling backend connection request." time="2017-02-03T16:39:24+08:00" level=info msg="Registering backend for host c63a6cb6-7d2c-40a3-6aff-fb501300fc22 with session ID 01502a25-1c20-4269-91e4-b946e630f34d." time="2017-02-03T16:39:49+08:00" level=info msg="Creating Machine" eventId=d12d9124-af86-4aec-878d-565783db7de7 resourceId=1ph3 time="2017-02-03T16:39:49+08:00" level=info msg="Activating Machine" eventId=23d67238-043c-4afc-8e2b-f172768e7527 resourceId=1ph3 time="2017-02-03T16:39:51+08:00" level=info msg="Handling backend connection request." time="2017-02-03T16:39:51+08:00" level=info msg="Registering backend for host af8f6240-f5ed-4e8c-64ef-bd2b769e9485 with session ID 68c78aee-4fb9-454a-905d-50908bec7c1e

---

Useful	Info
Versions	Rancher v1.3.3 Cattle: v0.175.9 UI: v1.3.5
Access	Disabled
Orchestration	Cattle
Route	hosts.index