traefik: Service status successful even if one or all servers/services failed

Do you want to request a feature or report a bug?

Bug

What did you do?

I created a service with a weighted service (Weighted Round Robin) and health check.

What did you expect to see?

In the GUI I expected to see the status failed or warning when at least one service/server status failed. For example (see config below): If server s1.test.com failed, I expexted to see the status of “http.services.app-2” equal to warning (since there is one more service available) and the status of “http.services.app-2v1” equal to failed (since all servers are failed).

What did you see instead?

The status of both services is successful.

Output of traefik version: (What version of Traefik are you using?)

2.1.1

What is your environment & configuration (arguments, toml, provider, platform, …)?

## Static configuration
[entryPoints]
    [entryPoints.web]
        address = ":80"
    [entryPoints.web-secure]
        address = ":443"
    [entryPoints.ping]
        address = ":8082"

[ping]
    entryPoint = "ping"

[providers]
    [providers.file]
        directory = "/etc/traefik/config-enabled"
        watch = true

[api]
    dashboard = true


[serversTransport]
    insecureSkipVerify = true
    [serversTransport.forwardingTimeouts]
        dialTimeout = "5s"
        responseHeaderTimeout = "1s"

[log]
    filePath = "/var/log/traefik.log"
    level = "WARN"

[accessLog]
    filePath = "/var/log/traefik-access.log"

[certificatesResolvers.le.acme]
    email = "support@mydomain.tld"
    storage = "/etc/traefik/acme/acme.json"
    [certificatesResolvers.le.acme.httpChallenge]
        entryPoint = "web"

[http.routers.domain-2]
    entryPoints = ["web"]
    rule = "Host(`domain-2.test.com`)"
    service = "app-2"

[http.services.app-2]
    [[http.services.app-2.weighted.services]]
        name = "app-2v1"
        weight = 3
    [[http.services.app-2.weighted.services]]
        name = "app-2v2"
        weight = 1

  [http.services.app-2v1]
      [http.services.app-2v1.loadBalancer]
          [http.services.app-2v1.loadBalancer.healthCheck]
              path = "/check"
              hostname = "domain-2.test.com"
              interval = "10s"
              timeout = "5s"
          [[http.services.app-2v1.loadBalancer.servers]]
              url = "http://s1.test.com/"

  [http.services.app-2v2]
      [http.services.app-2v2.loadBalancer]
          [http.services.app-2v2.loadBalancer.healthCheck]
              path = "/check"
              hostname = "domain-2.test.com"
              interval = "10s"
              timeout = "5s"
          [[http.services.app-2v2.loadBalancer.servers]]
              url = "http://s2.test.com/"

If applicable, please paste the log output in DEBUG level (--log.level=DEBUG switch)

time="2019-12-31T17:09:08+01:00" level=warning msg="Health check failed, removing from server list. Backend: \"app-2v1@file\" URL: \"http://s1.test.com/\" Weight: 1 Reason: receive$
time="2019-12-31T17:09:08+01:00" level=error msg="server not found"
time="2019-12-31T17:09:17+01:00" level=debug msg="Refreshing health check for backend: app-2v2@file"
time="2019-12-31T17:09:18+01:00" level=debug msg="Refreshing health check for backend: app-2v1@file"
time="2019-12-31T17:09:18+01:00" level=warning msg="Health check still failing. Backend: \"app-2v1@file\" URL: \"http://s1.test.com/\" Reason: received error status code: 504"
time="2019-12-31T17:09:27+01:00" level=debug msg="Refreshing health check for backend: app-2v2@file"
time="2019-12-31T17:09:28+01:00" level=debug msg="Refreshing health check for backend: app-2v1@file"
time="2019-12-31T17:09:28+01:00" level=warning msg="Health check still failing. Backend: \"app-2v1@file\" URL: \"http://s1.test.com/\" Reason: received error status code: 504"
time="2019-12-31T17:09:37+01:00" level=debug msg="Refreshing health check for backend: app-2v2@file"
time="2019-12-31T17:09:38+01:00" level=debug msg="Refreshing health check for backend: app-2v1@file"
time="2019-12-31T17:09:38+01:00" level=warning msg="Health check still failing. Backend: \"app-2v1@file\" URL: \"http://s1.test.com/\" Reason: received error status code: 504"
time="2019-12-31T17:09:47+01:00" level=debug msg="Refreshing health check for backend: app-2v2@file"
time="2019-12-31T17:09:48+01:00" level=debug msg="Refreshing health check for backend: app-2v1@file"
time="2019-12-31T17:09:48+01:00" level=warning msg="Health check still failing. Backend: \"app-2v1@file\" URL: \"http://s1.test.com/\" Reason: received error status code: 504"