kube-httpcache: {{ range .Backends -}} doesn't de-register on pod delete

I’ve got a VCL running health checks:

{{ range .Backends }}
backend be-{{ .Name }} {
  .host = "{{ .Host }}";
  .port = "{{ .Port }}";
  .first_byte_timeout = 600s;
  .probe = {
      .url = "/health_check.php";
      .timeout = 2s;
      .interval = 5s;
      .window = 10;
      .threshold = 5;
  }
}
{{- end }}

Now even with 1 backend in the service to discover, we’re getting multiple health checks (to the point it’s overloading our server). (this is a single pod’s logs here). I’m assuming it’s been registered more than once in the range.Backends, but I could be wrong.

127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:43 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:43 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:43 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:43 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:43 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"
127.0.0.1 -  29/Jan/2020:23:40:46 +0000 "GET /health_check.php" 200
10.0.1.179:80 10.0.1.139 - - [29/Jan/2020:23:40:44 +0000] "GET /health_check.php HTTP/1.1" 200 517 "-" "-"

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 33 (14 by maintainers)

Most upvoted comments

sure, Ill try it oit tomorrow