prometheus-operator: Alertmanager startup failed without clear reason.

What did you do?

Follow the document to deploy kube-prometheus

What did you expect to see?

To see every service announced.

What did you see instead? Under which circumstances?

Altermanager failed by unknown reason, the last two lines output are

# kubectl logs -f alertmanager-main-0 alertmanager -n monitoring
level=info ts=2018-02-01T19:22:59.421236028Z caller=main.go:141 msg="Starting Alertmanager" version="(version=0.13.0, branch=HEAD, revision=fb713f6d8239b57c646cae30f78e8b4b8861a1aa)"
level=info ts=2018-02-01T19:22:59.4212879Z caller=main.go:142 build_context="(go=go1.9.2, user=root@d83981af1d3d, date=20180112-10:32:46)"

Then pod terminated.

Environment

CentOS 7

• Kubernetes version information:

# kubectl version
Client Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.1", GitCommit:"3a1c9449a956b6026f075fa3134ff92f7d55f812", GitTreeState:"clean", BuildDate:"2018-01-04T11:52:23Z", GoVersion:"go1.9.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.2", GitCommit:"5fa2db2bd46ac79e5e00a4e6ed24191080aa463b", GitTreeState:"clean", BuildDate:"2018-01-18T09:42:01Z", GoVersion:"go1.9.2", Compiler:"gc", Platform:"linux/amd64"}

• Kubernetes cluster kind:

  Use kubeadm

• Manifests:

insert manifests relevant to the issue

• Prometheus Operator Logs:

# kubectl logs -f prometheus-operator-85c9b758dd-gxw46 -n monitoring
ts=2018-02-01T03:26:31.307586192Z caller=operator.go:257 component=prometheusoperator msg="connection established" cluster-version=v1.9.2
ts=2018-02-01T03:26:31.307756958Z caller=operator.go:156 component=alertmanageroperator msg="connection established" cluster-version=v1.9.2
ts=2018-02-01T03:26:31.371419738Z caller=operator.go:170 component=alertmanageroperator msg="CRD API endpoints ready"
ts=2018-02-01T03:26:31.483874041Z caller=operator.go:271 component=prometheusoperator msg="CRD API endpoints ready"
ts=2018-02-01T03:26:48.438482959Z caller=operator.go:307 component=prometheusoperator msg="Prometheus added" key=monitoring/k8s
ts=2018-02-01T03:26:48.523520912Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:26:48.809660296Z caller=operator.go:969 component=prometheusoperator msg="creating configuration"
ts=2018-02-01T03:26:48.88587352Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:26:48.90257071Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:26:48.933296335Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340099 cur=340107
ts=2018-02-01T03:26:48.933776916Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340099 cur=340107
ts=2018-02-01T03:26:48.970786439Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:26:48.990934187Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:26:49.99426365Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:26:50.022387485Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:26:50.389940397Z caller=operator.go:303 component=alertmanageroperator msg="Alertmanager added" key=monitoring/main
ts=2018-02-01T03:26:50.390020554Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:26:50.430868299Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:26:50.455753148Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340139 cur=340142
ts=2018-02-01T03:26:50.456344145Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340139 cur=340142
ts=2018-02-01T03:26:50.549405075Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:26:59.446003072Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340107 cur=340247
ts=2018-02-01T03:26:59.44606253Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:26:59.446782092Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340107 cur=340247
ts=2018-02-01T03:27:00.458324482Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340247 cur=340263
ts=2018-02-01T03:27:00.458963778Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340247 cur=340263
ts=2018-02-01T03:27:00.466630927Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:27:00.507653672Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:27:00.515629873Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:27:33.014263597Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:27:33.014337588Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:27:33.030856014Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:27:46.404646742Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:27:46.4166149Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:27:46.497626176Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:27:46.505157199Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:28:25.838379911Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:28:25.838437041Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:28:42.274627176Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:28:42.274669645Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:28:42.284496721Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:29:26.059024254Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:29:26.074283227Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:29:26.109686899Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:29:26.124575376Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:29:35.532160062Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:29:35.532282068Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:30:29.134996086Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:30:29.135058147Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:30:29.147277524Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:30:38.524126671Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:30:38.524167612Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:30:56.710634775Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:30:56.723706867Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:30:56.81949763Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:30:56.826948737Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:31:31.395273496Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:31:31.395333056Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:31:31.673474547Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:31:31.673560775Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:31:31.686077233Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:31:31.686135719Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:31:31.694638082Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:31:31.771651181Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:31:31.771700089Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:31:31.779715358Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:31:31.785605665Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:32:07.548871692Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:32:07.54911554Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:32:07.565063929Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:32:35.061027982Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:32:35.061066789Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:32:53.892689524Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:32:53.906330087Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:32:53.923099646Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:32:53.971939514Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:33:55.88527775Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:33:55.885331135Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:33:55.896382912Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:34:01.920826501Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:34:01.92086568Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:34:32.719796847Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:34:32.734839255Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:34:32.799049169Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:34:32.808033392Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:35:33.717230411Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:35:33.73007957Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:35:33.747907577Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:35:33.754283944Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:35:41.036986462Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:35:41.037028368Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:35:42.564260109Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:35:42.564347454Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:35:42.57797686Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:36:31.395838105Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:36:31.395904847Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:36:31.67402671Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:36:31.674114152Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:36:31.689377726Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:36:31.689437052Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:36:31.693901876Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:36:31.716888801Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:36:31.774227495Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:36:31.774270705Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:36:31.776537054Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:36:52.153533664Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:36:52.15357456Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:37:15.06434512Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:37:15.070390408Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:37:15.175685947Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:37:15.192865135Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:37:18.569316922Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:37:18.569361194Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:37:18.575726359Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:38:01.898999694Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:38:01.899040576Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:38:30.3885188Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:38:30.388568348Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:38:30.401757284Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:38:52.07339466Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:38:52.08827804Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:38:52.108275881Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:38:52.117814048Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:39:32.97608523Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:39:32.976135451Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:39:32.985618871Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:39:37.895258973Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:39:37.895325264Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:40:47.218920917Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:40:47.273888247Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:40:47.291235035Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:40:47.299870654Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:41:07.012420203Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:41:07.012475185Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:41:07.028799784Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:41:28.97979895Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:41:28.979837599Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:41:31.396292102Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:41:31.396339188Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:41:31.674343283Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:41:31.674393778Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:41:31.682933414Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:41:31.689378751Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:41:31.689414198Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:41:31.692921825Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:41:31.699222706Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:41:31.774837903Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:41:31.774879667Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:42:09.492010405Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:42:09.492241118Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:42:09.513298795Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:42:32.817233316Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:42:32.817274016Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:42:35.057869261Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:42:35.073255814Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:42:35.096690219Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:42:35.108872639Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:43:46.659137996Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:43:46.65917809Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:43:46.665114328Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:44:03.933462895Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:44:03.940692982Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:44:03.958293548Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:44:03.969799495Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:44:08.489969827Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:44:08.490083254Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:45:27.846913017Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:45:27.84699405Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:45:27.867549438Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:45:45.552059522Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:45:45.564886475Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:45:45.587953558Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:45:45.594235151Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:45:46.966873751Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:45:46.966930161Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:46:31.39642737Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:46:31.396496471Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:46:31.675557997Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:46:31.675743686Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:46:31.690313391Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:46:31.690383182Z caller=operator.go:343 component=alertmanageroperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:46:31.695464187Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:46:31.775460912Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340263 cur=340263
ts=2018-02-01T03:46:31.775527827Z caller=operator.go:636 component=prometheusoperator msg="update handler" old=340142 cur=340142
ts=2018-02-01T03:46:31.77744944Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:46:31.801894429Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:46:32.435967295Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:46:32.436047045Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:46:32.45651383Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:47:29.720846516Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:47:29.734104245Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:47:29.750845707Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:47:29.777748129Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:47:41.676756079Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:47:41.676799073Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:47:41.683782046Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:47:43.214140359Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:47:43.214184292Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:49:10.991619902Z caller=operator.go:323 component=alertmanageroperator msg="Alertmanager updated" key=monitoring/main
ts=2018-02-01T03:49:10.991669175Z caller=operator.go:379 component=alertmanageroperator msg="sync alertmanager" key=monitoring/main
ts=2018-02-01T03:49:14.92126325Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:49:14.934074553Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:49:14.946675121Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:49:14.955319556Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"
ts=2018-02-01T03:49:37.773388608Z caller=operator.go:327 component=prometheusoperator msg="Prometheus updated" key=monitoring/k8s
ts=2018-02-01T03:49:37.773460129Z caller=operator.go:671 component=prometheusoperator msg="sync prometheus" key=monitoring/k8s
ts=2018-02-01T03:49:37.790093574Z caller=operator.go:980 component=prometheusoperator msg="updating config skipped, no configuration change"