elasticsearch_exporter: Elasticsearch 7.13 Breaking Metrics

Elasticsearch 7.13 appears to have removed several key metrics around cluster disk storage etc.

This means metrics like elasticsearch_filesystem_data_size_bytes are no longer present.

About this issue

Original URL
State: closed
Created 3 years ago
Reactions: 15
Comments: 20 (1 by maintainers)

Commits related to this issue

test: refactor TestNodesStats As per #419, this functionality is failing for elasticsearch version 7.13+ due to a breaking change in the response from elasticsearch. This adds some test fixtures for ... — committed to sysadmind/elasticsearch_exporter by sysadmind 3 years ago
test: refactor TestNodesStats As per #419, this functionality is failing for elasticsearch version 7.13+ due to a breaking change in the response from elasticsearch. This adds some test fixtures for ... — committed to transferwise/elasticsearch_exporter by sysadmind 3 years ago
test: refactor TestNodesStats As per #419, this functionality is failing for elasticsearch version 7.13+ due to a breaking change in the response from elasticsearch. This adds some test fixtures for ... — committed to jnadler/elasticsearch_exporter by sysadmind 3 years ago

Most upvoted comments

I think the problem is that they have added info on each HTTP client to HTTP stats and this breaks the nodes_response collector.

I think this is a fast solution but I don’t know how to export the new metrics. I’m using this branch for building because the original one is broken.

diff.txt

jivco on May 31, 2021

Using elasticsearch-exporter:master version worked for me too. Can somebody comment on when the actual version is getting released, we use that (example: 1.2.0) in our images.

gkulkarni32 on Jun 21, 2021

Same here, error log:

caller=nodes.go:1851 msg=“failed to fetch and decode node stats” err=“json: cannot unmarshal array into Go struct field NodeStatsNodeResponse.http of type int”

epicvinny on May 27, 2021

My bild is working ok 😃 Are you using fix-build-go-mod branch from https://github.com/repl-mike-roest/elasticsearch_exporter for building?

jivco@jivco:/tmp/elasticsearch_exporter$ docker build -t jivco-test-image:v1 .
Sending build context to Docker daemon  1.581MB
Step 1/9 : FROM quay.io/prometheus/golang-builder as builder
 ---> a6c160c7ad69
Step 2/9 : ADD .   /go/src/github.com/justwatchcom/elasticsearch_exporter
 ---> aa516d7645e8
Step 3/9 : WORKDIR /go/src/github.com/justwatchcom/elasticsearch_exporter
 ---> Running in 5f6b8a6e32b5
Removing intermediate container 5f6b8a6e32b5
 ---> abcf99aeb651
Step 4/9 : RUN make
 ---> Running in a44568db3170
go: downloading github.com/go-kit/kit v0.10.0
go: downloading github.com/blang/semver v3.5.2-0.20180723201105-3c1074078d32+incompatible
go: downloading github.com/prometheus/client_golang v1.10.0
go: downloading github.com/prometheus/common v0.20.0
go: downloading gopkg.in/alecthomas/kingpin.v2 v2.2.6
go: downloading github.com/imdario/mergo v0.3.7-0.20181107191138-ca3dcc1022ba
go: downloading github.com/alecthomas/template v0.0.0-20190718012654-fb15b899a751
go: downloading github.com/alecthomas/units v0.0.0-20210208195552-ff826a37aa15
go: downloading github.com/prometheus/client_model v0.2.0
go: downloading github.com/beorn7/perks v1.0.1
go: downloading github.com/cespare/xxhash/v2 v2.1.1
go: downloading github.com/golang/protobuf v1.5.2
go: downloading github.com/prometheus/procfs v0.6.0
go: downloading github.com/go-logfmt/logfmt v0.5.0
go: downloading google.golang.org/protobuf v1.26.0
go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.1
go: downloading golang.org/x/sys v0.0.0-20210415045647-66c3f260301c
>> formatting code
collector/nodes_response.go
go: downloading github.com/prometheus/promu v0.12.0
go: downloading github.com/pkg/errors v0.9.1
go: downloading github.com/google/go-github/v25 v25.1.3
go: downloading go.uber.org/atomic v1.7.0
go: downloading golang.org/x/oauth2 v0.0.0-20210413134643-5e61552d6c78
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading github.com/Masterminds/semver v1.5.0
go: downloading github.com/prometheus/common v0.25.0
go: downloading golang.org/x/oauth2 v0.0.0-20210514164344-f6687ab2804c
go: downloading github.com/google/go-github v17.0.0+incompatible
go: downloading github.com/cespare/xxhash v1.1.0
go: downloading golang.org/x/net v0.0.0-20210415231046-e915ea6b2b7d
go: downloading google.golang.org/appengine v1.6.7
go: downloading golang.org/x/sys v0.0.0-20210601080250-7ecdf8ef093b
go: downloading golang.org/x/net v0.0.0-20210525063256-abc453219eb5
go: downloading github.com/google/go-querystring v1.1.0
go get: upgraded github.com/prometheus/common v0.20.0 => v0.25.0
go get: upgraded golang.org/x/net v0.0.0-20210415231046-e915ea6b2b7d => v0.0.0-20210525063256-abc453219eb5
go get: upgraded golang.org/x/oauth2 v0.0.0-20210413134643-5e61552d6c78 => v0.0.0-20210514164344-f6687ab2804c
go get: upgraded golang.org/x/sys v0.0.0-20210415045647-66c3f260301c => v0.0.0-20210601080250-7ecdf8ef093b
>> building binaries
 >   elasticsearch_exporter
>> running tests
?   	github.com/justwatchcom/elasticsearch_exporter	[no test files]
ok  	github.com/justwatchcom/elasticsearch_exporter/collector	0.033s
ok  	github.com/justwatchcom/elasticsearch_exporter/pkg/clusterinfo	0.028s
Removing intermediate container a44568db3170
 ---> 33d4fdd4a3f7
Step 5/9 : FROM        quay.io/prometheus/busybox:latest
 ---> 765c5b099deb
Step 6/9 : MAINTAINER  The Prometheus Authors <prometheus-developers@googlegroups.com>
 ---> Using cache
 ---> e58a1fa6b1d4
Step 7/9 : COPY --from=builder /go/src/github.com/justwatchcom/elasticsearch_exporter/elasticsearch_exporter  /bin/elasticsearch_exporter
 ---> f2d0044bbb84
Step 8/9 : EXPOSE      9114
 ---> Running in 164d8708eaae
Removing intermediate container 164d8708eaae
 ---> 4d01b438734f
Step 9/9 : ENTRYPOINT  [ "/bin/elasticsearch_exporter" ]
 ---> Running in e0c9b4101bdb
Removing intermediate container e0c9b4101bdb
 ---> 7f55b14f692d
Successfully built 7f55b14f692d
Successfully tagged jivco-test-image:v1

jivco on Jun 2, 2021