influxdb: memory leak crashing influxdb

I am seeing influxdb crash every day or two, because it consumes all the memory on the box. I took it from a 4GB to a 16GB and it just pushed how long it can go. Below is the chart. I find it odd that the Alloc and HeapAlloc are identical, but I looked here and it seems right. Still the growth and eventual OOM is a problem.

image

name: database
tags: database=metrics
numMeasurements	numSeries
---------------	---------
37		373362

influxdb version: InfluxDB v1.1.1 (git: master e47cf1f2e83a02443d7115c54f838be8ee959644) linux version: ubuntu 14.04

[general]
bind-address = ":8088"

[meta]
dir = "/mnt/db/meta"

[data]
dir = "/mnt/db/data"
wal-dir = "/mnt/influx"

[admin]
enabled = true
port = ":8083"
https-enabled = true
https-certificate = "/etc/cfssl/certs/combined.pem"

[hinted-handoff]
dir = "/mnt/db/hh"

[http]
bind-address = ":8086"
https-enabled = true
https-certificate = "/etc/cfssl/certs/combined.pem"
auth-enabled = true

About this issue

  • Original URL
  • State: closed
  • Created 7 years ago
  • Comments: 20 (8 by maintainers)

Commits related to this issue

Most upvoted comments

There’s an open docs pr documenting the internal metrics: https://github.com/influxdata/docs.influxdata.com/pull/777

We’re still investigating what may be causing the memory leak.