salt: Memory leak in ZeroMQPubServerChannel

Description of Issue/Question

I have a salt master connected to 50 minions, and I see a slow memory leak in the ZeroMQPubServerChannel it started with 40Mb, the memory usage keeps going up about 40MB per hour. I’m also having minions disconnection issue but not sure its related.

 ps -aux
USER        PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root          1  0.0  0.0 297428 44700 ?        Ss   17:20   0:01 /usr/bin/python2 /usr/bin/salt-master --log-file-level=debug ProcessManager
root         20  0.0  0.0 215080 24008 ?        S    17:20   0:00 /usr/bin/python2 /usr/bin/salt-master --log-file-level=debug MultiprocessingLoggingQueue
root         25  0.0  0.3 575160 207484 ?       Sl   17:20   0:01 /usr/bin/python2 /usr/bin/salt-master --log-file-level=debug ZeroMQPubServerChannel
root         28  0.0  0.0 306412 46996 ?        S    17:20   0:06 /usr/bin/python2 /usr/bin/salt-master --log-file-level=debug EventPublisher

Setup

(Please provide relevant configs and/or SLS files (Be sure to remove sensitive info).) The minions are connecting to the master behind an haproxy.

Steps to Reproduce Issue

(Include debug logs if possible and relevant.)

Versions Report

(Provided by running salt --versions-report. Please also mention any differences in master/minion versions.)

Master: salt --versions-report Salt Version: Salt: 2016.11.1

Dependency Versions: cffi: Not Installed cherrypy: Not Installed dateutil: 2.6.0 gitdb: Not Installed gitpython: Not Installed ioflo: Not Installed Jinja2: 2.8 libgit2: Not Installed libnacl: Not Installed M2Crypto: Not Installed Mako: 1.0.6 msgpack-pure: Not Installed msgpack-python: 0.4.8 mysql-python: 1.2.5 pycparser: Not Installed pycrypto: 2.6.1 pygit2: Not Installed Python: 2.7.5 (default, Nov 6 2016, 00:28:07) python-gnupg: Not Installed PyYAML: 3.11 PyZMQ: 15.3.0 RAET: Not Installed smmap: Not Installed timelib: Not Installed Tornado: 4.2.1 ZMQ: 4.1.4

System Versions: dist: centos 7.2.1511 Core machine: x86_64 release: 3.10.0-327.10.1.el7.strato0004.46fa8ebfb529.x86_64 system: Linux version: CentOS Linux 7.2.1511 Core

Minions: salt --versions-report Salt Version: Salt: 2016.11.1

Dependency Versions: cffi: Not Installed cherrypy: Not Installed dateutil: Not Installed gitdb: Not Installed gitpython: Not Installed ioflo: Not Installed Jinja2: 2.8 libgit2: Not Installed libnacl: Not Installed M2Crypto: Not Installed Mako: Not Installed msgpack-pure: Not Installed msgpack-python: 0.4.8 mysql-python: Not Installed pycparser: Not Installed pycrypto: 2.6.1 pygit2: Not Installed Python: 2.7.12 (default, Sep 29 2016, 13:30:34) python-gnupg: Not Installed PyYAML: 3.11 PyZMQ: 14.7.0 RAET: Not Installed smmap: Not Installed timelib: Not Installed Tornado: 4.4.2 ZMQ: 4.1.4

System Versions: dist: fedora 24 Twenty Four machine: x86_64 release: 4.5.5-300.fc24.x86_64 system: Linux version: Fedora 24 Twenty Four