salt: ZMQError: No such file or directory

Description of Issue/Question

Repeated errors in the log and salt-master is unresponsive:

# salt '*' test.ping
[ERROR   ] Unable to connect to the salt master publisher at /var/run/salt/master
The salt master could not be contacted. Is master running?
# tail -n 26 /var/log/salt/master
2017-07-23 02:19:57,129 [salt.utils.process][ERROR   ][4856] An un-handled exception from the multiprocessing process 'EventPublisher-56' was caught:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/salt/utils/process.py", line 647, in _run
    return self._original_run()
  File "/usr/lib/python2.7/site-packages/salt/utils/event.py", line 1109, in run
    self.publisher.start()
  File "/usr/lib/python2.7/site-packages/salt/transport/ipc.py", line 511, in start
    self.sock = tornado.netutil.bind_unix_socket(self.socket_path)
  File "/usr/lib/python2.7/site-packages/tornado/netutil.py", line 229, in bind_unix_socket
    sock.bind(file)
  File "/usr/lib/python2.7/socket.py", line 228, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 2] No such file or directory
2017-07-23 02:20:07,143 [salt.utils.process][ERROR   ][4871] An un-handled exception from the multiprocessing process 'EventPublisher-58' was caught:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/salt/utils/process.py", line 647, in _run
    return self._original_run()
  File "/usr/lib/python2.7/site-packages/salt/utils/event.py", line 1109, in run
    self.publisher.start()
  File "/usr/lib/python2.7/site-packages/salt/transport/ipc.py", line 511, in start
    self.sock = tornado.netutil.bind_unix_socket(self.socket_path)
  File "/usr/lib/python2.7/site-packages/tornado/netutil.py", line 229, in bind_unix_socket
    sock.bind(file)
  File "/usr/lib/python2.7/socket.py", line 228, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 2] No such file or directory

Setup

Arch Linux with libzmq 4.2.2

Versions Report

# salt --versions-report
Salt Version:                                                                                                                                                                                                     
           Salt: 2017.7.0                                                                                                                                                                                         
                                                                                                                                                                                                                  
Dependency Versions:                                                                                                                                                                                              
           cffi: 1.10.0                                                                                                                                                                                           
       cherrypy: Not Installed                                                                                                                                                                                    
       dateutil: Not Installed                                                                                                                                                                                    
      docker-py: Not Installed                                                                                                                                                                                    
          gitdb: Not Installed                                                                                                                                                                                    
      gitpython: Not Installed                                                                                                                                                                                    
          ioflo: Not Installed                                                                                                                                                                                    
         Jinja2: 2.9.6                                                                                                                                                                                            
        libgit2: Not Installed                                                                                                                                                                                    
        libnacl: Not Installed                                                                                                                                                                                    
       M2Crypto: 0.26.0                                                                                                                                                                                           
           Mako: Not Installed                                                                                                                                                                                    
   msgpack-pure: Not Installed                                                                                                                                                                                    
 msgpack-python: 0.4.8
   mysql-python: 1.2.5
      pycparser: 2.18
       pycrypto: 2.6.1
   pycryptodome: Not Installed
         pygit2: Not Installed
         Python: 2.7.13 (default, Jul 21 2017, 03:24:34)
   python-gnupg: 0.4.1
         PyYAML: 3.12
          PyZMQ: 16.0.2
           RAET: Not Installed
          smmap: Not Installed
        timelib: Not Installed
        Tornado: 4.5.1
            ZMQ: 4.2.2
 
System Versions:
           dist:   
         locale: UTF-8
        machine: x86_64
        release: 4.11.9-1-ARCH
         system: Linux
        version: Not Installed

About this issue

  • Original URL
  • State: closed
  • Created 7 years ago
  • Comments: 19 (18 by maintainers)

Most upvoted comments

Hrm. I wonder if it is a bug in the new zeromq on Arch.

I will test that in the morning.

Thanks! Daniel

On Thu, Aug 31, 2017 at 4:34 PM, Aaron Miller notifications@github.com wrote:

Yes, I started having this issue after a system update a few months ago and it’s been consistent since. I’m on a rolling release distro, maybe an updated dependency broke something?

Master config:

verify_env: false timeout: 300 sock_dir: “/var/run/salt/master” state_output: “mixed” state_tabular: true hash_type: “sha256” file_roots: base: - /srv/salt - /srv/formulas/salt - /srv/formulas/openssh - /srv/formulas/users - /srv/formulas/iscsi - /srv/formulas/binddns - /srv/formulas/iscdhcp - /srv/formulas/nfs - /srv/formulas/ntp - /srv/formulas/collectd - /srv/formulas/timezone - /srv/formulas/apache - /srv/formulas/php - /srv/formulas/mysql - /srv/formulas/plex - /srv/formulas/postfix - /srv/formulas/kerberos pillar_roots: base: - /srv/pillar peer: .*: - x509.sign_remote_certificate

The minion process on the same machine works fine.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/saltstack/salt/issues/42490#issuecomment-326438308, or mute the thread https://github.com/notifications/unsubscribe-auth/AAssoYv3JnXzF641cSJNvn493WwLIhrbks5sdzT0gaJpZM4OgZ2M .