mitogen: _broker_main() crashed

I’m mind-blown by the speed increase we’ve had with mitogen for some of our playbooks (going from ~40 minutes to ~7 minutes!!). The only issue we’re facing is that when the playbook ends (seemingly successful), it blurts out:

ERROR! [pid 12472] 14:59:12.774005 E mitogen: _broker_main() crashed
Traceback (most recent call last):
  File "/Users/gservat/Downloads/mitogen-stable/mitogen/core.py", line 1788, in _broker_main
    self._loop_once(max(0, deadline - time.time()))
  File "/Users/gservat/Downloads/mitogen-stable/mitogen/core.py", line 1774, in _loop_once
    for (side, func) in self.poller.poll(timeout):
  File "/Users/gservat/Downloads/mitogen-stable/mitogen/parent.py", line 560, in poll
    changelist, 32, timeout)
  File "/Users/gservat/Downloads/mitogen-stable/mitogen/core.py", line 287, in io_op
    return func(*args), False
OSError: [Errno 2] No such file or directory

Any ideas?

Python: 2.7.14

About this issue

Original URL
State: closed
Created 6 years ago
Comments: 21 (10 by maintainers)

Commits related to this issue

issue #300: temporary workaround for shutdown issue. Closes #300. — committed to mitogen-hq/mitogen by dw 6 years ago
Merge pull request #300 from spearlineltd/alert Alert container — committed to cyara/mitogen by dhavalindrodiya 2 years ago

Most upvoted comments

Hey @dw just wanted to confirm that v0.2.2 of mitogen seems to solve the issue for me 😄Thanks again!

gservat on Aug 7, 2018

This is now on the master branch and will make it into the next release. To be updated when a new release is made, subscribe to https://networkgenomics.com/mail/mitogen-announce/

Thanks again for reporting this!

dw on Aug 1, 2019

That definitely sounds like another race. Let me get an environment similar to yours and reproduce it – I haven’t tested much higher than the 80 target mark. These are usually really simple to fix once identified, but sometimes they can be difficult to tickle.

It’s entirely possible “-vvv” output will reveal another source of the hang, however if it is a race, enabling “-vvv” has a very high probability of hiding it. Incredibly frustrating 😃 So let me try finding it first on my end.

dw on Jul 12, 2018