NEXT: Initalization hang for launch experiment under assistant/init
Under a local NextML, when having 6 unfinished experiments (using the PoolBasedBinaryClassification app) I observed an initialization hang (never completed) when attempting to launch the strange fruit experiment. No errors were observed in the NextML output.
The problem went away once I did docker rm $(docker ps -a -q)
About this issue
- Original URL
- State: closed
- Created 7 years ago
- Comments: 20 (16 by maintainers)
In my experience is the problem is when you haven’t removed the containers in a few days. I’ve had plenty of times when I’ve started 20+ experiments in quick succession.
I think the trick will be replicating it and then turning on some very verbose outputs to pinpoint the problem. That and removing the containers one at a time to try to see which one is causing it. I’ll try to figure it out the next time it happens to me.