tt-metal: Hang of stable diffusion demo
Stable diffusion demo hangs without watcher but runs fine with.
To repro checkout aknezevic/sd_demo_hang: and run pytest -svv models/experimental/functional_stable_diffusion/demo/demo.py::test_demo_diffusiondb.
If watcher is enabled, the test runs to completion:
TT_METAL_WATCHER=1 pytest -svv models/experimental/functional_stable_diffusion/demo/demo.py::test_demo_diffusiondb.
@tt-dma, can you please take a look?
@boris-drazic and @tt-nshanker FYI.
About this issue
- Original URL
- State: open
- Created 3 months ago
- Comments: 20 (16 by maintainers)
let’s downgrade until we see more sighting.
Pardon the delayed response, we thought the issue went away, but it is still present on some machines. @mtatsumiTT, can you please rebase and try and repro on your end again?