dream-factory: GPU directories not being created correctly
Hello,
I’m attempting to run dream-factory on a ubuntu machine, it appears to be running - the web interface comes up and all GPUs show status dreaming, however after some time the following errors start to get thrown. It appears to be something wrong with the folder creation.
After a bit more time only two of the devices (which seem to be random), continue running. The other devices get stuck in the following +exif data state. While two of the devices keep dreaming and generating files. The files however are not stored/copied into the proper directories e.g. gpu_0, they remain in the root of the output/<date-config_name> directory.
I will attempt to debug this and make changes, however if you have any idea or guidance what could cause this that would be helpful. I really like this project and would like to contribute.
Please see the error below, following screenshot and system info.
Exception in thread Thread-17:
Traceback (most recent call last):
File "/home/lol/anaconda3/envs/dream-factory/lib/python3.9/threading.py", line 980, in _bootstrap_inner
self.run()
File "/home/lol/dream-factory/dream-factory.py", line 143, in run
new_files = os.listdir(samples_dir)
FileNotFoundError: [Errno 2] No such file or directory: 'output/2022-11-28-example-standard/gpu_4'
Exception in thread Thread-15:
Traceback (most recent call last):
File "/home/lol/anaconda3/envs/dream-factory/lib/python3.9/threading.py", line 980, in _bootstrap_inner
self.run()
File "/home/lol/dream-factory/dream-factory.py", line 143, in run
new_files = os.listdir(samples_dir)
FileNotFoundError: [Errno 2] No such file or directory: 'output/2022-11-28-example-standard/gpu_2'
Below are the system specs
(dream-factory) lol@lol-H110-D3A:~/dream-factory$ lsb_release -a
...
Distributor ID: Ubuntu
Description: Ubuntu 22.04.1 LTS
Release: 22.04
Codename: jammy
(dream-factory) lol@lol-H110-D3A:~/dream-factory$ sudo lshw -short
...
H/W path Device Class Description
========================================================
system H110-D3A (Default string)
/0 bus H110-D3A-CF
/0/0 memory 64KiB BIOS
/0/3d memory 20GiB System Memory
/0/3d/0 memory 16GiB DIMM DDR4 Synchronous 2133 MH
/0/3d/1 memory [empty]
/0/3d/2 memory 4GiB DIMM DDR4 Synchronous 2133 MHz
/0/3d/3 memory [empty]
/0/43 memory 128KiB L1 cache
/0/44 memory 512KiB L2 cache
/0/45 memory 2MiB L3 cache
/0/46 processor Intel(R) Celeron(R) CPU G3930 @ 2.9
/0/100 bridge Xeon E3-1200 v6/7th Gen Core Proces
/0/100/1 bridge 6th-10th Gen Core Processor PCIe Co
CUDA devices
(dream-factory) lol@lol-H110-D3A:~/dream-factory$ nvidia-smi
Mon Nov 28 15:32:21 2022
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 520.61.05 Driver Version: 520.61.05 CUDA Version: 11.8 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... Off | 00000000:01:00.0 On | N/A |
| 0% 46C P0 35W / 180W | 386MiB / 8192MiB | 5% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 1 NVIDIA GeForce ... Off | 00000000:03:00.0 Off | N/A |
| 0% 49C P8 24W / 220W | 6MiB / 8192MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 2 NVIDIA GeForce ... Off | 00000000:04:00.0 Off | N/A |
| 0% 35C P8 6W / 180W | 6MiB / 8192MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 3 NVIDIA GeForce ... Off | 00000000:05:00.0 Off | N/A |
| 0% 37C P8 7W / 180W | 6MiB / 8192MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 4 NVIDIA GeForce ... Off | 00000000:06:00.0 Off | N/A |
| 0% 49C P8 23W / 240W | 6MiB / 8192MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 5 NVIDIA GeForce ... Off | 00000000:07:00.0 Off | N/A |
| 0% 45C P8 17W / 240W | 6MiB / 8192MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 18 (9 by maintainers)
Just pushed the latest code up - I’m pretty confident that everything will work for you, though I do recommend a fresh install. Full changelog is here. You’ll also need to set up Auto1111’s repo as part of the setup process now; although that should take more than a few minutes.
Let me know how it goes for you!
@mkabatek oh my bad, img2img is already implemented! Just create a new prompt file and take a look at these 2 settings:
Just set !INPUT_IMAGE= to whatever image you want to use at the starting image (relative to the Dream Factory folder, or absolute paths are fine too). !STRENGTH is the denoising strength. In standard prompt files, you can put both of these in the [prompts] sections too, in case you want to set up switches between multiple input images. Setting !INPUT_IMAGE= by itself will clear out any set input image.
I really need to get some documentation on the github page. 🤣