bionic-gpt: Docker container llama-2-7b-chat:1.0.2 doesn't start
Hi There,
First thing…love the project. The UI and the potential look awesome. Unfortunately, I can’t get it to work.
I installed Ubuntu Server in a VM, installed Docker and Docker Compose then used your script from the documentation to install BionicGPT. I can reach the UI but every time I submit a query I get a “Error occurred while generating” message.
In the logs of the app docker_app_1 I can see the following error. 2023-12-10T18:33:13.374169Z ERROR axum_server::errors: response="status = 422 Unprocessable Entity, message = error trying to connect: dns error: failed to lookup address information: Try again"
The container ghcr.io/bionic-gpt/llama-2-7b-chat:1.0.2 exists immediately after deploying with no?? logs. I assume this is the issue but I am not sure what I did wrong.
This runs in a Proxmox VM on an Intel Xeon X5690. The VM has 8 cores allocated, 16 GB Ram (DDR3 ECC) and 128GB SSD storage.
Thank you
About this issue
- Original URL
- State: closed
- Created 7 months ago
- Comments: 21 (12 by maintainers)
@truehumandesign We’ve now updated to 1.0.4 I just needed to test it first.