bionic-gpt: Docker container llama-2-7b-chat:1.0.2 doesn't start

Hi There,

First thing…love the project. The UI and the potential look awesome. Unfortunately, I can’t get it to work.

I installed Ubuntu Server in a VM, installed Docker and Docker Compose then used your script from the documentation to install BionicGPT. I can reach the UI but every time I submit a query I get a “Error occurred while generating” message.

In the logs of the app docker_app_1 I can see the following error. 2023-12-10T18:33:13.374169Z ERROR axum_server::errors: response="status = 422 Unprocessable Entity, message = error trying to connect: dns error: failed to lookup address information: Try again"

The container ghcr.io/bionic-gpt/llama-2-7b-chat:1.0.2 exists immediately after deploying with no?? logs. I assume this is the issue but I am not sure what I did wrong.

image

This runs in a Proxmox VM on an Intel Xeon X5690. The VM has 8 cores allocated, 16 GB Ram (DDR3 ECC) and 128GB SSD storage.

Thank you

About this issue

  • Original URL
  • State: closed
  • Created 7 months ago
  • Comments: 21 (12 by maintainers)

Most upvoted comments

You are still on 1.0.2 according to your screenshot. The docker compose file of bionic-gpt needs an update first. Or you can just manually set the tag to 1.0.4

@truehumandesign We’ve now updated to 1.0.4 I just needed to test it first.