MiniGPT-4: Windows not supported

To save fellow Windows users some time and download bandwidth, this project only runs on Linux due to (at least) one of the dependencies not supporting Windows.

https://github.com/TimDettmers/bitsandbytes#requirements--installation

You’ll receive an error upon running it.

python.exe .\demo.py --cfg-path .\eval_configs\minigpt4_eval.yaml
# Required library version not found: libsbitsandbytes_cpu.so. Maybe you need to compile it from source?

The .so extension is for Linux only.

About this issue

Original URL
State: open
Created a year ago
Reactions: 1
Comments: 19

Most upvoted comments

I got it working on Windows 10 (CUDA 118, RTX 4090). Install this version compatible with windows: conda install git pip pip uninstall bitsandbytes pip install git+https://github.com/Keith-Hon/bitsandbytes-windows.git

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

binary_path: C:\ProgramData\miniconda3\envs\minigpt4\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll CUDA SETUP: Loading binary C:\ProgramData\miniconda3\envs\minigpt4\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll… Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:29<00:00, 9.74s/it] Loading LLAMA Done Load 4 training prompts Prompt Example ###Human: <ImageHere> Describe this image in detail. ###Assistant: Load BLIP2-LLM Checkpoint: ./model/pretrained_minigpt4.pth Initialization Finished Running on local URL: http://127.0.0.1:7860

First I uninstalled the none-windows package of bitsandbytes and after that I installed this version in Anaconda: https://github.com/Keith-Hon/bitsandbytes-windows.git

You just need to have installed Git on your Windows

latorc on Apr 26, 2023