Automated-AI-Web-Researcher-Ollama: pip install fails on building llama-cpp-python wheel

OS: 22.04.1-Ubuntu Python: Python 3.12.2

Build fails for llama-cpp-python

$ pip install -r requirements.txt 
...
Building wheels for collected packages: llama-cpp-python 
  Building wheel for llama-cpp-python (pyproject.toml) ... error 
  error: subprocess-exited-with-error 
  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully. 
  │ exit code: 1 
  ╰─> [128 lines of output] 
      *** scikit-build-core 0.10.7 using CMake 3.31.0 (wheel) 
      *** Configuring CMake... 
      loading initial cache file /tmp/tmpns9ajbe0/build/CMakeInit.txt 
      -- The C compiler identification is GNU 11.4.0 
      -- The CXX compiler identification is GNU 11.4.0 
      -- Detecting C compiler ABI info 
      -- Detecting C compiler ABI info - done 
      -- Check for working C compiler: /usr/bin/gcc - skipped 
      -- Detecting C compile features 
      -- Detecting C compile features - done 
      -- Detecting CXX compiler ABI info 
      -- Detecting CXX compiler ABI info - done 
      -- Check for working CXX compiler: /usr/bin/g++ - skipped 
      -- Detecting CXX compile features 
      -- Detecting CXX compile features - done 
      -- Found Git: /usr/bin/git (found version "2.34.1") 
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD 
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success 
      -- Found Threads: TRUE 
      -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF 
      -- CMAKE_SYSTEM_PROCESSOR: x86_64 
      -- Found OpenMP_C: -fopenmp (found version "4.5") 
      -- Found OpenMP_CXX: -fopenmp (found version "4.5") 
      -- Found OpenMP: TRUE (found version "4.5") 
      -- OpenMP found 
      -- Using llamafile 
      -- x86 detected 
      -- Using runtime weight conversion of Q4_0 to Q4_0_x_x to enable optimized GEMM/GEMV kernels 
      -- Including CPU backend 
      -- Using AMX 
      -- Including AMX backend 
      CMake Warning (dev) at CMakeLists.txt:13 (install): 
        Target llama has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION. 
      Call Stack (most recent call first): 
        CMakeLists.txt:80 (llama_cpp_python_install_target) 
      This warning is for project developers.  Use -Wno-dev to suppress it. 
      CMake Warning (dev) at CMakeLists.txt:21 (install): 
        Target llama has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION. 
      Call Stack (most recent call first): 
        CMakeLists.txt:80 (llama_cpp_python_install_target) 
      This warning is for project developers.  Use -Wno-dev to suppress it. 
      CMake Warning (dev) at CMakeLists.txt:13 (install): 
        Target ggml has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION. 
      Call Stack (most recent call first): 
        CMakeLists.txt:81 (llama_cpp_python_install_target) 
      This warning is for project developers.  Use -Wno-dev to suppress it. 
      CMake Warning (dev) at CMakeLists.txt:21 (install): 
        Target ggml has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION. 
      Call Stack (most recent call first): 
        CMakeLists.txt:81 (llama_cpp_python_install_target) 
      This warning is for project developers.  Use -Wno-dev to suppress it. 
      -- Configuring done (1.3s) 
      -- Generating done (0.0s) 
      -- Build files have been written to: /tmp/tmpns9ajbe0/build 
      *** Building project with Ninja... 
      Change Dir: '/tmp/tmpns9ajbe0/build' 
      Run Build Command(s): /tmp/pip-build-env-73kgrlh6/normal/lib/python3.12/site-packages/ninja/data/bin/ninja -v 
      [1/43] cd /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp && /tmp/pip-build-env-73kgrlh6/normal/lib/python3.12/site-packages/cmake/data/bin/cmake -DMSVC= -DCMAKE_C_COMPILER_VERSION=11.4.0 -DCMAKE_C_COMPILER_ID=GNU -DCMAKE_VS_PLATFORM_NAME= -DCMAKE_C_COMPILER=/usr/bin/gcc -P /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/cmake/build-info-gen-cpp.cmake 
      -- Found Git: /usr/bin/git (found version "2.34.1") 
      [2/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat   -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/build_info.dir/build-info.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/build_info.dir/build-info.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/build_info.dir/build-info.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/build-info.cpp 
      [3/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-aarch64.c.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-aarch64.c.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-aarch64.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-aarch64.c 
      [4/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-threading.cpp 
      [5/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-backend-reg.cpp 
      [6/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-alloc.c 
      [7/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/console.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/console.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/console.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/console.cpp 
      [8/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_amx_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -march=native -MD -MT vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/ggml-amx.cpp.o -MF vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/ggml-amx.cpp.o.d -o vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/ggml-amx.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/ggml-amx.cpp 
      [9/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_amx_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -march=native -MD -MT vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/mmq.cpp.o -MF vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/mmq.cpp.o.d -o vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/mmq.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-amx/mmq.cpp 
      [10/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_CPU_AARCH64 -DGGML_USE_LLAMAFILE -DGGML_USE_OPENMP -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cpu_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -march=native -fopenmp -MD -MT vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.cpp.o -MF vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.cpp.o.d -o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.cpp 
      [11/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../../common -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -O3 -DNDEBUG -fPIC -Wno-cast-qual -MD -MT vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o -MF vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o.d -o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/llava.cpp 
      [12/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/log.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/log.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/log.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/log.cpp 
      [13/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_CPU_AARCH64 -DGGML_USE_LLAMAFILE -DGGML_USE_OPENMP -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cpu_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -march=native -fopenmp -MD -MT vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-quants.c.o -MF vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-quants.c.o.d -o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-quants.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/ggml-cpu-quants.c 
      [14/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-backend.cpp 
      [15/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode-data.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode-data.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode-data.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/unicode-data.cpp 
      [16/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_CPU_AARCH64 -DGGML_USE_LLAMAFILE -DGGML_USE_OPENMP -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cpu_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -march=native -fopenmp -MD -MT vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-aarch64.c.o -MF vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-aarch64.c.o.d -o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-aarch64.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/ggml-cpu-aarch64.c 
      [17/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../../common -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/include -O3 -DNDEBUG -MD -MT vendor/llama.cpp/examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o -MF vendor/llama.cpp/examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o.d -o vendor/llama.cpp/examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/llava-cli.cpp 
      [18/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../../common -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/include -O3 -DNDEBUG -MD -MT vendor/llama.cpp/examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o -MF vendor/llama.cpp/examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o.d -o vendor/llama.cpp/examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/minicpmv-cli.cpp 
      [19/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/ngram-cache.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/ngram-cache.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/ngram-cache.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/ngram-cache.cpp 
      [20/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/sampling.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/sampling.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/sampling.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/sampling.cpp 
      [21/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml.c 
      [22/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/llama-grammar.cpp 
      [23/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/llama-sampling.cpp 
      [24/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-vocab.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-vocab.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-vocab.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/llama-vocab.cpp 
      [25/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_CPU_AARCH64 -DGGML_USE_LLAMAFILE -DGGML_USE_OPENMP -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cpu_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu++11 -fPIC -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -march=native -fopenmp -MD -MT vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/llamafile/sgemm.cpp.o -MF vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/llamafile/sgemm.cpp.o.d -o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/llamafile/sgemm.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp 
      [26/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -DGGML_USE_CPU_AARCH64 -DGGML_USE_LLAMAFILE -DGGML_USE_OPENMP -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_cpu_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -march=native -fopenmp -MD -MT vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.c.o -MF vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.c.o.d -o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c 
      [27/43] /usr/bin/gcc  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=gnu11 -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -MD -MT vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o -MF vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o.d -o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/ggml-quants.c 
      [28/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libggml-base.so -o vendor/llama.cpp/ggml/src/libggml-base.so vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o vendor/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-aarch64.c.o  -Wl,-rpath,"\$ORIGIN"  -lm && : 
      [29/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libggml-amx.so -o vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/ggml-amx.cpp.o vendor/llama.cpp/ggml/src/ggml-amx/CMakeFiles/ggml-amx.dir/mmq.cpp.o  -Wl,-rpath,"\$ORIGIN"  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      [30/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libggml-cpu.so -o vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.c.o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu.cpp.o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-aarch64.c.o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/ggml-cpu-quants.c.o vendor/llama.cpp/ggml/src/ggml-cpu/CMakeFiles/ggml-cpu.dir/llamafile/sgemm.cpp.o  -Wl,-rpath,"\$ORIGIN"  vendor/llama.cpp/ggml/src/libggml-base.so  /usr/lib/gcc/x86_64-linux-gnu/11/libgomp.so && : 
      [31/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libggml.so -o vendor/llama.cpp/ggml/src/libggml.so vendor/llama.cpp/ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o  -Wl,-rpath,"\$ORIGIN"  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      [32/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/common.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/common.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/common.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/common.cpp 
      [33/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/unicode.cpp 
      [34/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/json-schema-to-grammar.cpp 
      [35/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../.. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/../../common -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -O3 -DNDEBUG -fPIC -Wno-cast-qual -MD -MT vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o -MF vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o.d -o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/examples/llava/clip.cpp 
      [36/43] : && /tmp/pip-build-env-73kgrlh6/normal/lib/python3.12/site-packages/cmake/data/bin/cmake -E rm -f vendor/llama.cpp/examples/llava/libllava_static.a && /usr/bin/ar qc vendor/llama.cpp/examples/llava/libllava_static.a  vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o && /usr/bin/ranlib vendor/llama.cpp/examples/llava/libllava_static.a && : 
      [37/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_SHARED -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/common/CMakeFiles/common.dir/arg.cpp.o -MF vendor/llama.cpp/common/CMakeFiles/common.dir/arg.cpp.o.d -o vendor/llama.cpp/common/CMakeFiles/common.dir/arg.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/common/arg.cpp 
      [38/43] /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_AMX -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/. -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/../include -I/tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/ggml/src/../include -O3 -DNDEBUG -fPIC -MD -MT vendor/llama.cpp/src/CMakeFiles/llama.dir/llama.cpp.o -MF vendor/llama.cpp/src/CMakeFiles/llama.dir/llama.cpp.o.d -o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama.cpp.o -c /tmp/pip-install-oegh1a33/llama-cpp-python_050f75c93944400091e2f5925916ef80/vendor/llama.cpp/src/llama.cpp 
      [39/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libllama.so -o vendor/llama.cpp/src/libllama.so vendor/llama.cpp/src/CMakeFiles/llama.dir/llama.cpp.o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-vocab.cpp.o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o vendor/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o vendor/llama.cpp/src/CMakeFiles/llama.dir/unicode-data.cpp.o  -Wl,-rpath,"\$ORIGIN"  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      [40/43] : && /tmp/pip-build-env-73kgrlh6/normal/lib/python3.12/site-packages/cmake/data/bin/cmake -E rm -f vendor/llama.cpp/common/libcommon.a && /usr/bin/ar qc vendor/llama.cpp/common/libcommon.a  vendor/llama.cpp/common/CMakeFiles/build_info.dir/build-info.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/arg.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/common.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/console.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/log.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/ngram-cache.cpp.o vendor/llama.cpp/common/CMakeFiles/common.dir/sampling.cpp.o && /usr/bin/ranlib vendor/llama.cpp/common/libcommon.a && : 
      [41/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -fPIC -O3 -DNDEBUG   -shared -Wl,-soname,libllava.so -o vendor/llama.cpp/examples/llava/libllava.so vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o  -Wl,-rpath,"\$ORIGIN"  vendor/llama.cpp/src/libllama.so  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      [42/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -O3 -DNDEBUG  vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o -o vendor/llama.cpp/examples/llava/llama-llava-cli  -Wl,-rpath,/tmp/tmpns9ajbe0/build/vendor/llama.cpp/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-cpu:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-amx:  vendor/llama.cpp/common/libcommon.a  vendor/llama.cpp/src/libllama.so  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      FAILED: vendor/llama.cpp/examples/llava/llama-llava-cli 
      : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -O3 -DNDEBUG  vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llama-llava-cli.dir/llava-cli.cpp.o -o vendor/llama.cpp/examples/llava/llama-llava-cli  -Wl,-rpath,/tmp/tmpns9ajbe0/build/vendor/llama.cpp/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-cpu:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-amx:  vendor/llama.cpp/common/libcommon.a  vendor/llama.cpp/src/libllama.so  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      /home/kartik/miniconda3/compiler_compat/ld: warning: libgomp.so.1, needed by vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so, not found (try using -rpath or -rpath-link) 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_barrier@GOMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_parallel@GOMP_4.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `omp_get_thread_num@OMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_single_start@GOMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `omp_get_num_threads@OMP_1.0' 
      collect2: error: ld returned 1 exit status 
      [43/43] : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -O3 -DNDEBUG  vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o -o vendor/llama.cpp/examples/llava/llama-minicpmv-cli  -Wl,-rpath,/tmp/tmpns9ajbe0/build/vendor/llama.cpp/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-cpu:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-amx:  vendor/llama.cpp/common/libcommon.a  vendor/llama.cpp/src/libllama.so  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      FAILED: vendor/llama.cpp/examples/llava/llama-minicpmv-cli 
      : && /usr/bin/g++  -pthread -B /home/kartik/miniconda3/compiler_compat -O3 -DNDEBUG  vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/llava.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llava.dir/clip.cpp.o vendor/llama.cpp/examples/llava/CMakeFiles/llama-minicpmv-cli.dir/minicpmv-cli.cpp.o -o vendor/llama.cpp/examples/llava/llama-minicpmv-cli  -Wl,-rpath,/tmp/tmpns9ajbe0/build/vendor/llama.cpp/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-cpu:/tmp/tmpns9ajbe0/build/vendor/llama.cpp/ggml/src/ggml-amx:  vendor/llama.cpp/common/libcommon.a  vendor/llama.cpp/src/libllama.so  vendor/llama.cpp/ggml/src/libggml.so  vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so  vendor/llama.cpp/ggml/src/ggml-amx/libggml-amx.so  vendor/llama.cpp/ggml/src/libggml-base.so && : 
      /home/kartik/miniconda3/compiler_compat/ld: warning: libgomp.so.1, needed by vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so, not found (try using -rpath or -rpath-link) 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_barrier@GOMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_parallel@GOMP_4.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `omp_get_thread_num@OMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `GOMP_single_start@GOMP_1.0' 
      /home/kartik/miniconda3/compiler_compat/ld: vendor/llama.cpp/ggml/src/ggml-cpu/libggml-cpu.so: undefined reference to `omp_get_num_threads@OMP_1.0' 
      collect2: error: ld returned 1 exit status 
      ninja: build stopped: subcommand failed. 
      *** CMake build failed 
      [end of output] 
  note: This error originates from a subprocess, and is likely not a problem with pip. 
  ERROR: Failed building wheel for llama-cpp-python 
Failed to build llama-cpp-python 
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (llama-cpp-python) 

About this issue

  • Original URL
  • State: open
  • Created 2 years ago
  • Comments: 21 (9 by maintainers)

Most upvoted comments

Try windows subsystem for linux

Ahhhhhhhhh that makes a LOT of sense; thanks so much! I remember in my early AI days trying to figure this stuff out that that naming convention could be an issue, but never really encountered it until just now (not a coder by trade). I’ll do some reconfiguring on that directory when I get a chance and try to re-test; I appreciate you pointing that out!

@clduab11 I think I see the error and how to fix it. This specific line: image indicates that because your user is named “CLD’s Tower” with an apostrophe, it is being incorrectly registered (which is why it said the “s” was unexpected at character 22).

Try renaming your user to not include the apostrophe, to something like “CLDs_Tower”. This is because the ’ makes it think the string already ended when it shouldn’t have for that line, causing an error.

Let me know if this fixes it!

@clduab11 Sure thing!

I added it in the right order with the steps here (starting at “Installation on Windows”): https://github.com/leapingturtlefrog/Automated-AI-Web-Researcher-Ollama/blob/feature/windows-support/README.md although it hasn’t been merged to the main Windows branch Readme.

@synth-mania I’m on a fresh install of Windows 11 and using the windows branch and am getting the same error. Using the most recent versions of python, miniconda, git, and pip, just following the steps in the windows instructions.

Side note, activating my venv as written in the installation instructions also created an error for me, I had to specify .\venv\Scripts\activate

I answered @sebkont in another issue, but I’ll post this again here so more people see this. There is now a windows compatible branch. Please check it out!