chroma: `pip install chromadb` fails with python 3.11.0

steps to recreate:

  1. open shell with python 3.11.0
  2. run pip install chromadb
  3. see error “ERROR: Cannot install chromadb==0.1.0, chromadb==0.2.0, chromadb==0.3.0, chromadb==0.3.1 and chromadb==0.3.2 because these package versions have conflicting dependencies.”

workarounds:

  1. downgrade python to 3.10 to match dockerfile version

full terminal output:

(chroma) jefflab@JeffsM1Air app % pip install chromadb
Collecting chromadb
  Downloading chromadb-0.3.4-py3-none-any.whl (38 kB)
Collecting pandas>=1.3
  Using cached pandas-1.5.3-cp311-cp311-macosx_11_0_arm64.whl (10.8 MB)
Collecting requests>=2.28
  Using cached requests-2.28.2-py3-none-any.whl (62 kB)
Collecting pydantic>=1.9
  Using cached pydantic-1.10.5-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB)
Collecting hnswlib>=0.7
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting clickhouse-connect>=0.5.7
  Using cached clickhouse_connect-0.5.12-cp311-cp311-macosx_11_0_arm64.whl (216 kB)
Collecting sentence-transformers>=2.2.2
  Using cached sentence-transformers-2.2.2.tar.gz (85 kB)
  Preparing metadata (setup.py) ... done
Collecting duckdb>=0.5.1
  Downloading duckdb-0.7.0-cp311-cp311-macosx_11_0_arm64.whl (12.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 26.8 MB/s eta 0:00:00
Collecting fastapi>=0.85.1
  Downloading fastapi-0.92.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.2/56.2 kB 4.1 MB/s eta 0:00:00
Collecting uvicorn[standard]>=0.18.3
  Downloading uvicorn-0.20.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.9/56.9 kB 4.4 MB/s eta 0:00:00
Collecting numpy>=1.21.6
  Using cached numpy-1.24.2-cp311-cp311-macosx_11_0_arm64.whl (13.8 MB)
Collecting certifi
  Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 15.5 MB/s eta 0:00:00
Collecting urllib3>=1.26
  Downloading urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 kB 9.5 MB/s eta 0:00:00
Collecting pytz
  Downloading pytz-2022.7.1-py2.py3-none-any.whl (499 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 499.4/499.4 kB 16.1 MB/s eta 0:00:00
Collecting zstandard
  Downloading zstandard-0.20.0-cp311-cp311-macosx_11_0_arm64.whl (355 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 356.0/356.0 kB 14.3 MB/s eta 0:00:00
Collecting lz4
  Downloading lz4-4.3.2-cp311-cp311-macosx_11_0_arm64.whl (212 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 212.3/212.3 kB 12.8 MB/s eta 0:00:00
Collecting starlette<0.26.0,>=0.25.0
  Downloading starlette-0.25.0-py3-none-any.whl (66 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 5.8 MB/s eta 0:00:00
Collecting python-dateutil>=2.8.1
  Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 11.9 MB/s eta 0:00:00
Collecting typing-extensions>=4.2.0
  Using cached typing_extensions-4.5.0-py3-none-any.whl (27 kB)
Collecting charset-normalizer<4,>=2
  Downloading charset_normalizer-3.0.1-cp311-cp311-macosx_11_0_arm64.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 11.2 MB/s eta 0:00:00
Collecting idna<4,>=2.5
  Downloading idna-3.4-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 7.4 MB/s eta 0:00:00
Collecting transformers<5.0.0,>=4.6.0
  Downloading transformers-4.26.1-py3-none-any.whl (6.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.3/6.3 MB 25.4 MB/s eta 0:00:00
Collecting tqdm
  Downloading tqdm-4.64.1-py2.py3-none-any.whl (78 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.5/78.5 kB 5.4 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
Collecting requests>=2.28
  Downloading requests-2.28.1-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 6.1 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of pydantic to determine which version is compatible with other requirements. This could take a while.
Collecting pydantic>=1.9
  Downloading pydantic-1.10.4-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.5/2.5 MB 24.5 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of pandas to determine which version is compatible with other requirements. This could take a while.
Collecting pandas>=1.3
  Downloading pandas-1.5.2-cp311-cp311-macosx_11_0_arm64.whl (10.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.7/10.7 MB 22.7 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of numpy to determine which version is compatible with other requirements. This could take a while.
Collecting numpy>=1.21.6
  Downloading numpy-1.24.1-cp311-cp311-macosx_11_0_arm64.whl (13.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.8/13.8 MB 19.3 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of hnswlib to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of fastapi to determine which version is compatible with other requirements. This could take a while.
Collecting fastapi>=0.85.1
  Downloading fastapi-0.91.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.2/56.2 kB 3.7 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of duckdb to determine which version is compatible with other requirements. This could take a while.
Collecting duckdb>=0.5.1
  Downloading duckdb-0.6.1-cp311-cp311-macosx_11_0_arm64.whl (11.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 23.3 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of clickhouse-connect to determine which version is compatible with other requirements. This could take a while.
Collecting clickhouse-connect>=0.5.7
  Downloading clickhouse_connect-0.5.11-cp311-cp311-macosx_11_0_arm64.whl (216 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.6/216.6 kB 10.5 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of chromadb to determine which version is compatible with other requirements. This could take a while.
Collecting chromadb
  Downloading chromadb-0.3.3-py3-none-any.whl (38 kB)
  Downloading chromadb-0.3.2-py3-none-any.whl (37 kB)
Collecting duckdb~=0.5.1
  Using cached duckdb-0.5.1.tar.gz (13.5 MB)
  Preparing metadata (setup.py) ... done
Collecting fastapi~=0.85.1
  Using cached fastapi-0.85.2-py3-none-any.whl (55 kB)
Collecting uvicorn[standard]~=0.18.3
  Using cached uvicorn-0.18.3-py3-none-any.whl (57 kB)
Collecting chromadb
  Using cached chromadb-0.3.1-py3-none-any.whl (37 kB)
  Using cached chromadb-0.3.0-py3-none-any.whl (36 kB)
  Using cached chromadb-0.2.0-py3-none-any.whl (36 kB)
Collecting uuid~=1.30
  Using cached uuid-1.30.tar.gz (5.8 kB)
  Preparing metadata (setup.py) ... done
Collecting chromadb
  Using cached chromadb-0.1.0-py3-none-any.whl (34 kB)
ERROR: Cannot install chromadb==0.1.0, chromadb==0.2.0, chromadb==0.3.0, chromadb==0.3.1 and chromadb==0.3.2 because these package versions have conflicting dependencies.

The conflict is caused by:
    chromadb 0.3.2 depends on numpy~=1.21.6
    chromadb 0.3.1 depends on numpy~=1.21.6
    chromadb 0.3.0 depends on numpy~=1.21.6
    chromadb 0.2.0 depends on numpy~=1.21.6
    chromadb 0.1.0 depends on numpy~=1.21.6

To fix this you could try to:
1. loosen the range of package versions you've specified
5. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
(chroma) jefflab@JeffsM1Air app % python --version
Python 3.11.0

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Reactions: 13
  • Comments: 17 (2 by maintainers)

Most upvoted comments

this issue was raised way back in feb23. we already have python 3.12.0 we still face the same issue. each package ofcourse will depend on other packages and there will be version conflicts because different developers use different versions to develop. but this is causing too much of a hassle for someone who just wants to use a package to avail a particular feature. we cannot have 100s of environments. how do I install chromadb for python 3.12 to use langchain? please help. May I request to reopen this issue?

+7
annamalaiarunachalam on Dec 4, 2023

Works fine with: ARCHFLAGS="-arch x86_64" pip install chromadb See if that’s any useful.

Reference: https://github.com/Yale-LILY/SummerTime/issues/116#issuecomment-984134322

+4
kotakcloud on Apr 11, 2023

Will it be upgraded to be used with 3.11??

+3
jeyboy26 on Jun 16, 2023

That’s. Thank you, it actually told me that I need to instal Torch.

I am using Anaconda. I am successfully asking questions of multiple PDFs. Amazing.

I think my next project is a personal AI with memory - which will be local and able to use multiple pdfs to “peer review” another PDF.

+3
ryanniccolls on Apr 24, 2023

Thanks for filing this, I think what is occurring is that chromadb depends on sentence-transformers, which in turn depends on pytorch.

Pytorch is not yet compatible with python 3.11 https://github.com/pytorch/pytorch/issues/86566. You can verify this by trying to pip install pytorch or pip install sentence-transformers

I think for now you are restricted to using ❤️.11 without workarounds for a few dependencies such as installing pytorch nightly, and building sentence-transformers dependency sentencepiece (https://github.com/google/sentencepiece/issues/810).

+2
HammadB on Feb 22, 2023

yep, I tried 3.11.5 and it worked. looks like chromadb is not compatible with 3.12

On Thu, 14 Dec 2023 at 14:08, Rishav Ranjan @.***> wrote:

@annamalaiarunachalam https://github.com/annamalaiarunachalam bro, i’m stuck in same issue, and thinking to delete current version and reinstall 3.11.5, tell me if u tried this. ASAP please

— Reply to this email directly, view it on GitHub https://github.com/chroma-core/chroma/issues/163#issuecomment-1855200561, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALS6KGFW6NA35OPU3NZ5YZTYJKJXLAVCNFSM6AAAAAAVELEPP2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJVGIYDANJWGE . You are receiving this because you were mentioned.Message ID: @.***>

+1
annamalaiarunachalam on Dec 17, 2023

It worked, after installing the 3.11.5 version. But, it’s suggested to delete the corresponding modules and libraries simultaneously with python uninstalling, coz u’ll be needing to reinstall everything after another python installation

+1
RishavRanjan123 on Dec 14, 2023

SOLUTION: ChromaDB - chroma-hnswlib build error: Microsoft Visual C++ 14.0 or greater is required https://gist.github.com/ashmalvayani/ab3f4a8469fe3a2e9904c3a2674ea947

+1
ashmalvayani on Aug 24, 2023

@ryanniccolls I don’t think pytorch is maintained as pypi pytorch anymore. You likely only want torch https://pypi.org/project/torch/ https://pypi.org/project/pytorch/

+1
HammadB on Apr 24, 2023
Read more comments on GitHub
← chroma: Nextjs invalid exports
chromatic-cli: building your Storybook fails (only with chromatic) →