anything-llm: [BUG]: (fetch failed on embed) HuggingFace/Xenova blocking download from user IP

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I’m using latest AnythingLLM Version 1.1.1 (1.1.1) on a M2 Mac Studio.

I tried to embed some PDF or TXT files with default LanceDB, fetch failed. Then I get Chroma from github installed and ran locally with below command, NOT using Docker. Which is suggested by Chroma github.

pip install chromadb
chroma run --path /Volumes/Thunder_1T/chromaDB/

Then I tested heartbeat, working. Then I tried to embed same docs again, still failed. Since I tried with LanceDB getting same error from AnythingLLM, I guess I should report the bug here instead of Chroma. If it’s a bug on Chroma, please excuse me. Not a tech guy. Below finds running logs when error pops.

            (((((((((    (((((####
         ((((((((((((((((((((((#########
       ((((((((((((((((((((((((###########
     ((((((((((((((((((((((((((############
    (((((((((((((((((((((((((((#############
    (((((((((((((((((((((((((((#############
     (((((((((((((((((((((((((##############
     ((((((((((((((((((((((((##############
       (((((((((((((((((((((#############
         ((((((((((((((((##############
            (((((((((    #########

Running Chroma

Saving data to: /Volumes/Thunder_1T/chromaDB/ Connect to chroma at: http://localhost:8000 Getting started guide: https://docs.trychroma.com/getting-started

INFO: [27-02-2024 21:37:24] Set chroma_server_nofile to 65535 INFO: [27-02-2024 21:37:24] Anonymized telemetry enabled. See https://docs.trychroma.com/telemetry for more information. DEBUG: [27-02-2024 21:37:24] Starting component System DEBUG: [27-02-2024 21:37:24] Starting component OpenTelemetryClient DEBUG: [27-02-2024 21:37:24] Starting component SimpleAssignmentPolicy DEBUG: [27-02-2024 21:37:24] Starting component SqliteDB DEBUG: [27-02-2024 21:37:24] Starting component QuotaEnforcer DEBUG: [27-02-2024 21:37:24] Starting component Posthog DEBUG: [27-02-2024 21:37:24] Starting component LocalSegmentManager DEBUG: [27-02-2024 21:37:24] Starting component SegmentAPI INFO: [27-02-2024 21:37:24] Started server process [3055] INFO: [27-02-2024 21:37:24] Waiting for application startup. INFO: [27-02-2024 21:37:24] Application startup complete. INFO: [27-02-2024 21:37:24] Uvicorn running on http://localhost:8000 (Press CTRL+C to quit) INFO: [27-02-2024 21:37:48] ::1:54252 - “GET /api/v1/heartbeat HTTP/1.1” 200 ERROR: [27-02-2024 21:37:48] Collection test does not exist. Traceback (most recent call last): File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py”, line 97, in receive return self.receive_nowait() ^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py”, line 92, in receive_nowait raise WouldBlock anyio.WouldBlock

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 159, in call_next message = await recv_stream.receive() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/streams/memory.py”, line 112, in receive raise EndOfStream anyio.EndOfStream

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py”, line 82, in catch_exceptions_middleware return await call_next(request) ^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 165, in call_next raise app_exc File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 151, in coro await self.app(scope, receive_or_disconnect, send_no_error) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 189, in call with collapse_excgroups(): File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/contextlib.py”, line 155, in exit self.gen.throw(value) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_utils.py”, line 93, in collapse_excgroups raise exc File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 191, in call response = await self.dispatch_func(request, call_next) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py”, line 96, in check_http_version_middleware return await call_next(request) ^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 165, in call_next raise app_exc File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/base.py”, line 151, in coro await self.app(scope, receive_or_disconnect, send_no_error) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/middleware/exceptions.py”, line 62, in call await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py”, line 64, in wrapped_app raise exc File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py”, line 53, in wrapped_app await app(scope, receive, sender) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py”, line 758, in call await self.middleware_stack(scope, receive, send) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py”, line 778, in app await route.handle(scope, receive, send) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py”, line 299, in handle await self.app(scope, receive, send) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py”, line 79, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py”, line 64, in wrapped_app raise exc File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/_exception_handler.py”, line 53, in wrapped_app await app(scope, receive, sender) File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/routing.py”, line 74, in app response = await func(request) ^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py”, line 278, in app raw_response = await run_endpoint_function( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/fastapi/routing.py”, line 193, in run_endpoint_function return await run_in_threadpool(dependant.call, **values) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/starlette/concurrency.py”, line 42, in run_in_threadpool return await anyio.to_thread.run_sync(func, *args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/to_thread.py”, line 56, in run_sync return await get_async_backend().run_sync_in_worker_thread( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/_asyncio.py”, line 2144, in run_sync_in_worker_thread return await future ^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/anyio/_backends/_asyncio.py”, line 851, in run result = context.run(func, *args) ^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/init.py”, line 127, in wrapper return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/auth/fastapi.py”, line 242, in wrapped return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/server/fastapi/init.py”, line 440, in get_collection return self._api.get_collection( ^^^^^^^^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/telemetry/opentelemetry/init.py”, line 127, in wrapper return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File “/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/site-packages/chromadb/api/segment.py”, line 261, in get_collection raise ValueError(f"Collection {name} does not exist.") ValueError: Collection test does not exist. INFO: [27-02-2024 21:37:48] ::1:54254 - “GET /api/v1/collections/test?tenant=default_tenant&database=default_database HTTP/1.1” 500

Are there known steps to reproduce?

Launch Chroma locally Launch AnythingLLM Set Vector DB to Chroma Try to embed any docs in a workspace in AnythingLLM