poetry: poetry install fails on KeyError even for defined environment variables

I see this issue from time to time on our gitlab ci (kubernetes runner). I works pretty much all the time after a retry (so same environment, same container, same git commit)

That’s strange I got a similar error on gitlab CI (even though I don’t get the same locally, even using the gitlab-runner):

 • Installing multidict (5.0.0)
  Stack trace:
  12  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:202 in _execute_operation
      result = self._do_execute_operation(operation)
  11  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:276 in _do_execute_operation
      result = getattr(self, "_execute_{}".format(method))(operation)
  10  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:411 in _execute_install
      return self._install(operation)
   9  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:437 in _install
      archive = self._download(operation)
   8  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:580 in _download
      return self._download_link(operation, link)
   7  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:589 in _download_link
      archive = self._download_archive(operation, link)
   6  /usr/local/lib/python3.8/site-packages/poetry/installation/executor.py:615 in _download_archive
      response = self._authenticator.request(
   5  /usr/local/lib/python3.8/site-packages/poetry/installation/authenticator.py:66 in request
      settings = session.merge_environment_settings(
   4  /usr/local/lib/python3.8/site-packages/requests/sessions.py:711 in merge_environment_settings
      env_proxies = get_environ_proxies(url, no_proxy=no_proxy)
   3  /usr/local/lib/python3.8/site-packages/requests/utils.py:775 in get_environ_proxies
      return getproxies()
   2  /usr/local/lib/python3.8/urllib/request.py:2502 in getproxies_environment
      for name, value in os.environ.items():
   1  /usr/local/lib/python3.8/_collections_abc.py:744 in __iter__
      yield (key, self._mapping[key])
  KeyError
  'VIRTUAL_ENV'
  at /usr/local/lib/python3.8/os.py:675 in __getitem__
       671│         try:
       672│             value = self._data[self.encodekey(key)]
       673│         except KeyError:
       674│             # raise KeyError with the original key value
    →  675│             raise KeyError(key) from None
       676│         return self.decodevalue(value)
       677│ 
       678│     def __setitem__(self, key, value):
       679│         key = self.encodekey(key)

On the other hand, locally I have the environment variable defined:

❯ echo $VIRTUAL_ENV
/Users/cglacet/.pyenv/versions/3.7.7/envs/env-name

The suggested fix did work for me too:

poetry config experimental.new-installer false

Thanks @kosta-p that seems to help. I ran our CI/CD three times and all runs passed.

For anyone experiencing this issue, try disabling parallel installer before running poetry install:

poetry config experimental.new-installer false

@pepastach actually you can. poetry config experimental.new-installer false helped me to resolve similar issues on my MacOS dev environment and inside docker during Gitlab CI

@abn Managed to reproduce the issue locally (with poetry 1.1.5), it’s a bit hacky though.

First, set a lot of env variables (10k will make your bash session very laggy):

for var in {1..10000}
do
  export v${var}=$var
done

pyproject.toml

[tool.poetry]
name = "poetry-demo"
version = "0.1.0"
description = ""
authors = ["RobinFrcd"]

[tool.poetry.dependencies]
python = "^3.7"
pendulum = "*"
boto3 = "*"
urllib3 = "*"
requests = "*"
certifi = "*"

[tool.poetry.dev-dependencies]
pytest = "^5.2"

[build-system]
requires = ["poetry-core>=1.0.0"]
build-backend = "poetry.core.masonry.api"

poetry install while now fail:

❯ poetry install
Installing dependencies from lock file

Package operations: 18 installs, 0 updates, 0 removals

  • Installing botocore (1.20.38): Failed

  KeyError

  'v8240'

  at ~/.pyenv/versions/3.7.9/lib/python3.7/os.py:681 in __getitem__
       677│         try:
       678│             value = self._data[self.encodekey(key)]
       679│         except KeyError:
       680│             # raise KeyError with the original key value
    →  681│             raise KeyError(key) from None
       682│         return self.decodevalue(value)
       683│ 
       684│     def __setitem__(self, key, value):
       685│         key = self.encodekey(key)

  • Installing importlib-metadata (3.7.3)
  • Installing pyparsing (2.4.7)

Same happening here in GitLab CI. 1.1.3 didn’t fix it.

Same error encountered during Gitlab CI, and disabling parrallel installer as noted above worked. Thanks !

Good news is that I was able to verify that #3253 does indeed fix it. But would definitely like confirmation, can someone please try the above snippet but with the following installation?

python -m pip install -q git+https://github.com/python-poetry/poetry.git@refs/pull/3253/head

Yes, we are impacted as well and your fix does fix our CI in Gitlab… can’t wait for release 1.1.6 to be available!

Thank you @stephsamson !

With “only” 10k env vars it was indeed not consistent at all. Had to increase the numbers to make it fail more often.

So, I installed #3253 and two great news:

• Doesn’t fail any more with about 10 tests
• It seems it’s much faster now (about 3x faster with 30k env vars)

Thank you so much for the fix! 👍

Good news is that I was able to verify that #3253 does indeed fix it. But would definitely like confirmation, can someone please try the above snippet but with the following installation?

python -m pip install -q git+https://github.com/python-poetry/poetry.git@refs/pull/3253/head

Alternatively install via pipx with a suffix.

pipx install --suffix=@3253 'poetry @ git+https://github.com/python-poetry/poetry.git@refs/pull/3253/head'

I’m also seeing spurious errors like this one:

Connection pool is full, discarding connection: pypi.org
  Stack trace:
  13  ~/.poetry/lib/poetry/installation/executor.py:199 in _execute_operation
       197│ 
       198│             try:
     → 199│                 result = self._do_execute_operation(operation)
       200│             except EnvCommandError as e:
       201│                 if e.e.returncode == -2:
  12  ~/.poetry/lib/poetry/installation/executor.py:273 in _do_execute_operation
       271│             return 0
       272│ 
     → 273│         result = getattr(self, "_execute_{}".format(method))(operation)
       274│ 
       275│         if result != 0:
  11  ~/.poetry/lib/poetry/installation/executor.py:408 in _execute_install
       406│ 
       407│     def _execute_install(self, operation):  # type: (Install) -> None
     → 408│         return self._install(operation)
       409│ 
       410│     def _execute_update(self, operation):  # type: (Update) -> None
  10  ~/.poetry/lib/poetry/installation/executor.py:434 in _install
       432│             archive = self._download_link(operation, Link(package.source_url))
       433│         else:
     → 434│             archive = self._download(operation)
       435│ 
       436│         operation_message = self.get_operation_message(operation)
   9  ~/.poetry/lib/poetry/installation/executor.py:575 in _download
       573│ 
       574│     def _download(self, operation):  # type: (Operation) -> Path
     → 575│         link = self._chooser.choose_for(operation.package)
       576│ 
       577│         return self._download_link(operation, link)
   8  ~/.poetry/lib/poetry/installation/chooser.py:60 in choose_for
        58│         """
        59│         links = []
     →  60│         for link in self._get_links(package):
        61│             if link.is_wheel and not Wheel(link.filename).is_supported_by_environment(
        62│                 self._env
   7  ~/.poetry/lib/poetry/installation/chooser.py:94 in _get_links
        92│             repository = self._pool.repository(package.source_reference)
        93│ 
     →  94│         links = repository.find_links_for_package(package)
        95│ 
        96│         hashes = [f["hash"] for f in package.files]
   6  ~/.poetry/lib/poetry/repositories/pypi_repository.py:245 in find_links_for_package
       243│ 
       244│     def find_links_for_package(self, package):
     → 245│         json_data = self._get("pypi/{}/{}/json".format(package.name, package.version))
       246│         if json_data is None:
       247│             return []
   5  ~/.poetry/lib/poetry/repositories/pypi_repository.py:319 in _get
       317│     def _get(self, endpoint):  # type: (str) -> Union[dict, None]
       318│         try:
     → 319│             json_response = self.session.get(self._base_url + endpoint)
       320│         except requests.exceptions.TooManyRedirects:
       321│             # Cache control redirect loop.
   4  ~/.poetry/lib/poetry/_vendor/py3.7/requests/sessions.py:543 in get
       541│ 
       542│         kwargs.setdefault('allow_redirects', True)
     → 543│         return self.request('GET', url, **kwargs)
       544│ 
       545│     def options(self, url, **kwargs):
   3  ~/.poetry/lib/poetry/_vendor/py3.7/requests/sessions.py:530 in request
       528│         }
       529│         send_kwargs.update(settings)
     → 530│         resp = self.send(prep, **send_kwargs)
       531│ 
       532│         return resp
   2  ~/.poetry/lib/poetry/_vendor/py3.7/requests/sessions.py:643 in send
       641│ 
       642│         # Send the request
     → 643│         r = adapter.send(request, **kwargs)
       644│ 
       645│         # Total elapsed time of the request (approximately)
   1  ~/.poetry/lib/poetry/_vendor/py3.7/cachecontrol/adapter.py:53 in send
        51│             request.headers.update(self.controller.conditional_headers(request))
        52│ 
     →  53│         resp = super(CacheControlAdapter, self).send(request, **kw)
        54│ 
        55│         return resp
  ConnectionError
  ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
  at ~/.poetry/lib/poetry/_vendor/py3.7/requests/adapters.py:498 in send
      494│                     low_conn.close()
      495│                     raise
      496│ 
      497│         except (ProtocolError, socket.error) as err:
    → 498│             raise ConnectionError(err, request=request)
      499│ 
      500│         except MaxRetryError as e:
      501│             if isinstance(e.reason, ConnectTimeoutError):
      502│                 # TODO: Remove this in 3.0.0: see #2811

which causes poetry install to exit with code 1. It might be caused by parallel install. @pepastach, have you tried disabling parallel installs?