cloudmapper: Cloudmapper fails to install on macos
Hello, whatever the solution I came up with to setup cloudmapper, it fails at the pyjq installβ¦
pip3 install --user pipenv
cd cloudmapper/; pipenv install --skip-lock
is it related to the below issue ?
https://github.com/doloopwhile/pyjq/issues/54 https://bugs.python.org/issue42504
Please find hereunder my logs:
Installing dependencies from Pipfileβ¦ An error occurred while installing pyjq==2.3.1! Will try again. An error occurred while installing seaborn==0.10.1! Will try again. π ββββββββββββββββββββββββββββββββ 37/37 β 00:00:44 Installing initially failed dependenciesβ¦ [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/cli/command.pyβ, line 233, in install [InstallError]: retcode = do_install( [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/core.pyβ, line 2052, in do_install [InstallError]: do_init( [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/core.pyβ, line 1304, in do_init [InstallError]: do_install_dependencies( [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/core.pyβ, line 899, in do_install_dependencies [InstallError]: batch_install( [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/core.pyβ, line 796, in batch_install [InstallError]: _cleanup_procs(procs, failed_deps_queue, retry=retry) [InstallError]: File β/usr/local/Cellar/pipenv/2020.11.15/libexec/lib/python3.9/site-packages/pipenv/core.pyβ, line 703, in _cleanup_procs [InstallError]: raise exceptions.InstallError(c.dep.name, extra=err_lines) [pipenv.exceptions.InstallError]: Collecting pyjq==2.3.1 [pipenv.exceptions.InstallError]: Using cached pyjq-2.3.1.tar.gz (2.1 MB) [pipenv.exceptions.InstallError]: Requirement already satisfied: six in /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/lib/python3.8/site-packages (from pyjq==2.3.1->-r /var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pipenv-8bez_ooa-requirements/pipenv-r8czubvu-requirement.txt (line 1)) (1.14.0) [pipenv.exceptions.InstallError]: Building wheels for collected packages: pyjq [pipenv.exceptions.InstallError]: Building wheel for pyjq (setup.py): started [pipenv.exceptions.InstallError]: Building wheel for pyjq (setup.py): finished with status βerrorβ [pipenv.exceptions.InstallError]: ERROR: Command errored out with exit status 1: [pipenv.exceptions.InstallError]: command: /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/bin/python -u -c βimport sys, setuptools, tokenize; sys.argv[0] = β"β"β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ; file=ββ'ββ/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ;f=getattr(tokenize, β"βββopenβββββ, open)(file);code=f.read().replace(βββ"β\r\nββ'ββ, β"β"β\nββ'ββ);f.close();exec(compile(code, file, β"βββexecβββββ))β bdist_wheel -d /private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-wheel-dbvkaevy [pipenv.exceptions.InstallError]: cwd: /private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/ [pipenv.exceptions.InstallError]: Complete output (44 lines): [pipenv.exceptions.InstallError]: running bdist_wheel [pipenv.exceptions.InstallError]: running build [pipenv.exceptions.InstallError]: running build_py [pipenv.exceptions.InstallError]: creating build [pipenv.exceptions.InstallError]: creating build/lib.macosx-11-x86_64-3.8 [pipenv.exceptions.InstallError]: copying pyjq.py -> build/lib.macosx-11-x86_64-3.8 [pipenv.exceptions.InstallError]: warning: build_py: byte-compiling is disabled, skipping. [pipenv.exceptions.InstallError]: [pipenv.exceptions.InstallError]: running build_ext [pipenv.exceptions.InstallError]: Traceback (most recent call last): [pipenv.exceptions.InstallError]: File β<string>β, line 1, in <module> [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 93, in <module> [pipenv.exceptions.InstallError]: setup( [pipenv.exceptions.InstallError]: File β/Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/lib/python3.8/site-packages/setuptools/init.pyβ, line 153, in setup [pipenv.exceptions.InstallError]: return distutils.core.setup(**attrs) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/core.pyβ, line 148, in setup [pipenv.exceptions.InstallError]: dist.run_commands() [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 966, in run_commands [pipenv.exceptions.InstallError]: self.run_command(cmd) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/lib/python3.8/site-packages/wheel/bdist_wheel.pyβ, line 299, in run [pipenv.exceptions.InstallError]: self.run_command(βbuildβ) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/cmd.pyβ, line 313, in run_command [pipenv.exceptions.InstallError]: self.distribution.run_command(command) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/command/build.pyβ, line 135, in run [pipenv.exceptions.InstallError]: self.run_command(cmd_name) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/cmd.pyβ, line 313, in run_command [pipenv.exceptions.InstallError]: self.distribution.run_command(command) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 30, in run [pipenv.exceptions.InstallError]: self._build_oniguruma() [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 39, in _build_oniguruma [pipenv.exceptions.InstallError]: self._build_lib( [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 67, in _build_lib [pipenv.exceptions.InstallError]: os.environ[βMACOSX_DEPLOYMENT_TARGETβ] = macosx_deployment_target [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/bin/β¦/Frameworks/Python.framework/Versions/3.8/lib/python3.8/os.pyβ, line 680, in setitem [pipenv.exceptions.InstallError]: value = self.encodevalue(value) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/bin/β¦/Frameworks/Python.framework/Versions/3.8/lib/python3.8/os.pyβ, line 750, in encode [pipenv.exceptions.InstallError]: raise TypeError(βstr expected, not %sβ % type(value).name) [pipenv.exceptions.InstallError]: TypeError: str expected, not int [pipenv.exceptions.InstallError]: ---------------------------------------- [pipenv.exceptions.InstallError]: ERROR: Failed building wheel for pyjq [pipenv.exceptions.InstallError]: Running setup.py clean for pyjq [pipenv.exceptions.InstallError]: Failed to build pyjq [pipenv.exceptions.InstallError]: Installing collected packages: pyjq [pipenv.exceptions.InstallError]: Running setup.py install for pyjq: started [pipenv.exceptions.InstallError]: Running setup.py install for pyjq: finished with status βerrorβ [pipenv.exceptions.InstallError]: ERROR: Command errored out with exit status 1: [pipenv.exceptions.InstallError]: command: /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = 'ββ"β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ; file=ββ'ββ/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ;f=getattr(tokenize, β"βββopenβββββ, open)(file);code=f.read().replace(βββ"β\r\nββ'ββ, β"β"β\nββ'ββ);f.close();exec(compile(code, file, β"βββexecβββββ))β install --record /private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-record-1eezjp50/install-record.txt --single-version-externally-managed --compile --install-headers /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/include/site/python3.8/pyjq [pipenv.exceptions.InstallError]: cwd: /private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/ [pipenv.exceptions.InstallError]: Complete output (46 lines): [pipenv.exceptions.InstallError]: running install [pipenv.exceptions.InstallError]: running build [pipenv.exceptions.InstallError]: running build_py [pipenv.exceptions.InstallError]: creating build [pipenv.exceptions.InstallError]: creating build/lib.macosx-11-x86_64-3.8 [pipenv.exceptions.InstallError]: copying pyjq.py -> build/lib.macosx-11-x86_64-3.8 [pipenv.exceptions.InstallError]: warning: build_py: byte-compiling is disabled, skipping. [pipenv.exceptions.InstallError]: [pipenv.exceptions.InstallError]: running build_ext [pipenv.exceptions.InstallError]: Traceback (most recent call last): [pipenv.exceptions.InstallError]: File β<string>β, line 1, in <module> [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 93, in <module> [pipenv.exceptions.InstallError]: setup( [pipenv.exceptions.InstallError]: File β/Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/lib/python3.8/site-packages/setuptools/init.pyβ, line 153, in setup [pipenv.exceptions.InstallError]: return distutils.core.setup(**attrs) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/core.pyβ, line 148, in setup [pipenv.exceptions.InstallError]: dist.run_commands() [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 966, in run_commands [pipenv.exceptions.InstallError]: self.run_command(cmd) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/lib/python3.8/site-packages/setuptools/command/install.pyβ, line 61, in run [pipenv.exceptions.InstallError]: return orig.install.run(self) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/command/install.pyβ, line 545, in run [pipenv.exceptions.InstallError]: self.run_command(βbuildβ) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/cmd.pyβ, line 313, in run_command [pipenv.exceptions.InstallError]: self.distribution.run_command(command) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/command/build.pyβ, line 135, in run [pipenv.exceptions.InstallError]: self.run_command(cmd_name) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/cmd.pyβ, line 313, in run_command [pipenv.exceptions.InstallError]: self.distribution.run_command(command) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/distutils/dist.pyβ, line 985, in run_command [pipenv.exceptions.InstallError]: cmd_obj.run() [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 30, in run [pipenv.exceptions.InstallError]: self._build_oniguruma() [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 39, in _build_oniguruma [pipenv.exceptions.InstallError]: self._build_lib( [pipenv.exceptions.InstallError]: File β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyβ, line 67, in _build_lib [pipenv.exceptions.InstallError]: os.environ[βMACOSX_DEPLOYMENT_TARGETβ] = macosx_deployment_target [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/bin/β¦/Frameworks/Python.framework/Versions/3.8/lib/python3.8/os.pyβ, line 680, in setitem [pipenv.exceptions.InstallError]: value = self.encodevalue(value) [pipenv.exceptions.InstallError]: File β/usr/local/opt/python@3.8/bin/β¦/Frameworks/Python.framework/Versions/3.8/lib/python3.8/os.pyβ, line 750, in encode [pipenv.exceptions.InstallError]: raise TypeError(βstr expected, not %sβ % type(value).name) [pipenv.exceptions.InstallError]: TypeError: str expected, not int [pipenv.exceptions.InstallError]: ---------------------------------------- [pipenv.exceptions.InstallError]: ERROR: Command errored out with exit status 1: /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = 'ββ"β/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ; file=ββ'ββ/private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-install-7m4e96ks/pyjq_abce72f03b2c422d9a98ef71102e0034/setup.pyββ'ββ;f=getattr(tokenize, β"βββopenβββββ, open)(file);code=f.read().replace(βββ"β\r\nββ'ββ, β"β"β\nββ'ββ);f.close();exec(compile(code, file, β"βββexecβββ"β))β install --record /private/var/folders/26/pmmcdlhx727ffbxy2ld7m86h0000gn/T/pip-record-1eezjp50/install-record.txt --single-version-externally-managed --compile --install-headers /Users/hiyaa/.local/share/virtualenvs/cloudmapper-WzNltrOW/include/site/python3.8/pyjq Check the logs for full command output. ERROR: Couldnβt install package: pyjq Package installation failedβ¦ β€ ββββββββββββββββββββββββββββββββ 1/2 β
Many thanks !
About this issue
- Original URL
- State: open
- Created 3 years ago
- Reactions: 1
- Comments: 18 (8 by maintainers)
Youβre not wrong @w0rmr1d3r, I did manually implement #876 (which I see you reviewed a couple of weeks before I opened my issue), although it was running
sudo apt install autoconf libtoolfrom doloopwhile/pyjq#50 which finally fixed the issue for me.Ideally I would reset my environment to test how much of an impact manually implementing #876 has before installed the additional apt packages.
That happens to you the same way it happened to other people, because
urllib3got updated and it conflicted withbotocoreversions and other dependencies. Exists this PR which fixes the issue that you have encountered -> https://github.com/duo-labs/cloudmapper/pull/876 Which, at the same time, it fixes this issue -> https://github.com/duo-labs/cloudmapper/issues/875Thatβs why I was saying that there are issues and PRs opened regarding dependencies and problems installing them.
issues fixed by updating typed-ast==1.5.5 and pyjq==2.6.0
@w0rmr1d3r correct, my file looks like this:
astroid autoflake autopep8 boto3 botocore certifi chardet coverage docutils idna isort Jinja2 jmespath lazy-object-proxy MarkupSafe matplotlib mccabe mock netaddr nose pandas parliament policyuniverse pycodestyle pyflakes pyjq pylint python-dateutil PyYAML requests s3transfer seaborn six toml typed-ast urllib3 wraptI have to say, I had another dependency issue, different packages, but perhaps this works for you too.
I had the same issue on mac os, removing the version numbers from the file fixed it for me, pip sorted out everything.
@w0rmr1d3r Many thank, but finally went to the docker version, which works fine. Weβll try to install it on my MacOs next time i need it !
@serialp the python issue has been resolved! It should work now, have you tried it again?
Is this on macOS Big Sur? Could be this Python issue: https://bugs.python.org/issue42504
I installed CloudMapper without issues on an Ubuntu system last week.