dagster: [dagit] Dagit does not run on M1 (Apple Silicon)
Summary
I was going through the Getting Started docs for Dagster and was following along on a newer Macbook using an M1 chip. When I tried to start Dagit, I ran into an error, and I’m not able to figure out a quick workaround.
I think the issue might be with an upstream dependency, but I wanted to report it here first, in case I was mistaken.
Reproduction
- Install Dagster with
pip install dagster. - Create
hello_world.pyas described in the getting started docs. - Install Dagit with
pip install dagit. - Run
dagit -f hello_world.py
Expected behavior
The Dagit command does not output an error, and localhost:3000 hosts an instance of the Dagit UI.
Actual behavior
The Dagit command fails with this error:
Traceback (most recent call last):
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/bin/dagit", line 5, in <module>
from dagit.cli import main
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagit/__init__.py", line 1, in <module>
from dagster.core.utils import check_dagster_package_version
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/__init__.py", line 175, in <module>
from dagster.core.launcher import DefaultRunLauncher
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/launcher/__init__.py", line 1, in <module>
from .base import (
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/launcher/base.py", line 8, in <module>
from dagster.core.workspace.workspace import IWorkspace
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/workspace/__init__.py", line 1, in <module>
from .context import IWorkspaceProcessContext, WorkspaceProcessContext
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/workspace/context.py", line 13, in <module>
from dagster.core.host_representation import (
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/host_representation/__init__.py", line 9, in <module>
from .external import (
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/host_representation/external.py", line 24, in <module>
from .handle import JobHandle, PartitionSetHandle, PipelineHandle, RepositoryHandle
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/host_representation/handle.py", line 4, in <module>
from dagster.core.host_representation.origin import ExternalRepositoryOrigin
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/dagster/core/host_representation/origin.py", line 8, in <module>
import grpc
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/grpc/__init__.py", line 22, in <module>
from grpc import _compression
File "/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/grpc/_compression.py", line 15, in <module>
from grpc._cython import cygrpc
ImportError: dlopen(/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so, 0x0002): tried: '/Users/praneetsahgal/.pyenv/versions/3.10.0/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e')), '/usr/local/lib/cygrpc.cpython-310-darwin.so' (no such file), '/usr/lib/cygrpc.cpython-310-darwin.so' (no such file)
Additional Info about Your Environment
- Device: 2021 16-inch Macbook Pro (running an M1 chip)
- Python version: 3.10.0
- Pip version: 21.3.1
- I was prompted to install Rosetta earlier, so I think I have it installed.
Message from the maintainers:
Impacted by this bug? Give it a 👍. We factor engagement into prioritization.
About this issue
- Original URL
- State: closed
- Created 3 years ago
- Reactions: 26
- Comments: 24 (7 by maintainers)
Using python 3.9.x and installing grpc with conda, solved the problem to me
https://github.com/grpc/grpc/issues/25082#issuecomment-878271247
conda install grpciogrpcio just released a 1.47.5 release today that should install cleanly on M1 macs when installing Dagster - I’m going to close this out as a result but let us know if you are having any similar issues going forward.