ray: Import error for pyarrow when Ray built from source
System information
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu
- Ray installed from (source or binary): source
- Ray version: source
- Python version: 3.5
- Exact command to reproduce:
from ray.pyarrow._parquet import (ParquetReader, FileMetaData)
Describe the problem
Import error on importing parquet from pyarrow. See full error below.
Source code / logs
ImportError: /data/devin/ray/python/ray/pyarrow_files/pyarrow/libparquet.so.1: undefined symbol: _ZNK5arrow6Status8ToStringB5cxx11Ev
About this issue
- Original URL
- State: closed
- Created 6 years ago
- Reactions: 5
- Comments: 16 (6 by maintainers)
I’m seeing this on jupter/all-spark-notebook too
@devin-petersohn I suspect that doesn’t actually use the user’s installed pyarrow, because
import raymodifies the Python path to make Ray’s copy of pyarrow first, seehttps://github.com/ray-project/ray/blob/8aa736572bcdee4b8cb7700860e25e2fc0fdeca9/python/ray/__init__.py#L8-L17
e.g., you can do
pip uninstall pyarrowand that shouldn’t change anything.