arrow: [R] Error: package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath = DLLpath, ...):

Describe the bug, including details regarding any error messages, version, and platform.

Hi there - I am trying to install the R package arrow on my Mac OS M1.

I have tried to re-install the apache-arrow library with home brew and multiple other solution I read from different github and stackoverflow issue but it still does not solve the issue.

Could you help me out there?

Here is the log below:

install.packages("arrow")
Installing package into ‘/opt/homebrew/lib/R/4.3/site-library’
(as ‘lib’ is unspecified)
trying URL 'https://cloud.r-project.org/src/contrib/arrow_14.0.0.2.tar.gz'
Content type 'application/x-gzip' length 4263864 bytes (4.1 MB)
==================================================
downloaded 4.1 MB

* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
*** pkg-config found.
*** Trying Arrow C++ found by pkg-config: /opt/homebrew/Cellar/apache-arrow/14.0.1_2
**** Not using: C++ library version (14.0.1) does not match R package (14.0.0.2)
*** Found libcurl and OpenSSL >= 3.0.0
trying URL 'https://apache.jfrog.io/artifactory/arrow/r/14.0.0/libarrow/bin/darwin-arm64-openssl-3.0/arrow-14.0.0.zip'
Content type 'application/zip' length 22764076 bytes (21.7 MB)
==================================================
downloaded 21.7 MB

*** Successfully retrieved libarrow (darwin-arm64-openssl-3.0)
*** Checksum validated successfully for libarrow: darwin-arm64-openssl-3.0/arrow-14.0.0.zip
PKG_CFLAGS=-DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS
PKG_LIBS=-L/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/lib -L/opt/homebrew/opt/openssl@3/lib -larrow_dataset -lparquet -larrow_acero -larrow -larrow_bundled_dependencies -lcurl -lssl -lcrypto
** libs
using C++ compiler: ‘Apple clang version 15.0.0 (clang-1500.0.40.1)’
using C++17
using SDK: ‘MacOSX14.0.sdk’
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c RTasks.cpp -o RTasks.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c altrep.cpp -o altrep.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c array.cpp -o array.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c array_to_vector.cpp -o array_to_vector.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c arraydata.cpp -o arraydata.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c arrowExports.cpp -o arrowExports.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c bridge.cpp -o bridge.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c buffer.cpp -o buffer.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c chunkedarray.cpp -o chunkedarray.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c compression.cpp -o compression.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c compute-exec.cpp -o compute-exec.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c compute.cpp -o compute.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c config.cpp -o config.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c csv.cpp -o csv.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c dataset.cpp -o dataset.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c datatype.cpp -o datatype.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c expression.cpp -o expression.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c extension-impl.cpp -o extension-impl.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c feather.cpp -o feather.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c field.cpp -o field.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c filesystem.cpp -o filesystem.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c io.cpp -o io.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c json.cpp -o json.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c memorypool.cpp -o memorypool.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c message.cpp -o message.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c parquet.cpp -o parquet.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c r_to_arrow.cpp -o r_to_arrow.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c recordbatch.cpp -o recordbatch.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c recordbatchreader.cpp -o recordbatchreader.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c recordbatchwriter.cpp -o recordbatchwriter.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c safe-call-into-r-impl.cpp -o safe-call-into-r-impl.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c scalar.cpp -o scalar.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c schema.cpp -o schema.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c symbols.cpp -o symbols.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c table.cpp -o table.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c threadpool.cpp -o threadpool.o
clang++ -std=gnu++17 -I"/opt/homebrew/Cellar/r/4.3.2/lib/R/include" -DNDEBUG -DPARQUET_STATIC -DARROW_STATIC -I/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/include -I/opt/homebrew/opt/openssl@3/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'/opt/homebrew/lib/R/4.3/site-library/cpp11/include' -I/opt/homebrew/opt/gettext/include -I/opt/homebrew/opt/readline/include -I/opt/homebrew/opt/xz/include -I/opt/homebrew/include    -fPIC  -g -O2  -c type_infer.cpp -o type_infer.o
clang++ -std=gnu++17 -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup -L/opt/homebrew/Cellar/r/4.3.2/lib/R/lib -L/opt/homebrew/opt/gettext/lib -L/opt/homebrew/opt/readline/lib -L/opt/homebrew/opt/xz/lib -L/opt/homebrew/lib -o arrow.so RTasks.o altrep.o array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o expression.o extension-impl.o feather.o field.o filesystem.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o scalar.o schema.o symbols.o table.o threadpool.o type_infer.o -L/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpVoPXG1/R.INSTALL5d16635befe4/arrow/libarrow/arrow-14.0.0/lib -L/opt/homebrew/opt/openssl@3/lib -larrow_dataset -lparquet -larrow_acero -larrow -larrow_bundled_dependencies -lcurl -lssl -lcrypto -L/opt/homebrew/Cellar/r/4.3.2/lib/R/lib -lR -lintl -Wl,-framework -Wl,CoreFoundation
installing to /opt/homebrew/lib/R/4.3/site-library/00LOCK-arrow/00new/arrow/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded from temporary location
Error: package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath = DLLpath, ...):
 unable to load shared object '/opt/homebrew/lib/R/4.3/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so':
  dlopen(/opt/homebrew/lib/R/4.3/site-library/00LOCK-arrow/00new/arrow/libs/arrow.so, 0x0006): symbol not found in flat namespace '__ZN5arrow2fs10GcsOptions15FromAccessTokenERKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEENS2_6chrono10time_pointINSB_12system_clockENSB_8durationIxNS2_5ratioILl1ELl1000000000EEEEEEE'
Error: loading failed
Execution halted
ERROR: loading failed
* removing ‘/opt/homebrew/lib/R/4.3/site-library/arrow’

The downloaded source packages are in
	‘/private/var/folders/q2/rt91d_wn5x3bhkfft38g2xww0000gn/T/RtmpQcK0se/downloaded_packages’
Warning message:
In install.packages("arrow") :
  installation of package ‘arrow’ had non-zero exit status

Component(s)

R

About this issue

  • Original URL
  • State: closed
  • Created 7 months ago
  • Reactions: 1
  • Comments: 21 (9 by maintainers)

Most upvoted comments

Just as a side note, while Homebrew’s R formula has the issues mentioned above, the Cask version works great (it’s just the CRAN .pkg installer), so saying homebrew’s R isn’t recommended isn’t quite right since Homebrew is great at managing the CRAN version of R.

So while this gives you a problematic version of R:

brew install r

This gives you the CRAN version of R:

brew install --cask r

And comes with the benefit that Homebrew will automatically upgrade it for you when you run brew upgrade.

+3
amoeba on Feb 3, 2024

I was working with renv and had the package source set to the Posit Package Manager. Testing different sources, this is what I see:

  • from CRAN, the 14.0.0.2 binary loads (but versions later than 13.0.0.1 do not build when type = "source", as with remotes::install_version)
  • from PPM, the 14.0.0.2 binary does not load (and versions later than 13.0.0.1 do not build when type = "source")
CRAN <- "https://cloud.r-project.org/"
PPM <- "https://packagemanager.posit.co/cran/latest"

# fails ----- 
install.packages("arrow", repos = PPM)
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> 
#> The downloaded binary packages are in
#>  /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpyLusWt/downloaded_packages
callr::r(\(x) library("arrow"))
#> Error: ! in callr subprocess.
#> Caused by error: 
#> ! package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath = DLLpath, ...):
#>  unable to load shared object '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20/arrow/libs/arrow.so':
#>   dlopen(/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20/arrow/libs/arrow.so, 0x0006): symbol not found in flat namespace '__ZN5arrow12ArrayBuilder12AppendScalarERKNS_6ScalarEx'

# fails -----
remotes::install_version("arrow", "14.0.0.2", repos = PPM)
#> Downloading package from url: https://packagemanager.posit.co/cran/latest/src/contrib/arrow_14.0.0.2.tar.gz
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> Warning in i.p(...): installation of package
#> '/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpyLusWt/remotes1cf77b6510ae/arrow'
#> had non-zero exit status
remotes::install_version("arrow", "14.0.0.2", repos = CRAN)
#> Downloading package from url: https://cloud.r-project.org/src/contrib/arrow_14.0.0.2.tar.gz
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> Warning in i.p(...): installation of package
#> '/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpyLusWt/remotes1cf7134a78d1/arrow'
#> had non-zero exit status

# succeeds -----
install.packages("arrow", repos = CRAN)
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> 
#> The downloaded binary packages are in
#>  /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpyLusWt/downloaded_packages
callr::r(\(x) library("arrow"))
#> [1] "arrow"     "stats"     "graphics"  "grDevices" "datasets"  "utils"    
#> [7] "methods"   "base"

remotes::install_version("arrow", "13.0.0.1", repos = PPM)
#> Downloading package from url: https://packagemanager.posit.co/cran/latest/src/contrib/Archive/arrow/arrow_13.0.0.1.tar.gz
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.3/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)

Created on 2023-12-13 with reprex v2.0.2

Session info 
sessionInfo()
#> R version 4.3.2 (2023-10-31)
#> Platform: aarch64-apple-darwin20 (64-bit)
#> Running under: macOS Sonoma 14.1.1
#> 
#> Matrix products: default
#> BLAS:   /Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/lib/libRblas.0.dylib 
#> LAPACK: /Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/lib/libRlapack.dylib;  LAPACK version 3.11.0
#> 
#> locale:
#> [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
#> 
#> time zone: America/New_York
#> tzcode source: internal
#> 
#> attached base packages:
#> [1] stats     graphics  grDevices datasets  utils     methods   base     
#> 
#> loaded via a namespace (and not attached):
#>  [1] vctrs_0.6.5       cli_3.6.2         knitr_1.45        rlang_1.1.2      
#>  [5] xfun_0.41         processx_3.8.3    purrr_1.0.2       styler_1.10.2    
#>  [9] renv_1.0.3        glue_1.6.2        htmltools_0.5.7   ps_1.7.5         
#> [13] rmarkdown_2.25    R.cache_0.16.0    evaluate_0.23     fastmap_1.1.1    
#> [17] yaml_2.3.8        lifecycle_1.0.4   compiler_4.3.2    fs_1.6.3         
#> [21] rstudioapi_0.15.0 R.oo_1.25.0       R.utils_2.12.3    digest_0.6.33    
#> [25] R6_2.5.1          reprex_2.0.2      callr_3.7.3       magrittr_2.0.3   
#> [29] R.methodsS3_1.8.2 tools_4.3.2       withr_2.5.2       remotes_2.4.2.1
+3
psadil on Dec 13, 2023

@sj-io Thanks for confirming that.

We’ve also now rebuilt arrow with the fix for 14.0.0 and 14.0.0.1, so installing these older versions should work as well.

+2
glin on Jan 31, 2024

@glin I believe it’s working. I removed the package and uninstalled/reinstalled a couple different ways (including using repos = "https://packagemanager.posit.co/cran/latest", a regular install with no conditions, and installing inside and outside of an renv package) and didn’t run into any issues when I tried to render pages that use arrow.

> packageDescription("arrow")
Package: arrow
Title: Integration to 'Apache' 'Arrow'
Version: 14.0.0.2
Authors@R: c( person("Neal", "Richardson", email =
       "neal.p.richardson@gmail.com", role = c("aut")),
       person("Ian", "Cook", email = "ianmcook@gmail.com",
       role = c("aut")), person("Nic", "Crane", email =
       "thisisnic@gmail.com", role = c("aut", "cre")),
       person("Dewey", "Dunnington", role = c("aut"), email =
       "dewey@fishandwhistle.net", comment = c(ORCID =
       "0000-0002-9415-4582")), person("Romain",
       "Fran\u00e7ois", role = c("aut"), comment = c(ORCID =
       "0000-0002-2444-4226")), person("Jonathan", "Keane",
       email = "jkeane@gmail.com", role = c("aut")),
       person("Drago\u0219", "Moldovan-Gr\u00fcnfeld", email =
       "dragos.mold@gmail.com", role = c("aut")),
       person("Jeroen", "Ooms", email = "jeroen@berkeley.edu",
       role = c("aut")), person("Jacob", "Wujciak-Jens", email
       = "jacob@wujciak.de", role = c("aut")),
       person("Javier", "Luraschi", email =
       "javier@rstudio.com", role = c("ctb")), person("Karl",
       "Dunkle Werner", email =
       "karldw@users.noreply.github.com", role = c("ctb"),
       comment = c(ORCID = "0000-0003-0523-7309")),
       person("Jeffrey", "Wong", email =
       "jeffreyw@netflix.com", role = c("ctb")),
       person("Apache Arrow", email = "dev@arrow.apache.org",
       role = c("aut", "cph")) )
Description: 'Apache' 'Arrow' <https://arrow.apache.org/> is a
       cross-language development platform for in-memory data.
       It specifies a standardized language-independent
       columnar memory format for flat and hierarchical data,
       organized for efficient analytic operations on modern
       hardware. This package provides an interface to the
       'Arrow C++' library.
Depends: R (>= 3.4)
License: Apache License (>= 2.0)
URL: https://github.com/apache/arrow/,
       https://arrow.apache.org/docs/r/
BugReports: https://github.com/apache/arrow/issues
Encoding: UTF-8
Language: en-US
SystemRequirements: C++17; for AWS S3 support on Linux,
       libcurl and openssl (optional)
Biarch: true
Imports: assertthat, bit64 (>= 0.9-7), glue, methods, purrr,
       R6, rlang (>= 1.0.0), stats, tidyselect (>= 1.0.0),
       utils, vctrs
RoxygenNote: 7.2.3
Config/testthat/edition: 3
Suggests: blob, curl, cli, DBI, dbplyr, decor, distro, dplyr,
       duckdb (>= 0.2.8), hms, jsonlite, knitr, lubridate,
       pillar, pkgload, reticulate, rmarkdown, stringi,
       stringr, sys, testthat (>= 3.1.0), tibble, tzdb, withr
LinkingTo: cpp11 (>= 0.4.2)
Collate: 'arrowExports.R' 'enums.R' 'arrow-object.R' 'type.R'
       .....
NeedsCompilation: yes
Packaged: 2023-12-01 18:37:34 UTC; jwj
Author: Neal Richardson [aut], Ian Cook [aut], Nic Crane [aut,
       cre], Dewey Dunnington [aut]
       (<https://orcid.org/0000-0002-9415-4582>), Romain
       François [aut]
       (<https://orcid.org/0000-0002-2444-4226>), Jonathan
       Keane [aut], Dragoș Moldovan-Grünfeld [aut], Jeroen
       Ooms [aut], Jacob Wujciak-Jens [aut], Javier Luraschi
       [ctb], Karl Dunkle Werner [ctb]
       (<https://orcid.org/0000-0003-0523-7309>), Jeffrey Wong
       [ctb], Apache Arrow [aut, cph]
Maintainer: Nic Crane <thisisnic@gmail.com>
Repository: RSPM
Date/Publication: 2023-12-02 01:30:03 UTC
Built: R 4.3.0; x86_64-pc-linux-gnu; 2024-01-03 00:08:18 UTC;
       unix

When I load it outside of a project with renv it lists “Repository: CRAN”.

+2
sj-io on Jan 31, 2024

We believe we’ve now fixed this for arrow 14.0.0.2 in Package Manager. Older arrow versions with the issue haven’t been rebuilt yet, but we’ll get those fixed soon as well.

@sj-io If you’re able to reinstall that arrow binary from Package Manager, could you provide the output of running packageDescription("arrow") in R?

+2
glin on Jan 31, 2024

FWIW, I’m encountering the same with versions newer than 13.0.0.1

14.0.0.2 (fails)

install.packages('arrow'); library('arrow')
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> 
#> The downloaded binary packages are in
#>  /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//Rtmp9NnRRv/downloaded_packages
#> Error: package or namespace load failed for 'arrow' in dyn.load(file, DLLpath = DLLpath, ...):
#>  unable to load shared object '/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20/arrow/libs/arrow.so':
#>   dlopen(/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20/arrow/libs/arrow.so, 0x0006): symbol not found in flat namespace '__ZN5arrow12ArrayBuilder12AppendScalarERKNS_6ScalarEx'

Created on 2023-12-12 with reprex v2.0.2

14.0.0.1 (fails)

remotes::install_version("arrow", "14.0.0.1")
#> Downloading package from url: https://packagemanager.posit.co/cran/latest/src/contrib/Archive/arrow/arrow_14.0.0.1.tar.gz
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)
#> Warning in i.p(...): installation of package
#> '/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpFv7S6a/remotes13556236975bd/arrow'
#> had non-zero exit status
Longer Install Log 
> remotes::install_version('arrow', "14.0.0.1")
Downloading package from url: https://packagemanager.posit.co/cran/latest/src/contrib/Archive/arrow/arrow_14.0.0.1.tar.gz
Installing package into ‘/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20’
(as ‘lib’ is unspecified)
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
*** OpenSSL not found
*** Unable to find libcurl and openssl
*** Found local C++ source: 'tools/cpp'
*** Building libarrow from source
    For build options and troubleshooting, see the install guide:
    https://arrow.apache.org/docs/r/articles/install.html
**** cmake
**** pkg-config not installed, setting ARROW_DEPENDENCY_SOURCE=BUNDLED
****  S3/GCS  support  requires libcurl-devel (rpm) or libcurl4-openssl-dev (deb) ; building with  ARROW_S3=OFF and ARROW_GCS=OFF 
**** arrow 
**** Error building Arrow C++.
**** Printing contents of build log because the build failed while ARROW_R_DEV was set to FALSE
++ pwd
+ : /private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow
+ : tools/cpp
+ : /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4f47f4aa
+ : libarrow/arrow-14.0.0
+ : /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4449acdf6/cmake-3.26.4-macos-universal/bin/cmake
++ cd tools/cpp
++ pwd
+ SOURCE_DIR=/private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow/tools/cpp
++ mkdir -p libarrow/arrow-14.0.0
++ cd libarrow/arrow-14.0.0
++ pwd
+ DEST_DIR=/private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow/libarrow/arrow-14.0.0
+ '[' 2 = '' ']'
+ '[' false '!=' '' ']'
++ echo false
++ tr '[:upper:]' '[:lower:]'
+ LIBARROW_MINIMAL=false
+ '[' false = false ']'
+ ARROW_DEFAULT_PARAM=ON
+ case "$CXX" in
+ mkdir -p /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4f47f4aa
+ pushd /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4f47f4aa
/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpjgVixX/file138d4f47f4aa /private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow
+ /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4449acdf6/cmake-3.26.4-macos-universal/bin/cmake -DARROW_BOOST_USE_SHARED=OFF -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_SHARED=OFF -DARROW_BUILD_STATIC=ON -DARROW_ACERO=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=BUNDLED -DAWSSDK_SOURCE= -DARROW_FILESYSTEM=ON -DARROW_GCS=OFF -DARROW_JEMALLOC=ON -DARROW_MIMALLOC=ON -DARROW_JSON=ON -DARROW_PARQUET=ON -DARROW_S3=OFF -DARROW_WITH_BROTLI=ON -DARROW_WITH_BZ2=ON -DARROW_WITH_LZ4=ON -DARROW_WITH_RE2=ON -DARROW_WITH_SNAPPY=ON -DARROW_WITH_UTF8PROC=ON -DARROW_WITH_ZLIB=ON -DARROW_WITH_ZSTD=ON -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF -DCMAKE_BUILD_TYPE=Release -DCMAKE_FIND_DEBUG_MODE=OFF -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow/libarrow/arrow-14.0.0 -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_UNITY_BUILD=OFF -Dxsimd_SOURCE= -Dzstd_SOURCE= -G 'Unix Makefiles' /private/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T/RtmpaBXKm8/remotes1351f3d741409/arrow/tools/cpp
inst/build_arrow_static.sh: line 67: /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4449acdf6/cmake-3.26.4-macos-universal/bin/cmake: No such file or directory
**** Complete build log may still be present at /var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpjgVixX/file138d4584a69f5.log 
Warning messages:
1: In rep(yes, length.out = len) : 'x' is NULL so the result will be NULL
2: In system(cmake_cmd, ignore.stdout = TRUE, ignore.stderr = TRUE) :
  error in running command
------------------------- NOTE ---------------------------
There was an issue preparing the Arrow C++ libraries.
See https://arrow.apache.org/docs/r/articles/install.html
----------------------------------------------------------

Test compile error: <stdin>:1:10: fatal error: 'arrow/api.h' file not found
#include <arrow/api.h>
         ^~~~~~~~~~~~~
1 error generated.
Failing compile command: clang++ -arch arm64 -E -I/opt/R/arm64/include  -falign-functions=64 -Wall -g -O2 -std=gnu++17 -xc++ -
PKG_CFLAGS=
PKG_LIBS=
ERROR: configuration failed for package ‘arrow’
* removing ‘/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20/arrow’
* restoring previous ‘/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20/arrow’
Warning message:
In i.p(...) :
  installation of package ‘/var/folders/v_/kcpb096s1m3_37ctfd2sp2xm0000gn/T//RtmpaBXKm8/remotes1351f3d741409/arrow’ had non-zero exit status

Created on 2023-12-12 with reprex v2.0.2

13.0.0.1 (works)

remotes::install_version('arrow', "13.0.0.1")
#> Downloading package from url: https://packagemanager.posit.co/cran/latest/src/contrib/Archive/arrow/arrow_13.0.0.1.tar.gz
#> Installing package into '/Users/psadil/git/arrow/renv/library/R-4.2/aarch64-apple-darwin20'
#> (as 'lib' is unspecified)

Created on 2023-12-12 with reprex v2.0.2

Session info 
sessionInfo()
#> R version 4.2.3 (2023-03-15)
#> Platform: aarch64-apple-darwin20 (64-bit)
#> Running under: macOS 14.1.1
#> 
#> Matrix products: default
#> BLAS:   /Library/Frameworks/R.framework/Versions/4.2-arm64/Resources/lib/libRblas.0.dylib
#> LAPACK: /Library/Frameworks/R.framework/Versions/4.2-arm64/Resources/lib/libRlapack.dylib
#> 
#> locale:
#> [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
#> 
#> attached base packages:
#> [1] stats     graphics  grDevices utils     datasets  methods   base     
#> 
#> loaded via a namespace (and not attached):
#>  [1] digest_0.6.33     withr_2.5.2       R.methodsS3_1.8.2 lifecycle_1.0.4  
#>  [5] magrittr_2.0.3    reprex_2.0.2      evaluate_0.23     rlang_1.1.2      
#>  [9] cli_3.6.2         remotes_2.4.2.1   rstudioapi_0.15.0 fs_1.6.3         
#> [13] R.utils_2.12.3    R.oo_1.25.0       vctrs_0.6.5       styler_1.10.2    
#> [17] rmarkdown_2.25    tools_4.2.3       R.cache_0.16.0    glue_1.6.2       
#> [21] purrr_1.0.2       xfun_0.41         yaml_2.3.8        fastmap_1.1.1    
#> [25] compiler_4.2.3    htmltools_0.5.7   knitr_1.45
+2
psadil on Dec 13, 2023

Thank you so much for the suggestion! It’s working great!!

Just as a side note, while Homebrew’s R formula has the issues mentioned above, the Cask version works great (it’s just the CRAN .pkg installer), so saying homebrew’s R isn’t recommended isn’t quite right since Homebrew is great at managing the CRAN version of R.

So while this gives you a problematic version of R:

brew install r

This gives you the CRAN version of R:

brew install --cask r

And comes with the benefit that Homebrew will automatically upgrade it for you when you run brew upgrade.

+1
juanfcocontreras on Feb 3, 2024

I forgot that Homebrew R has binary package install disabled oO TIL

@juanfcocontreras I am going to close this issue as the actual matter is closed (Thanks for that and the brew help too @glin!)

As @glin said homebrew R is not recommended for arrow specifically and also overall 😉 If you want the ease of a packagemanager to update and switch R versions I would highly recommend https://github.com/r-libs/rig!

You can of course open another issue if the problems persists after following the suggestions 😃

+1
assignUser on Feb 3, 2024

I think there are two different issues in this thread, one about installing arrow from source on Homebrew R, and one about installing the precompiled arrow package binaries from Posit Package Manager (https://packagemanager.posit.co/cran/latest).

We’ve addressed the issues with installing precompiled arrow from Posit Package Manager, but I don’t think there was a resolution with installing arrow from Homebrew R.

I’m not sure what the Homebrew issue may be, but @juanfcocontreras you can try installing arrow from https://packagemanager.posit.co/cran/latest instead of https://cran.rstudio.com/. CRAN binary packages on macOS typically aren’t compatible with Homebrew R, but the Package Manager binary packages may happen to work on Homebrew R.

+1
glin on Feb 1, 2024

The non-working PPM binary is caused by the issue reported by Jeroen in #38855 where the host system is used to download the pre-compiled binary which is of course not suiteable for the target system (mac):

arrow_cran.so: Mach-O 64-bit x86_64 dynamically linked shared library, flags:<NOUNDEFS|DYLDLINK|TWOLEVEL|WEAK_DEFINES|BINDS_TO_WEAK|NO_REEXPORTED_DYLIBS|HAS_TLV_DESCRIPTORS>
arrow_ppm.so: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, BuildID[sha1]=efa1a6bb9cc2686f83c1e21b3e6ded56cf73c7b5, stripped
+1
assignUser on Dec 14, 2023

I can repro on github actions: https://github.com/assignUser/test-repo-a/actions/runs/7202352843/job/19620310001#step:3:96 CRAN version works fine though.

+1
assignUser on Dec 13, 2023

I can reproduce @psadil’s error by installing from Posit package manager:

> install.packages("arrow", repos = "https://packagemanager.posit.co/cran/latest")
trying URL 'https://packagemanager.posit.co/cran/latest/bin/macosx/big-sur-arm64/contrib/4.3/arrow_14.0.0.2.tgz'
Content type 'binary/octet-stream' length 5434963 bytes (5.2 MB)
==================================================
downloaded 5.2 MB


The downloaded binary packages are in
	/var/folders/gt/l87wjg8s7312zs9s7c1fgs900000gn/T//RtmpobGW3N/downloaded_packages
> library(arrow)
Error: package or namespace load failed for ‘arrow’ in dyn.load(file, DLLpath = DLLpath, ...):
 unable to load shared object '/Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/library/arrow/libs/arrow.so':
  dlopen(/Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/library/arrow/libs/arrow.so, 0x0006): symbol not found in flat namespace '__ZN5arrow12ArrayBuilder12AppendScalarERKNS_6ScalarEx'

Perhaps since you’re using renv that’s where the binary is coming from?

+1
paleolimbot on Dec 13, 2023

For the original source build in the post, I see you are building from R installed via Homebrew. I don’t think we test or support that…perhaps R installed from the official CRAN page will work? (Even though we don’t test or support installation via Homebrew, this error may point to something else that is incorrect about our installation process on MacOS, so thank you for reporting!). I suspect that in your case the linked libraries are different than those by CRAN-provided R, so I’m not sure our precompiled binaries will work (although a source build should).

For the install.packages() error reported by @psadil, that looks like a normal R installation and the missing symbol is from Arrow itself. Normally that type of error occurs when Arrow R and Arrow C++ were built against different versions of Arrow headers.

On one of my MacOS M1s I get a somewhat concerning:

(edit: This was because Arrow was already loaded in my session…restarting R and then installing rectified the error)

> install.packages("arrow")
trying URL 'https://cran.rstudio.com/bin/macosx/big-sur-arm64/contrib/4.3/arrow_14.0.0.2.tgz'
Content type 'application/x-gzip' length 27212023 bytes (26.0 MB)
==================================================
downloaded 26.0 MB


The downloaded binary packages are in
	/var/folders/gt/l87wjg8s7312zs9s7c1fgs900000gn/T//RtmprpIGyO/downloaded_packages
> library(arrow)

Attaching package: ‘arrow’

The following object is masked from ‘package:utils’:

    timestamp

Warning message:
In MemoryPool__default() : internal error -3 in R_decompress1
> arrow::arrow_info()
Error in MemoryPool__default() : 
  lazy-load database '/Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/library/arrow/R/arrow.rdb' is corrupt
In addition: Warning messages:
1: In MemoryPool__default() : restarting interrupted promise evaluation
2: In MemoryPool__default() : internal error -3 in R_decompress1

On my other MacOS M1, I don’t have any issues. Those are both on R 4.3.1 (i.e., “release”).

+1
paleolimbot on Dec 13, 2023

hm this reads like maybe the precompiled binaries where build without s3/gcs but the package was (correctly) build with them enabled? I don’t have a mac so I will have to look at the binary but maybe @paleolimbot can test it? (which we did prior to release so it’s weird that it’s not working now…)

+1
assignUser on Dec 13, 2023

@psadil using the package version 13.0.0.1 worked for me as well! It did the trick!

I don’t know how I did not think about installing an other version before, probably the killing overload before the christmas break killed me ! 🤦‍♂️ 😶‍🌫️

Thanks for the quick response, sharing and support @psadil !!

However, I will let the issue open to get the apache-arrow support team be aware about the issue with the package version > 13.0.0.1!

+1
roled12 on Dec 13, 2023
Read more comments on GitHub
← arrow: [R] arrow violates the CRAN policy on downloading binary software
arrow: [R] Link-time optimization reports violations of one-definition rule in the R package →