arrow: [CI][R][Python] R and Python integration's tests failed
Describe the bug, including details regarding any error messages, version, and platform.
https://github.com/apache/arrow/actions/runs/7760862085/job/21168058007#step:6:32228
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test-python-flight.R:32:5'): flight_put ─────────────────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
▆
1. └─arrow::flight_put(client, example_data, path = flight_obj) at test-python-flight.R:32:5
2. ├─reticulate::r_to_py(data)
3. └─arrow:::r_to_py.Table(data)
4. ├─reticulate::r_to_py(as_record_batch_reader(x), convert = FALSE)
5. └─arrow:::r_to_py.RecordBatchReader(...)
6. └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
7. └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python-flight.R:42:5'): flight_put with max_chunksize ──────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
▆
1. └─arrow::flight_put(client, example_data, path = flight_obj, max_chunksize = 1) at test-python-flight.R:42:5
2. ├─reticulate::r_to_py(data)
3. └─arrow:::r_to_py.Table(data)
3. └─pa$Field$`_import_from_c`(pyarrow_compatible_pointer(schema_ptr))
4. └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python.R:157:3'): RecordBatchReader to python ──────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
▆
1. ├─reticulate::r_to_py(reader) at test-python.R:157:3
2. └─arrow:::r_to_py.RecordBatchReader(reader)
3. └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
4. └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python.R:177:3'): RecordBatchReader from python ────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
▆
1. ├─reticulate::r_to_py(reader) at test-python.R:177:3
2. └─arrow:::r_to_py.RecordBatchReader(reader)
3. └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
4. └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
The last success commit: https://github.com/apache/arrow/commit/2721134715b7dedfa2715bcf47548728ff702d5a The first failed commit: https://github.com/apache/arrow/commit/b684028dfbeeed85d132a1249449a85877d796b1
Commits between them:
- https://github.com/apache/arrow/commit/44d5597a0e8a4d635f1aec82ba885f61b5c17829
- https://github.com/apache/arrow/commit/3d45ac96534fc76b820b488aa02182e6b93a388f
- https://github.com/apache/arrow/commit/a1c1773b724e4d78faf9a097247c7e976cd2cbfa
- https://github.com/apache/arrow/commit/4ceb66101382d74c6ef73ff546fad10183ab58d8
@jorisvandenbossche Could you take a look at this PyCapsule related error messages?
Component(s)
Continuous Integration, Python, R
About this issue
- Original URL
- State: closed
- Created 5 months ago
- Comments: 15 (15 by maintainers)
Commits related to this issue
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to apache/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to dgreiss/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to apache/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to apache/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to zanmato1984/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to apache/arrow by paleolimbot 5 months ago
- GH-39933: [R] Fix pointer conversion to Python for latest reticulate (#39969) ### Rationale for this change The integration tests and documentation build is failing ### What changes are included i... — committed to thisisnic/arrow by paleolimbot 5 months ago
We should do both, because ideally one can use an older R-Arrow with a newer PyArrow and vice-versa.
Let me verify my guess, I’ll report back.