arrow: [CI][R][Python] R and Python integration's tests failed

Describe the bug, including details regarding any error messages, version, and platform.

https://github.com/apache/arrow/actions/runs/7760862085/job/21168058007#step:6:32228

══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test-python-flight.R:32:5'): flight_put ─────────────────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
    ▆
 1. └─arrow::flight_put(client, example_data, path = flight_obj) at test-python-flight.R:32:5
 2.   ├─reticulate::r_to_py(data)
 3.   └─arrow:::r_to_py.Table(data)
 4.     ├─reticulate::r_to_py(as_record_batch_reader(x), convert = FALSE)
 5.     └─arrow:::r_to_py.RecordBatchReader(...)
 6.       └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
 7.         └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python-flight.R:42:5'): flight_put with max_chunksize ──────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
    ▆
 1. └─arrow::flight_put(client, example_data, path = flight_obj, max_chunksize = 1) at test-python-flight.R:42:5
 2.   ├─reticulate::r_to_py(data)
 3.   └─arrow:::r_to_py.Table(data)
 3.   └─pa$Field$`_import_from_c`(pyarrow_compatible_pointer(schema_ptr))
 4.     └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python.R:157:3'): RecordBatchReader to python ──────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
    ▆
 1. ├─reticulate::r_to_py(reader) at test-python.R:157:3
 2. └─arrow:::r_to_py.RecordBatchReader(reader)
 3.   └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
 4.     └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)
── Error ('test-python.R:177:3'): RecordBatchReader from python ────────────────
<python.builtin.ValueError/python.builtin.Exception/python.builtin.BaseException/python.builtin.object/error/condition>
Error in `py_call_impl(callable, call_args$unnamed, call_args$named)`: ValueError: PyCapsule_GetPointer called with incorrect name
Run `reticulate::py_last_error()` for details.
Backtrace:
    ▆
 1. ├─reticulate::r_to_py(reader) at test-python.R:177:3
 2. └─arrow:::r_to_py.RecordBatchReader(reader)
 3.   └─pa$lib$RecordBatchReader$`_import_from_c`(pyarrow_compatible_pointer(stream_ptr))
 4.     └─reticulate:::py_call_impl(callable, call_args$unnamed, call_args$named)

The last success commit: https://github.com/apache/arrow/commit/2721134715b7dedfa2715bcf47548728ff702d5a The first failed commit: https://github.com/apache/arrow/commit/b684028dfbeeed85d132a1249449a85877d796b1

Commits between them:

@jorisvandenbossche Could you take a look at this PyCapsule related error messages?

Component(s)

Continuous Integration, Python, R

About this issue

  • Original URL
  • State: closed
  • Created 5 months ago
  • Comments: 15 (15 by maintainers)

Commits related to this issue

Most upvoted comments

We should do both, because ideally one can use an older R-Arrow with a newer PyArrow and vice-versa.

Let me verify my guess, I’ll report back.