xgboost: Segmentation Fault with CV2 import

The following code creates a Fatal Python error: Segmentation fault.

• XGBoost 1.4.0 and opencv 4.5.2 in conda on Ubuntu 20.04.2 LTS (conda-forge)

It does not do so when (i) cv2 is not imported or (ii) n_jobs = 1 or 2 on a machine with 2 CPUs or (iii) n_job = 1 on a machine with 16 CPUs. Also, I can’t reproduce it on MacOS BigSur (same package versions, also conda-forge).

I tried to build XGBoost from source, with no luck. In my specific case the workaround is to only import cv2 within the function that needs it, so by the time the code reaches XGBoost it is out of scope.

gdb and faulthandler traces below.

Crash location As shown below it originates in /xgboost/data.py", line 155 in _from_numpy_array:

_check_call(_LIB.XGDMatrixCreateFromMat_omp(
        flatten.ctypes.data_as(ctypes.POINTER(ctypes.c_float)),
        c_bst_ulong(data.shape[0]),
        c_bst_ulong(data.shape[1]),
        ctypes.c_float(missing),
        ctypes.byref(handle),
        ctypes.c_int(nthread)))

Demo Code

import cv2

import xgboost
import numpy as np

import faulthandler
faulthandler.enable()

model = xgboost.XGBClassifier(n_jobs=3)

X = np.asarray([[0, 0, 0], [1, 1, 1], [2, 2, 2]])
y = np.asarray([0, 1, 2])
model.fit(X, y)
print(model.predict(X))

faulthandler:

Current thread 0x00007f8d07a9b740 (most recent call first):
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/data.py", line 155 in _from_numpy_array
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/data.py", line 556 in dispatch_data_backend
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/core.py", line 538 in __init__
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/core.py", line 433 in inner_f
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/sklearn.py", line 1172 in <lambda>
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/sklearn.py", line 236 in _wrap_evaluation_matrices
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/sklearn.py", line 1158 in fit
  File "/home/ubuntu/miniconda3/envs/automap21/lib/python3.9/site-packages/xgboost/core.py", line 433 in inner_f
  File "/home/ubuntu/bug.py", line 24 in <module>
Segmentation fault (core dumped)

gdb:

(gdb) run bug.py 
Starting program: /home/ubuntu/miniconda3/envs/automap21/bin/python bug.py
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[New Thread 0x7fffe9904700 (LWP 2793)]
[New Thread 0x7fffdac5d700 (LWP 2794)]

Thread 1 "python" received signal SIGSEGV, Segmentation fault.
0x00007fffdae6a037 in unsigned long xgboost::SparsePage::Push<xgboost::data::DenseAdapterBatch>(xgboost::data::DenseAdapterBatch const&, float, int) ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/libxgboost.so
(gdb) backtrace
#0  0x00007fffdae6a037 in unsigned long xgboost::SparsePage::Push<xgboost::data::DenseAdapterBatch>(xgboost::data::DenseAdapterBatch const&, float, int) ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/libxgboost.so
#1  0x00007fffdae8a65c in xgboost::data::SimpleDMatrix::SimpleDMatrix<xgboost::data::DenseAdapter>(xgboost::data::DenseAdapter*, float, int) ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/libxgboost.so
#2  0x00007fffdae852e4 in xgboost::DMatrix* xgboost::DMatrix::Create<xgboost::data::DenseAdapter>(xgboost::data::DenseAdapter*, float, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, unsigned long) () from /home/ubuntu/miniconda3/envs/automap21/lib/libxgboost.so
#3  0x00007fffdadbdc04 in XGDMatrixCreateFromMat_omp ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/libxgboost.so
#4  0x00007fffe09d49ed in ffi_call_unix64 ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/python3.9/lib-dynload/../../libffi.so.7
#5  0x00007fffe09d4077 in ffi_call_int ()
   from /home/ubuntu/miniconda3/envs/automap21/lib/python3.9/lib-dynload/../../libffi.so.7
#6  0x00007fffe09eddd7 in _call_function_pointer (
    argtypecount=<optimized out>, argcount=6, resmem=0x7fffffffc090, 
    restype=<optimized out>, atypes=<optimized out>, avalues=0x7fffffffc050, 
    pProc=0x7fffdadbdb80 <XGDMatrixCreateFromMat_omp>, flags=4353)
    at /usr/local/src/conda/python-3.9.6/Modules/_ctypes/callproc.c:920
--Type <RET> for more, q to quit, c to continue without paging--c
#7  _ctypes_callproc (pProc=<optimized out>, argtuple=<optimized out>, flags=<optimized out>, argtypes=<optimized out>, restype=0x555555c03560, checker=<optimized out>) at /usr/local/src/conda/python-3.9.6/Modules/_ctypes/callproc.c:1263
#8  0x00007fffe09ee464 in PyCFuncPtr_call (self=<optimized out>, inargs=<optimized out>, kwds=<optimized out>) at /usr/local/src/conda/python-3.9.6/Modules/_ctypes/_ctypes.c:4201
#9  0x000055555569a986 in _PyObject_MakeTpCall (tstate=0x5555559458f0, callable=0x7fffdad12b80, args=<optimized out>, nargs=<optimized out>, keywords=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_pyerrors.h:14
#10 0x00005555557392cc in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdad12b80, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:116
#11 _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x555556cd84c8, callable=0x7fffdad12b80, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:103
#12 PyObject_Vectorcall (kwnames=0x0, nargsf=<optimized out>, args=0x555556cd84c8, callable=0x7fffdad12b80) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#13 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#14 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3487
#15 0x00005555556f53fa in _PyEval_EvalFrame (throwflag=0, f=0x555556cd8310, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/object.c:1822
#16 function_code_fastcall (globals=0x7fffdacadf80, nargs=<optimized out>, args=<optimized out>, co=<optimized out>, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:330
#17 _PyFunction_Vectorcall (func=<optimized out>, stack=0x7fffdacde7b8, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:367
#18 0x000055555573431c in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x7fffdacde7b8, callable=0x7fffdacb7e50, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#19 PyObject_Vectorcall (kwnames=0x0, nargsf=<optimized out>, args=0x7fffdacde7b8, callable=0x7fffdacb7e50) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#20 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#21 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3518
#22 0x000055555568d430 in _PyEval_EvalFrame (throwflag=0, f=0x7fffdacde610, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#23 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffe02b1af8, kwargs=0x555556ce5078, kwcount=<optimized out>, kwstep=1, defs=0x7fffdacba7a8, defcount=1, kwdefs=0x0, closure=0x0, name=0x7fffe02b1a80, qualname=0x7fffe02b1a80) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#24 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x555556ce5070, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#25 0x0000555555735141 in _PyObject_VectorcallTstate (kwnames=0x7fffe02b1ae0, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdacc3160, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#26 PyObject_Vectorcall (kwnames=0x7fffe02b1ae0, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdacc3160) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#27 call_function (kwnames=0x7fffe02b1ae0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#28 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3535
#29 0x000055555568dc70 in _PyEval_EvalFrame (throwflag=0, f=0x555556ce4e70, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#30 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffdacf39d8, kwargs=0x7fffdacbe938, kwcount=<optimized out>, kwstep=1, defs=0x7fffe02aee38, defcount=1, kwdefs=0x7fffdb1b4f00, closure=0x0, name=0x7ffff791b530, qualname=0x7fffe02b1b20) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#31 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x7fffdacbe938, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#32 0x00005555556b4335 in PyVectorcall_Call (kwargs=<optimized out>, tuple=<optimized out>, callable=0x7fffdb1b8e50) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:266
#33 _PyObject_Call (tstate=<optimized out>, callable=0x7fffdb1b8e50, args=<optimized out>, kwargs=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:266
#34 0x0000555555736cc9 in PyObject_Call (kwargs=0x7fffe02ac180, args=0x7ffff791f040, callable=0x7fffdb1b8e50) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:290
#35 do_call_core (kwdict=0x7fffe02ac180, callargs=0x7ffff791f040, func=0x7fffdb1b8e50, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5120
#36 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3580
#37 0x000055555568dc70 in _PyEval_EvalFrame (throwflag=0, f=0x55555696e7a0, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#38 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffdb1aac28, kwargs=0x7fffdacbe9a0, kwcount=<optimized out>, kwstep=1, defs=0x0, defcount=0, kwdefs=0x0, closure=0x7fffdb1b9450, name=0x7ffff791b530, qualname=0x7fffe02b1b20) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#39 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x7fffdacbe998, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#40 0x0000555555701824 in _PyObject_FastCallDictTstate (kwargs=<optimized out>, nargsf=1, args=0x7fffffffce50, callable=0x7fffdb1b8f70, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/object.c:2203
#41 _PyObject_Call_Prepend (kwargs=<optimized out>, args=<optimized out>, obj=<optimized out>, callable=0x7fffdb1b8f70, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:489
#42 slot_tp_init (self=<optimized out>, args=<optimized out>, kwds=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/typeobject.c:6943
#43 0x00005555556a01d5 in type_call (type=<optimized out>, args=0x7ffff791f040, kwds=0x7fffdad04a40) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/typeobject.c:1026
#44 0x00005555556b43b8 in _PyObject_Call (tstate=0x5555559458f0, callable=0x555555edb340, args=0x7ffff791f040, kwargs=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:281
#45 0x0000555555736cc9 in PyObject_Call (kwargs=0x7fffdad04a40, args=0x7ffff791f040, callable=0x555555edb340) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:290
#46 do_call_core (kwdict=0x7fffdad04a40, callargs=0x7ffff791f040, func=0x555555edb340, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5120
#47 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3580
#48 0x000055555568d430 in _PyEval_EvalFrame (throwflag=0, f=0x7fffdac64550, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#49 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffdad1d598, kwargs=0x555556c62878, kwcount=<optimized out>, kwstep=1, defs=0x0, defcount=0, kwdefs=0x0, closure=0x7ffff784aac0, name=0x7ffff77cf930, qualname=0x7fffdaca4b70) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#50 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x555556c62878, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#51 0x0000555555735141 in _PyObject_VectorcallTstate (kwnames=0x7fffdad1d580, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdac5e700, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#52 PyObject_Vectorcall (kwnames=0x7fffdad1d580, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdac5e700) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#53 call_function (kwnames=0x7fffdad1d580, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#54 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3535
#55 0x000055555568dc70 in _PyEval_EvalFrame (throwflag=0, f=0x555556c62640, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#56 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffdacaf0f8, kwargs=0x555556cd1570, kwcount=<optimized out>, kwstep=1, defs=0x7fffdacaab08, defcount=1, kwdefs=0x0, closure=0x0, name=0x7fffdad05530, qualname=0x7fffdad05530) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#57 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x555556cd1570, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#58 0x0000555555735141 in _PyObject_VectorcallTstate (kwnames=0x7fffdacaf0e0, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdacc3b80, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#59 PyObject_Vectorcall (kwnames=0x7fffdacaf0e0, nargsf=<optimized out>, args=<optimized out>, callable=0x7fffdacc3b80) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#60 call_function (kwnames=0x7fffdacaf0e0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#61 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3535
#62 0x000055555568dc70 in _PyEval_EvalFrame (throwflag=0, f=0x555556cd1320, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#63 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x7fffe02ac158, kwargs=0x7fffe029d638, kwcount=<optimized out>, kwstep=1, defs=0x0, defcount=0, kwdefs=0x7fffdacc8c40, closure=0x0, name=0x7ffff76c59b0, qualname=0x7fffdacae620) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#64 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x7fffe029d638, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#65 0x00005555556b4335 in PyVectorcall_Call (kwargs=<optimized out>, tuple=<optimized out>, callable=0x7fffdacc5ee0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:266
#66 _PyObject_Call (tstate=<optimized out>, callable=0x7fffdacc5ee0, args=<optimized out>, kwargs=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:266
#67 0x0000555555736cc9 in PyObject_Call (kwargs=0x7ffff7889d40, args=0x7ffff791f040, callable=0x7fffdacc5ee0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:290
#68 do_call_core (kwdict=0x7ffff7889d40, callargs=0x7ffff791f040, func=0x7fffdacc5ee0, tstate=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5120
#69 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3580
#70 0x000055555568dc70 in _PyEval_EvalFrame (throwflag=0, f=0x555556b76060, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#71 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x0, kwargs=0x5555559a24d8, kwcount=<optimized out>, kwstep=1, defs=0x0, defcount=0, kwdefs=0x0, closure=0x7fffdacc1b80, name=0x7ffff76c59b0, qualname=0x7fffdacae620) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#72 0x00005555556f5596 in _PyFunction_Vectorcall (func=<optimized out>, stack=0x5555559a24c0, nargsf=<optimized out>, kwnames=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Objects/call.c:396
#73 0x0000555555734569 in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x5555559a24c0, callable=0x7fffdacc5f70, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#74 PyObject_Vectorcall (kwnames=0x0, nargsf=<optimized out>, args=0x5555559a24c0, callable=0x7fffdacc5f70) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/cpython/abstract.h:127
#75 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:5072
#76 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=<optimized out>, throwflag=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:3504
#77 0x000055555568d430 in _PyEval_EvalFrame (throwflag=0, f=0x5555559a2350, tstate=0x5555559458f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Include/internal/pycore_ceval.h:40
#78 _PyEval_EvalCode (tstate=0x5555559458f0, _co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=0x0, kwargs=0x0, kwcount=<optimized out>, kwstep=2, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0, name=0x0, qualname=0x0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4327
#79 0x0000555555773517 in _PyEval_EvalCodeWithName (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kwnames=<optimized out>, kwargs=0x0, kwcount=0, kwstep=2, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0, name=0x0, qualname=0x0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4359
#80 0x0000555555773559 in PyEval_EvalCodeEx (_co=<optimized out>, globals=<optimized out>, locals=<optimized out>, args=<optimized out>, argcount=<optimized out>, kws=<optimized out>, kwcount=0, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:4375
#81 0x000055555577357b in PyEval_EvalCode (co=<optimized out>, globals=<optimized out>, locals=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/ceval.c:826
#82 0x00005555557a5ec9 in run_eval_code_obj (tstate=0x5555559458f0, co=0x7ffff77d4920, globals=0x7ffff7889b00, locals=0x7ffff7889b00) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/pythonrun.c:1219
#83 0x00005555557e0c04 in run_mod (mod=<optimized out>, filename=<optimized out>, globals=0x7ffff7889b00, locals=0x7ffff7889b00, flags=<optimized out>, arena=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/pythonrun.c:1240
#84 0x0000555555668def in pyrun_file (fp=0x5555559454f0, filename=0x7ffff788f670, start=<optimized out>, globals=0x7ffff7889b00, locals=0x7ffff7889b00, closeit=1, flags=0x7fffffffdf88) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/pythonrun.c:1138
#85 0x00005555557e6d72 in pyrun_simple_file (flags=0x7fffffffdf88, closeit=1, filename=0x7ffff788f670, fp=0x5555559454f0) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/pythonrun.c:449
#86 PyRun_SimpleFileExFlags (fp=0x5555559454f0, filename=<optimized out>, closeit=1, flags=0x7fffffffdf88) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Python/pythonrun.c:482
#87 0x00005555557e7445 in pymain_run_file (cf=0x7fffffffdf88, config=0x555555946740) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Modules/main.c:379
#88 pymain_run_python (exitcode=0x7fffffffdf80) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Modules/main.c:604
#89 Py_RunMain () at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Modules/main.c:683
#90 0x00005555557e7599 in Py_BytesMain (argc=<optimized out>, argv=<optimized out>) at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Modules/main.c:1129
#91 0x00007ffff7c6d0b3 in __libc_start_main (main=0x555555672a20 <main>, argc=2, argv=0x7fffffffe188, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fffffffe178) at ../csu/libc-start.c:308
#92 0x00005555557606b1 in _start () at /home/conda/feedstock_root/build_artifacts/python-split_1625973859697/work/Parser/pegen/pegen.c:55
(gdb)