cellrank: PETSc fails when computing absorption probabilities

When computing absorption probabilities on the lung using g_fwd.compute_absorption_probabilities(use_petsc=True, solver='gmres', n_jobs=8), my kernel dies and I get the following error message in the terminal:

[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Caught signal number 13 Broken Pipe: Likely while reading or writing to a socket
[0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[0]PETSC ERROR: or see https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind
[0]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[0]PETSC ERROR: to get more information on the crash.
application called MPI_Abort(MPI_COMM_WORLD, 50162059) - process 0
[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=50162059
:

Versions:

cellrank==1.1.0+gb36eac8 scanpy==1.6.0 anndata==0.7.4 numpy==1.19.5 numba==0.52.0 scipy==1.5.3 pandas==1.1.3 scikit-learn==0.23.2 statsmodels==0.12.0 python-igraph==0.8.3 scvelo==0.2.2 pygam==0.8.0 matplotlib==3.2.2 seaborn==0.11.0

…

Update 1: Running just g_fwd.compute_absorption_probabilities(n_jobs=8) works fine.

Update 2: Using just a single core, i.e. g_fwd.compute_absorption_probabilities(use_petsc=True, solver='gmres', n_jobs=1) also works fine.

About this issue

  • Original URL
  • State: closed
  • Created 6 years ago
  • Comments: 16

Most upvoted comments

Which multiprocessing backed are you using (e.g. default is loky). Could try with backend='threading'. Could you also try with e.g. n_jobs=2?