dask: Bug: flaky plugin - unexpected keyword argument 'reruns'

What happened:

Building dask from source using conda on arm64 machine
Command used- conda env create -n dask-dev -f continuous_integration/environment-latest.yaml (error)

Error

Collecting package metadata (repodata.json): done
Solving environment: failed

ResolvePackageNotFound: 
  - bcolz
  - crick

What you expected to happen: Able to create the environment without any missing packages

Anything else we need to know?: I commented the bcolz, crick in the environment-lates.yaml file, and the environment was created successfully, though few tests failed.

Updated tests failures

conda create -n dask python dask` - successful env creation

ERROR dask/tests/test_base.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest....
ERROR dask/tests/test_base.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest....
ERROR dask/tests/test_distributed.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs....
ERROR dask/tests/test_distributed.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs....
ERROR dask/tests/test_graph_manipulation.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https:...
ERROR dask/tests/test_graph_manipulation.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https:...
ERROR dask/tests/test_threaded.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pyt...
ERROR dask/tests/test_threaded.py - pytest.PytestUnknownMarkWarning: Unknown pytest.mark.flaky - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pyt...

Environemnt info

conda info

     active environment : dask
    active env location : /Users/sayantikabanik/miniforge3/envs/dask
            shell level : 1
       user config file : /Users/sayantikabanik/.condarc
 populated config files : /Users/sayantikabanik/miniforge3/.condarc
                          /Users/sayantikabanik/.condarc
          conda version : 4.10.3
    conda-build version : not installed
         python version : 3.9.7.final.0
       virtual packages : __osx=11.5.2=0
                          __unix=0=0
                          __archspec=1=arm64
       base environment : /Users/sayantikabanik/miniforge3  (writable)
      conda av data dir : /Users/sayantikabanik/miniforge3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/osx-arm64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /Users/sayantikabanik/miniforge3/pkgs
                          /Users/sayantikabanik/.conda/pkgs
       envs directories : /Users/sayantikabanik/miniforge3/envs
                          /Users/sayantikabanik/.conda/envs
               platform : osx-arm64
             user-agent : conda/4.10.3 requests/2.26.0 CPython/3.9.7 Darwin/20.6.0 OSX/11.5.2
                UID:GID : 501:20
             netrc file : None
           offline mode : False

conda list


attrs                     21.2.0                   pypi_0    pypi
bokeh                     2.4.0            py39h2804cbe_0    conda-forge
ca-certificates           2021.5.30            h4653dfc_0    conda-forge
click                     8.0.1            py39h2804cbe_0    conda-forge
cloudpickle               2.0.0              pyhd8ed1ab_0    conda-forge
cytoolz                   0.11.0           py39h5161555_3    conda-forge
dask                      2021.9.1+22.g0b0b2f74.dirty           dev_0    <develop>
distributed               2021.9.1         py39h2804cbe_0    conda-forge
freetype                  2.10.4               h17b34a0_1    conda-forge
fsspec                    2021.10.0          pyhd8ed1ab_0    conda-forge
heapdict                  1.0.1                      py_0    conda-forge
iniconfig                 1.1.1                    pypi_0    pypi
jbig                      2.1               h3422bc3_2003    conda-forge
jinja2                    3.0.1              pyhd8ed1ab_0    conda-forge
jpeg                      9d                   h27ca646_0    conda-forge
lcms2                     2.12                 had6a04f_0    conda-forge
lerc                      2.2.1                h9f76cd9_0    conda-forge
libblas                   3.9.0           11_osxarm64_openblas    conda-forge
libcblas                  3.9.0           11_osxarm64_openblas    conda-forge
libcxx                    12.0.1               h168391b_0    conda-forge
libdeflate                1.7                  h27ca646_5    conda-forge
libgfortran               5.0.0.dev0      11_0_1_hf114ba7_23    conda-forge
libgfortran5              11.0.1.dev0         hf114ba7_23    conda-forge
liblapack                 3.9.0           11_osxarm64_openblas    conda-forge
libopenblas               0.3.17          openmp_h5dd58f0_1    conda-forge
libpng                    1.6.37               hf7e6567_2    conda-forge
libtiff                   4.3.0                hc6122e1_1    conda-forge
libwebp-base              1.2.1                h3422bc3_0    conda-forge
libzlib                   1.2.11            hee7b306_1013    conda-forge
llvm-openmp               12.0.1               hf3c4609_1    conda-forge
locket                    0.2.0                      py_2    conda-forge
lz4-c                     1.9.3                hbdafb3b_1    conda-forge
markupsafe                2.0.1            py39h5161555_0    conda-forge
msgpack-python            1.0.2            py39h4d2d688_1    conda-forge
ncurses                   6.2                  h9aa5885_4    conda-forge
numpy                     1.21.2           py39h1f3b974_0    conda-forge
olefile                   0.46               pyh9f0ad1d_1    conda-forge
openjpeg                  2.4.0                h062765e_1    conda-forge
openssl                   3.0.0                h3422bc3_1    conda-forge
packaging                 21.0               pyhd8ed1ab_0    conda-forge
pandas                    1.3.3            py39h7f752ed_0    conda-forge
partd                     1.2.0              pyhd8ed1ab_0    conda-forge
pillow                    8.3.2            py39ha74c66e_0    conda-forge
pip                       21.2.4             pyhd8ed1ab_0    conda-forge
pluggy                    1.0.0                    pypi_0    pypi
psutil                    5.8.0            py39h5161555_1    conda-forge
py                        1.10.0                   pypi_0    pypi
pyarrow                   5.0.0                    pypi_0    pypi
pyparsing                 2.4.7              pyh9f0ad1d_0    conda-forge
pytest                    6.2.5                    pypi_0    pypi
python                    3.9.7           hc0da0df_3_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python_abi                3.9                      2_cp39    conda-forge
pytz                      2021.1             pyhd8ed1ab_0    conda-forge
pyyaml                    5.4.1            py39h5161555_1    conda-forge
readline                  8.1                  hedafd6a_0    conda-forge
setuptools                58.0.4           py39h2804cbe_2    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
sqlite                    3.36.0               h72a2b83_2    conda-forge
tblib                     1.7.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.11               he1e0b03_1    conda-forge
toml                      0.10.2                   pypi_0    pypi
toolz                     0.11.1                     py_0    conda-forge
tornado                   6.1              py39h5161555_1    conda-forge
typing_extensions         3.10.0.2           pyha770c72_0    conda-forge
tzdata                    2021b                he74cb21_0    conda-forge
wheel                     0.37.0             pyhd8ed1ab_1    conda-forge
xz                        5.2.5                h642e427_1    conda-forge
yaml                      0.2.5                h642e427_0    conda-forge
zict                      2.0.0                      py_0    conda-forge
zlib                      1.2.11            hee7b306_1013    conda-forge
zstd                      1.5.0                h861e0a7_0    conda-forge

Version details:

Dask version: 2021.9.1
Python version: 3.9.7
Operating System: macos (arm64)
Install method (conda, pip, source): conda

About this issue

Original URL
State: closed
Created 3 years ago
Comments: 15 (8 by maintainers)

Most upvoted comments

Thanks, @jrbourbeau all the test cases passed. It would be great I think to document this.

sayantikabanik on Oct 20, 2021

pytest-rerunfailures is already included in when you do python -m pip install -e ".[complete,test]" as recommended in the Development Guideline. I am going to close this, but if you think there is somewhere where we can be more explicit please open a pull request!

jsignell on Oct 20, 2021

Yeah am not really sure at this point. We seem to be getting into the weeds of how pytest and its plugins work. Probably the next step is to start simplifying the error to the point where we can raise upstream. Either there is something we are doing wrong here in our config they can advise us on or we are running into some kind of bug in their tooling.

jakirkham on Oct 14, 2021