xarray: recent versions of sparse and dask seem to be incompatible with our tests

Python 3.9 Test Summary Info

FAILED xarray/tests/test_plot.py::TestFacetGrid::test_can_set_norm - ValueErr...
FAILED xarray/tests/test_plot.py::TestCFDatetimePlot::test_cfdatetime_line_plot
FAILED xarray/tests/test_plot.py::TestCFDatetimePlot::test_cfdatetime_pcolormesh_plot
FAILED xarray/tests/test_plot.py::TestCFDatetimePlot::test_cfdatetime_contour_plot

About this issue

Original URL
State: closed
Created 3 years ago
Comments: 28 (17 by maintainers)

Most upvoted comments

This should be closed via https://github.com/pydata/xarray/pull/5751. Again, thanks all for your efforts!

jrbourbeau on Aug 31, 2021

I have fixed the reported issues and released version 0.13.0 with the fixes included.

hameerabbasi on Aug 30, 2021

Thanks Hameer! 😄

jakirkham on Aug 30, 2021

cc @pentschev (just so you are aware)

jakirkham on Aug 26, 2021

Narrowed it down.

>>> import dask.array as da
>>> import sparse
>>> s = sparse.COO.from_numpy([0, 0, 1, 2])
>>> a = da.from_array(s)
>>> z = da.zeros_like(a)
>>> z
dask.array<zeros_like, shape=(4,), dtype=int64, chunksize=(4,), chunktype=sparse.COO>
>>> z.compute()
<function _broadcast_trick_inner at 0x7fb8a3874e50>

numpy-1.20.1 dask-2021.3.0 sparse-0.11.2

crusaderky on Aug 26, 2021

Ah, that’s a good point @keewis. Stepping back a bit, my current situation locally is I’m able to reproduce the xarray/tests/test_sparse.py::test_chunk failure with:

the latest commit to dask (https://github.com/dask/dask/commit/76822dbc3da29767d7e6d70d73010046bd52604e)
the latest commit to xarray (https://github.com/pydata/xarray/commit/e26aec9500e04f3b926b248988b976dbfcb9c632)
numpy=1.21.1
pandas=1.3.1

Rolling dask back to the 2021.7.2 release, but keeping everything else the same, test_chunk passes. After running git bisect between the latest dask commit and the 2021.7.2 release, https://github.com/dask/dask/pull/7939 is the point where test_chunk started failing (cc @jakirkham for visibility). I’ll try to dig in a bit more to see if I can find the root cause of the failure

EDIT: I should note that the test_chunk failure has a similar traceback to https://github.com/dask/dask/issues/5259

jrbourbeau on Aug 20, 2021