dask-jobqueue: Dask Dashboard - Connection Refused
Not sure if this belongs here or dask distributed (or elsewhere?) - so please let me know if I should move this issue to another repo.
Issue
I am unable to access the dask dashboard when starting a cluster with dask jobqueue.
Setup
Port forwarding jupyterlab from HPC running slurm. Running a container (w/ Singularity): container info
Conda Environments
Base env (running JupyterLab)conda list
# packages in environment at /opt/conda:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 0_gnu conda-forge
aiohttp 3.6.2 py37h516909a_0 conda-forge
alembic 1.4.2 pyh9f0ad1d_0 conda-forge
async-timeout 3.0.1 py_1000 conda-forge
async_generator 1.10 py_0 conda-forge
attrs 19.3.0 py_0 conda-forge
backcall 0.1.0 py_0 conda-forge
bleach 3.1.5 pyh9f0ad1d_0 conda-forge
blinker 1.4 py_1 conda-forge
bokeh 2.0.1 py37hc8dfbb8_0 conda-forge
brotlipy 0.7.0 py37h8f50634_1000 conda-forge
ca-certificates 2020.4.5.1 hecc5488_0 conda-forge
certifi 2020.4.5.1 py37hc8dfbb8_0 conda-forge
certipy 0.1.3 py_0 conda-forge
cffi 1.14.0 py37hd463f26_0 conda-forge
chardet 3.0.4 py37hc8dfbb8_1006 conda-forge
click 7.1.2 pyh9f0ad1d_0 conda-forge
cloudpickle 1.4.1 py_0 conda-forge
conda 4.8.2 py37_0 conda-forge
conda-package-handling 1.6.0 py37h8f50634_2 conda-forge
configurable-http-proxy 4.2.1 node13_he01fd0c_0 conda-forge
cryptography 2.9.2 py37hb09aad4_0 conda-forge
cytoolz 0.10.1 py37h516909a_0 conda-forge
dask-core 2.17.2 py_0 conda-forge
dask-labextension 2.0.2 py_0 conda-forge
decorator 4.4.2 py_0 conda-forge
defusedxml 0.6.0 py_0 conda-forge
distributed 2.17.0 py37hc8dfbb8_0 conda-forge
entrypoints 0.3 py37hc8dfbb8_1001 conda-forge
freetype 2.10.2 he06d7ca_0 conda-forge
heapdict 1.0.1 py_0 conda-forge
icu 64.2 he1b5a44_1 conda-forge
idna 2.9 py_1 conda-forge
importlib-metadata 1.6.0 py37hc8dfbb8_0 conda-forge
importlib_metadata 1.6.0 0 conda-forge
ipykernel 5.3.0 py37h43977f1_0 conda-forge
ipython 7.14.0 py37hc8dfbb8_0 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
jedi 0.17.0 py37hc8dfbb8_0 conda-forge
jinja2 2.11.2 pyh9f0ad1d_0 conda-forge
jpeg 9c h14c3975_1001 conda-forge
json5 0.9.0 py_0 conda-forge
jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge
jupyter-archive 0.6.2 py_0 conda-forge
jupyter-panel-proxy 0.1.0 py_0 conda-forge
jupyter-rsession-proxy 1.2 py_0 conda-forge
jupyter-server-proxy 1.5.0 py_0 conda-forge
jupyter-vscode-proxy 0.1 py_0 conda-forge
jupyter_client 6.1.3 py_0 conda-forge
jupyter_core 4.6.3 py37hc8dfbb8_1 conda-forge
jupyter_telemetry 0.0.5 py_0 conda-forge
jupyterhub 1.1.0 py37_2 conda-forge
jupyterhub-base 1.1.0 py37_2 conda-forge
jupyterlab 2.1.3 py_0 conda-forge
jupyterlab_server 1.1.5 py_0 conda-forge
krb5 1.17.1 h2fd8d38_0 conda-forge
ld_impl_linux-64 2.34 h53a641e_0 conda-forge
libblas 3.8.0 14_openblas conda-forge
libcblas 3.8.0 14_openblas conda-forge
libcurl 7.69.1 hf7181ac_0 conda-forge
libedit 3.1.20170329 hf8c457e_1001 conda-forge
libffi 3.2.1 he1b5a44_1007 conda-forge
libgcc-ng 9.2.0 h24d8f2e_2 conda-forge
libgfortran-ng 7.5.0 hdf63c60_6 conda-forge
libgomp 9.2.0 h24d8f2e_2 conda-forge
liblapack 3.8.0 14_openblas conda-forge
libopenblas 0.3.7 h5ec1e0e_6 conda-forge
libpng 1.6.37 hed695b0_1 conda-forge
libsodium 1.0.17 h516909a_0 conda-forge
libssh2 1.9.0 hab1572f_2 conda-forge
libstdcxx-ng 9.2.0 hdf63c60_2 conda-forge
libtiff 4.1.0 hc7e4089_6 conda-forge
libuv 1.34.0 h516909a_0 conda-forge
libwebp-base 1.1.0 h516909a_3 conda-forge
lz4-c 1.9.2 he1b5a44_1 conda-forge
mako 1.1.0 py_0 conda-forge
markdown 3.2.2 py_0 conda-forge
markupsafe 1.1.1 py37h8f50634_1 conda-forge
mistune 0.8.4 py37h8f50634_1001 conda-forge
msgpack-python 1.0.0 py37h99015e2_1 conda-forge
multidict 4.7.5 py37h8f50634_1 conda-forge
nb_conda_kernels 2.2.3 py37_0 conda-forge
nbconvert 5.6.1 py37hc8dfbb8_1 conda-forge
nbformat 5.0.6 py_0 conda-forge
ncurses 6.1 hf484d3e_1002 conda-forge
nodejs 13.13.0 hf5d1a2b_0 conda-forge
notebook 6.0.3 py37hc8dfbb8_0 conda-forge
numpy 1.18.4 py37h8960a57_0 conda-forge
oauthlib 3.0.1 py_0 conda-forge
olefile 0.46 py_0 conda-forge
openssl 1.1.1g h516909a_0 conda-forge
packaging 20.4 pyh9f0ad1d_0 conda-forge
pamela 1.0.0 py_0 conda-forge
pandoc 2.9.2.1 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
panel 0.9.5 py_1 conda-forge
param 1.9.3 py_0 conda-forge
parso 0.7.0 pyh9f0ad1d_0 conda-forge
pexpect 4.8.0 py37hc8dfbb8_1 conda-forge
pickleshare 0.7.5 py37hc8dfbb8_1001 conda-forge
pillow 7.1.2 py37h718be6c_0 conda-forge
pip 20.1 pyh9f0ad1d_0 conda-forge
prometheus_client 0.8.0 pyh9f0ad1d_0 conda-forge
prompt-toolkit 3.0.5 py_0 conda-forge
psutil 5.7.0 py37h8f50634_1 conda-forge
ptyprocess 0.6.0 py_1001 conda-forge
pycosat 0.6.3 py37h8f50634_1004 conda-forge
pycparser 2.20 py_0 conda-forge
pyct 0.4.6 py_0 conda-forge
pyct-core 0.4.6 py_0 conda-forge
pycurl 7.43.0.5 py37h16ce93b_0 conda-forge
pygments 2.6.1 py_0 conda-forge
pyjwt 1.7.1 py_0 conda-forge
pyopenssl 19.1.0 py_1 conda-forge
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyrsistent 0.16.0 py37h8f50634_0 conda-forge
pysocks 1.7.1 py37hc8dfbb8_1 conda-forge
python 3.7.6 h8356626_5_cpython conda-forge
python-dateutil 2.8.1 py_0 conda-forge
python-editor 1.0.4 py_0 conda-forge
python-json-logger 0.1.11 py_0 conda-forge
python_abi 3.7 1_cp37m conda-forge
pyviz_comms 0.7.4 pyh8c360ce_0 conda-forge
pyyaml 5.3.1 py37h8f50634_0 conda-forge
pyzmq 19.0.1 py37hac76be4_0 conda-forge
readline 8.0 hf8c457e_0 conda-forge
requests 2.23.0 pyh8c360ce_2 conda-forge
ruamel.yaml 0.16.6 py37h8f50634_1 conda-forge
ruamel.yaml.clib 0.2.0 py37h8f50634_1 conda-forge
ruamel_yaml 0.15.80 py37h8f50634_1001 conda-forge
send2trash 1.5.0 py_0 conda-forge
setuptools 46.1.3 py37hc8dfbb8_0 conda-forge
simpervisor 0.3 py_1 conda-forge
six 1.14.0 py_1 conda-forge
sortedcontainers 2.1.0 py_0 conda-forge
sqlalchemy 1.3.17 py37h8f50634_0 conda-forge
sqlite 3.30.1 hcee41ef_0 conda-forge
tblib 1.6.0 py_0 conda-forge
terminado 0.8.3 py37hc8dfbb8_1 conda-forge
testpath 0.4.4 py_0 conda-forge
tini 0.18.0 h14c3975_1001 conda-forge
tk 8.6.10 hed695b0_0 conda-forge
toolz 0.10.0 py_0 conda-forge
tornado 5.1.1 py37h14c3975_1000 conda-forge
tqdm 4.45.0 pyh9f0ad1d_1 conda-forge
traitlets 4.3.3 py37hc8dfbb8_1 conda-forge
typing_extensions 3.7.4.2 py_0 conda-forge
urllib3 1.25.9 py_0 conda-forge
wcwidth 0.1.9 pyh9f0ad1d_0 conda-forge
webencodings 0.5.1 py_1 conda-forge
wheel 0.34.2 py_1 conda-forge
widgetsnbextension 3.5.1 py37_0 conda-forge
xz 5.2.5 h516909a_0 conda-forge
yaml 0.2.4 h516909a_0 conda-forge
yarl 1.3.0 py37h516909a_1000 conda-forge
zeromq 4.3.2 he1b5a44_2 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.1.0 py_0 conda-forge
zlib 1.2.11 h516909a_1006 conda-forge
zstd 1.4.4 h6597ccf_3 conda-forge
py_geo env (kernel used in JupyterLab)conda list
# packages in environment at /opt/conda/envs/py_geo:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 1_llvm conda-forge
_py-xgboost-mutex 2.0 cpu_0 conda-forge
abseil-cpp 20200225.2 he1b5a44_0 conda-forge
affine 2.3.0 py_0 conda-forge
aiohttp 3.6.2 py37h516909a_0 conda-forge
appdirs 1.4.3 py_1 conda-forge
arrow-cpp 0.17.1 py37h1234567_3_cpu conda-forge
asciitree 0.3.3 py_2 conda-forge
async-timeout 3.0.1 py_1000 conda-forge
at-spi2-atk 2.32.0 h1369247_0 conda-forge
at-spi2-core 2.35.1 h1369247_0 conda-forge
atk 2.36.0 0 conda-forge
atk-1.0 2.36.0 haf93ef1_0 conda-forge
attrs 19.3.0 py_0 conda-forge
aws-sdk-cpp 1.7.164 hc831370_1 conda-forge
backcall 0.1.0 py_0 conda-forge
beautifulsoup4 4.9.1 py37hc8dfbb8_0 conda-forge
bleach 3.1.5 pyh9f0ad1d_0 conda-forge
blinker 1.4 py_1 conda-forge
blosc 1.18.1 he1b5a44_0 conda-forge
bokeh 2.0.1 py37hc8dfbb8_0 conda-forge
boost-cpp 1.72.0 h8e57a91_0 conda-forge
boto3 1.13.18 pyh9f0ad1d_0 conda-forge
botocore 1.16.18 pyh9f0ad1d_0 conda-forge
brotli 1.0.7 he1b5a44_1002 conda-forge
bzip2 1.0.8 h516909a_2 conda-forge
c-ares 1.15.0 h516909a_1001 conda-forge
ca-certificates 2020.4.5.1 hecc5488_0 conda-forge
cachetools 4.1.0 py_1 conda-forge
cairo 1.16.0 hcf35c78_1003 conda-forge
cartopy 0.18.0 py37h4b180d9_0 conda-forge
certifi 2020.4.5.1 py37hc8dfbb8_0 conda-forge
cffi 1.14.0 py37hd463f26_0 conda-forge
cfitsio 3.470 h3eac812_5 conda-forge
cftime 1.1.3 py37h03ebfcd_0 conda-forge
chardet 3.0.4 py37hc8dfbb8_1006 conda-forge
click 7.1.2 pyh9f0ad1d_0 conda-forge
click-plugins 1.1.1 py_0 conda-forge
cligj 0.5.0 py_0 conda-forge
cloudpickle 1.4.1 py_0 conda-forge
colorcet 2.0.1 py_0 conda-forge
cryptography 2.9.2 py37hb09aad4_0 conda-forge
curl 7.69.1 h33f0ec9_0 conda-forge
cycler 0.10.0 py_2 conda-forge
cytoolz 0.10.1 py37h516909a_0 conda-forge
dask 2.17.2 py_0 conda-forge
dask-core 2.17.2 py_0 conda-forge
dask-glm 0.2.0 py_1 conda-forge
dask-jobqueue 0.7.1 py_0 conda-forge
dask-labextension 2.0.2 py_0 conda-forge
dask-ml 1.5.0 py_0 conda-forge
dask-xgboost 0.1.10 py_0 conda-forge
datashader 0.11.0 pyh9f0ad1d_0 conda-forge
datashape 0.5.4 py_1 conda-forge
dbus 1.13.6 he372182_0 conda-forge
decorator 4.4.2 py_0 conda-forge
defusedxml 0.6.0 py_0 conda-forge
deprecated 1.2.10 pyh9f0ad1d_0 conda-forge
distributed 2.17.0 py37hc8dfbb8_0 conda-forge
docopt 0.6.2 py_1 conda-forge
docutils 0.15.2 py37_0 conda-forge
earthengine-api 0.1.223 pyh9f0ad1d_0 conda-forge
entrypoints 0.3 py37hc8dfbb8_1001 conda-forge
epoxy 1.5.4 h516909a_1 conda-forge
esda 2.2.1 py_0 conda-forge
et_xmlfile 1.0.1 py_1001 conda-forge
expat 2.2.9 he1b5a44_2 conda-forge
fastcache 1.1.0 py37h8f50634_1 conda-forge
fasteners 0.14.1 py_3 conda-forge
fastparquet 0.4.0 py37h03ebfcd_0 conda-forge
fastprogress 0.2.3 py_0 conda-forge
fiona 1.8.13 py37h0492a4a_1 conda-forge
firefox 76.0 he1b5a44_0 conda-forge
fontconfig 2.13.1 h86ecdb6_1001 conda-forge
freetype 2.10.2 he06d7ca_0 conda-forge
freexl 1.0.5 h14c3975_1002 conda-forge
fribidi 1.0.9 h516909a_0 conda-forge
fsspec 0.7.4 py_0 conda-forge
future 0.18.2 py37hc8dfbb8_1 conda-forge
gcsfs 0.6.2 py_0 conda-forge
gdal 3.0.4 py37h4b180d9_6 conda-forge
gdb 8.3.1 py37h497da48_1 conda-forge
gdk-pixbuf 2.38.2 h3f25603_3 conda-forge
geckodriver 0.26.0 he1b5a44_0 conda-forge
geopandas 0.7.0 py_1 conda-forge
geos 3.8.1 he1b5a44_0 conda-forge
geotiff 1.5.1 h05acad5_10 conda-forge
geoviews 1.8.1 py_0 conda-forge
geoviews-core 1.8.1 py_0 conda-forge
gettext 0.19.8.1 hc5be6a0_1002 conda-forge
gflags 2.2.2 he1b5a44_1002 conda-forge
giddy 2.3.0 py_0 conda-forge
giflib 5.2.1 h516909a_2 conda-forge
glib 2.64.3 h6f030ca_0 conda-forge
glog 0.4.0 h49b9bf7_3 conda-forge
gmp 6.2.0 he1b5a44_2 conda-forge
gmpy2 2.1.0b1 py37h04dde30_0 conda-forge
gobject-introspection 1.58.2 py37h619baee_1004 conda-forge
google-api-core 1.17.0 py37hc8dfbb8_0 conda-forge
google-api-python-client 1.8.4 pyh9f0ad1d_0 conda-forge
google-auth 1.14.3 pyh9f0ad1d_0 conda-forge
google-auth-httplib2 0.0.3 py_3 conda-forge
google-auth-oauthlib 0.4.1 py_2 conda-forge
google-cloud-core 1.3.0 py_0 conda-forge
google-cloud-storage 1.28.1 pyh9f0ad1d_0 conda-forge
google-resumable-media 0.5.0 py_1 conda-forge
googleapis-common-protos 1.51.0 py37hc8dfbb8_2 conda-forge
graphite2 1.3.13 he1b5a44_1001 conda-forge
graphviz 2.42.3 h0511662_0 conda-forge
grpc-cpp 1.29.0 h8e748ff_0 conda-forge
gtk3 3.24.14 h45fd312_2 conda-forge
h5netcdf 0.8.0 py_0 conda-forge
h5py 2.10.0 nompi_py37h513d04c_102 conda-forge
harfbuzz 2.4.0 h9f30f68_3 conda-forge
hdf4 4.2.13 hf30be14_1003 conda-forge
hdf5 1.10.5 nompi_h3c11f04_1104 conda-forge
heapdict 1.0.1 py_0 conda-forge
holoviews 1.13.2 pyh9f0ad1d_0 conda-forge
httplib2 0.18.1 pyh9f0ad1d_0 conda-forge
hvplot 0.5.2 py_0 conda-forge
icu 64.2 he1b5a44_1 conda-forge
idna 2.9 py_1 conda-forge
importlib-metadata 1.6.0 py37hc8dfbb8_0 conda-forge
importlib_metadata 1.6.0 0 conda-forge
inequality 1.0.0 py_0 conda-forge
intake 0.5.5 py_0 conda-forge
intake-esm 2020.5.21 py_0 conda-forge
intake-parquet 0.2.3 py_0 conda-forge
intake-sql 0.2.0 py_0 conda-forge
intake-stac 0.2.3 py_0 conda-forge
intake-xarray 0.3.1 py_0 conda-forge
ipykernel 5.3.0 py37h43977f1_0 conda-forge
ipython 7.14.0 py37hc8dfbb8_0 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
ipywidgets 7.5.1 py_0 conda-forge
jdcal 1.4.1 py_0 conda-forge
jedi 0.17.0 py37hc8dfbb8_0 conda-forge
jinja2 2.11.2 pyh9f0ad1d_0 conda-forge
jmespath 0.10.0 pyh9f0ad1d_0 conda-forge
joblib 0.15.1 py_0 conda-forge
jpeg 9c h14c3975_1001 conda-forge
json-c 0.13.1 hbfbb72e_1002 conda-forge
jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge
jupyter-server-proxy 1.5.0 py_0 conda-forge
jupyter_client 6.1.3 py_0 conda-forge
jupyter_core 4.6.3 py37hc8dfbb8_1 conda-forge
kealib 1.4.13 hec59c27_0 conda-forge
kiwisolver 1.2.0 py37h99015e2_0 conda-forge
krb5 1.17.1 h2fd8d38_0 conda-forge
ld_impl_linux-64 2.34 h53a641e_4 conda-forge
libblas 3.8.0 16_openblas conda-forge
libcblas 3.8.0 16_openblas conda-forge
libcups 2.2.12 hf10b501_1 conda-forge
libcurl 7.69.1 hf7181ac_0 conda-forge
libdap4 3.20.6 h1d1bd15_0 conda-forge
libedit 3.1.20170329 hf8c457e_1001 conda-forge
libevent 2.1.10 h72c5cf5_0 conda-forge
libffi 3.2.1 he1b5a44_1007 conda-forge
libgcc-ng 9.2.0 h24d8f2e_2 conda-forge
libgdal 3.0.4 h3dfc09a_6 conda-forge
libgfortran-ng 7.5.0 hdf63c60_6 conda-forge
libiconv 1.15 h516909a_1006 conda-forge
libkml 1.3.0 hb574062_1011 conda-forge
liblapack 3.8.0 16_openblas conda-forge
libllvm8 8.0.1 hc9558a2_0 conda-forge
libnetcdf 4.7.4 nompi_h9f9fd6a_101 conda-forge
libopenblas 0.3.9 h5ec1e0e_0 conda-forge
libpng 1.6.37 hed695b0_1 conda-forge
libpq 12.2 h5513abc_1 conda-forge
libprotobuf 3.11.4 h8b12597_0 conda-forge
libpysal 4.2.2 py_0 conda-forge
libsodium 1.0.17 h516909a_0 conda-forge
libspatialindex 1.9.3 he1b5a44_3 conda-forge
libspatialite 4.3.0a h2482549_1038 conda-forge
libssh2 1.9.0 hab1572f_2 conda-forge
libstdcxx-ng 9.2.0 hdf63c60_2 conda-forge
libtiff 4.1.0 hc7e4089_6 conda-forge
libtool 2.4.6 h14c3975_1002 conda-forge
libuuid 2.32.1 h14c3975_1000 conda-forge
libwebp-base 1.1.0 h516909a_3 conda-forge
libxcb 1.13 h14c3975_1002 conda-forge
libxgboost 1.0.2 he1b5a44_1 conda-forge
libxml2 2.9.10 hee79883_0 conda-forge
libxslt 1.1.33 h31b3aaa_0 conda-forge
llvm-openmp 10.0.0 hc9558a2_0 conda-forge
llvmlite 0.31.0 py37h5202443_1 conda-forge
locket 0.2.0 py_2 conda-forge
lxml 4.5.1 py37he3881c9_0 conda-forge
lz4-c 1.9.2 he1b5a44_1 conda-forge
lzo 2.10 h14c3975_1000 conda-forge
mapclassify 2.2.0 py_0 conda-forge
markdown 3.2.2 py_0 conda-forge
markupsafe 1.1.1 py37h8f50634_1 conda-forge
matplotlib-base 3.2.1 py37h30547a4_0 conda-forge
mechanicalsoup 0.12.0 py_0 conda-forge
metpy 0.12.1 py_0 conda-forge
mgwr 2.1.1 py_0 conda-forge
mistune 0.8.4 py37h8f50634_1001 conda-forge
mock 4.0.2 py37hc8dfbb8_0 conda-forge
monotonic 1.5 py_0 conda-forge
more-itertools 8.3.0 py_0 conda-forge
mpc 1.1.0 h04dde30_1007 conda-forge
mpfr 4.0.2 he80fd80_1 conda-forge
mpi 1.0 openmpi conda-forge
mpi4py 3.0.3 py37hbfacf26_1 conda-forge
mpmath 1.1.0 py_0 conda-forge
msgpack-python 1.0.0 py37h99015e2_1 conda-forge
multidict 4.7.5 py37h8f50634_1 conda-forge
multipledispatch 0.6.0 py_0 conda-forge
munch 2.5.0 py_0 conda-forge
nbconvert 5.6.1 py37hc8dfbb8_1 conda-forge
nbformat 5.0.6 py_0 conda-forge
ncurses 6.1 hf484d3e_1002 conda-forge
netcdf4 1.5.3 nompi_py37hec16513_103 conda-forge
nose 1.3.7 py37hc8dfbb8_1004 conda-forge
notebook 6.0.3 py37hc8dfbb8_0 conda-forge
numba 0.48.0 py37hb3f55d8_0 conda-forge
numcodecs 0.6.4 py37he1b5a44_0 conda-forge
numexpr 2.7.1 py37h0da4684_1 conda-forge
numpy 1.18.4 py37h8960a57_0 conda-forge
oauth2client 4.1.3 py_0 conda-forge
oauthlib 3.0.1 py_0 conda-forge
olefile 0.46 py_0 conda-forge
openjpeg 2.3.1 h981e76c_3 conda-forge
openmpi 4.0.3 hdf1f1ad_1 conda-forge
openpyxl 3.0.3 py_0 conda-forge
openssl 1.1.1g h516909a_0 conda-forge
owslib 0.19.2 py_1 conda-forge
packaging 20.4 pyh9f0ad1d_0 conda-forge
pandas 1.0.3 py37h0da4684_1 conda-forge
pandoc 2.9.2.1 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
panel 0.9.5 py_1 conda-forge
pango 1.42.4 h7062337_4 conda-forge
param 1.9.3 py_0 conda-forge
parquet-cpp 1.5.1 2 conda-forge
parso 0.7.0 pyh9f0ad1d_0 conda-forge
partd 1.1.0 py_0 conda-forge
patsy 0.5.1 py_0 conda-forge
pcre 8.44 he1b5a44_0 conda-forge
pexpect 4.8.0 py37hc8dfbb8_1 conda-forge
phantomjs 2.1.1 1 conda-forge
pickleshare 0.7.5 py37hc8dfbb8_1001 conda-forge
pillow 7.1.2 py37h718be6c_0 conda-forge
pint 0.11 py_1 conda-forge
pip 20.1.1 py_1 conda-forge
pixman 0.38.0 h516909a_1003 conda-forge
pluggy 0.13.1 py37hc8dfbb8_1 conda-forge
pointpats 2.1.0 py_1 conda-forge
pooch 1.1.1 py_0 conda-forge
poppler 0.67.0 h14e79db_8 conda-forge
poppler-data 0.4.9 1 conda-forge
postgresql 12.2 h8573dbc_1 conda-forge
proj 7.0.0 h966b41f_4 conda-forge
prometheus_client 0.8.0 pyh9f0ad1d_0 conda-forge
prompt-toolkit 3.0.5 py_0 conda-forge
protobuf 3.11.4 py37h3340039_1 conda-forge
psutil 5.7.0 py37h8f50634_1 conda-forge
psycopg2 2.8.5 py37hb09aad4_1 conda-forge
pthread-stubs 0.4 h14c3975_1001 conda-forge
ptyprocess 0.6.0 py_1001 conda-forge
py 1.8.1 py_0 conda-forge
py-xgboost 1.0.2 py37hc8dfbb8_1 conda-forge
pyarrow 0.17.1 py37h1234567_3_cpu conda-forge
pyasn1 0.4.8 py_0 conda-forge
pyasn1-modules 0.2.7 py_0 conda-forge
pycparser 2.20 py_0 conda-forge
pyct 0.4.6 py_0 conda-forge
pyct-core 0.4.6 py_0 conda-forge
pydap 3.2.2 py37_1000 conda-forge
pydrive 1.3.1 py_1 conda-forge
pyepsg 0.4.0 py_0 conda-forge
pygments 2.6.1 py_0 conda-forge
pyjwt 1.7.1 py_0 conda-forge
pyopenssl 19.1.0 py_1 conda-forge
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyproj 2.6.1.post1 py37h34dd122_0 conda-forge
pyrsistent 0.16.0 py37h8f50634_0 conda-forge
pysal 2.2.0 py_0 conda-forge
pyshp 2.1.0 py_0 conda-forge
pysocks 1.7.1 py37hc8dfbb8_1 conda-forge
pytables 3.6.1 py37h9f153d1_1 conda-forge
pytest 5.4.2 py37hc8dfbb8_0 conda-forge
python 3.7.6 h8356626_5_cpython conda-forge
python-dateutil 2.7.5 py_0 conda-forge
python_abi 3.7 1_cp37m conda-forge
pytz 2020.1 pyh9f0ad1d_0 conda-forge
pyviz_comms 0.7.4 pyh8c360ce_0 conda-forge
pyyaml 5.3.1 py37h8f50634_0 conda-forge
pyzmq 19.0.1 py37hac76be4_0 conda-forge
quantecon 0.4.7 py37hc8dfbb8_0 conda-forge
rasterio 1.1.4 py37h0492a4a_0 conda-forge
rasterstats 0.14.0 py_0 conda-forge
re2 2020.05.01 he1b5a44_1 conda-forge
readline 8.0 hf8c457e_0 conda-forge
requests 2.23.0 pyh8c360ce_2 conda-forge
requests-oauthlib 1.2.0 py_0 conda-forge
rioxarray 0.0.26 py_0 conda-forge
rsa 4.0 py_0 conda-forge
rtree 0.9.4 py37h8526d28_1 conda-forge
s3fs 0.4.2 py_0 conda-forge
s3transfer 0.3.3 py37hc8dfbb8_1 conda-forge
sat-stac 0.3.3 py_0 conda-forge
scikit-learn 0.23.1 py37h8a51577_0 conda-forge
scipy 1.4.1 py37ha3d9a3c_3 conda-forge
seaborn 0.10.1 py_0 conda-forge
segregation 1.2.0 py_1 conda-forge
selenium 3.141.0 py37h8f50634_1001 conda-forge
send2trash 1.5.0 py_0 conda-forge
setuptools 47.1.0 py37hc8dfbb8_0 conda-forge
shapely 1.7.0 py37hc88ce51_3 conda-forge
simpervisor 0.3 py_1 conda-forge
simplejson 3.17.0 py37h8f50634_1 conda-forge
six 1.15.0 pyh9f0ad1d_0 conda-forge
snappy 1.1.8 he1b5a44_1 conda-forge
snuggs 1.4.7 py_0 conda-forge
sortedcontainers 2.1.0 py_0 conda-forge
soupsieve 2.0.1 py37hc8dfbb8_0 conda-forge
spaghetti 1.5.0 py_0 conda-forge
spectral 0.21 pyh9f0ad1d_1 conda-forge
spglm 1.0.7 py_0 conda-forge
spint 1.0.6 py_0 conda-forge
splot 1.1.3 py_0 conda-forge
spreg 1.1.1 py_0 conda-forge
spvcm 0.3.0 py_0 conda-forge
sqlalchemy 1.3.17 py37h8f50634_0 conda-forge
sqlite 3.30.1 hcee41ef_0 conda-forge
statsmodels 0.11.1 py37h8f50634_1 conda-forge
streamz 0.5.3 pyh9f0ad1d_0 conda-forge
sympy 1.6 py37hc8dfbb8_0 conda-forge
tbb 2020.1 hc9558a2_0 conda-forge
tblib 1.6.0 py_0 conda-forge
terminado 0.8.3 py37hc8dfbb8_1 conda-forge
testpath 0.4.4 py_0 conda-forge
threadpoolctl 2.0.0 pyh5ca1d4c_0 conda-forge
threddsclient 0.4.2 py_0 conda-forge
thrift 0.11.0 py37he1b5a44_1001 conda-forge
thrift-cpp 0.13.0 h62aa4f2_2 conda-forge
tiledb 1.7.7 h8efa9f0_3 conda-forge
tk 8.6.10 hed695b0_0 conda-forge
tobler 0.3.0 py_0 conda-forge
toolz 0.10.0 py_0 conda-forge
tornado 5.1.1 py37h14c3975_1000 conda-forge
tqdm 4.46.0 pyh9f0ad1d_0 conda-forge
traitlets 4.3.3 py37hc8dfbb8_1 conda-forge
typing_extensions 3.7.4.2 py_0 conda-forge
tzcode 2020a h516909a_0 conda-forge
uritemplate 3.0.1 py_0 conda-forge
urllib3 1.24.3 py37_0 conda-forge
wcwidth 0.1.9 pyh9f0ad1d_0 conda-forge
webencodings 0.5.1 py_1 conda-forge
webob 1.8.6 py_0 conda-forge
wheel 0.34.2 py_1 conda-forge
widgetsnbextension 3.5.1 py37_0 conda-forge
wrapt 1.12.1 py37h8f50634_1 conda-forge
xarray 0.15.1 py_0 conda-forge
xerces-c 3.2.2 h8412b87_1004 conda-forge
xgboost 1.0.2 py37h3340039_1 conda-forge
xgeo 1.0 py_0 conda-forge
xorg-kbproto 1.0.7 h14c3975_1002 conda-forge
xorg-libice 1.0.10 h516909a_0 conda-forge
xorg-libsm 1.2.3 h84519dc_1000 conda-forge
xorg-libx11 1.6.9 h516909a_0 conda-forge
xorg-libxau 1.0.9 h14c3975_0 conda-forge
xorg-libxdmcp 1.1.3 h516909a_0 conda-forge
xorg-libxext 1.3.4 h516909a_0 conda-forge
xorg-libxpm 3.5.13 h516909a_0 conda-forge
xorg-libxrender 0.9.10 h516909a_1002 conda-forge
xorg-libxt 1.1.5 h516909a_1003 conda-forge
xorg-renderproto 0.11.1 h14c3975_1002 conda-forge
xorg-xextproto 7.3.0 h14c3975_1002 conda-forge
xorg-xproto 7.0.31 h14c3975_1007 conda-forge
xrviz 0.1.4 py_1 conda-forge
xz 5.2.5 h516909a_0 conda-forge
yaml 0.2.4 h516909a_0 conda-forge
yarl 1.3.0 py37h516909a_1000 conda-forge
zarr 2.4.0 py_0 conda-forge
zeromq 4.3.2 he1b5a44_2 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.1.0 py_0 conda-forge
zlib 1.2.11 h516909a_1006 conda-forge
zstd 1.4.4 h6597ccf_3 conda-forge
Example
Working Example
I am able to access the dashboard with /proxy/8787/status in the dask labextension and at: http://localhost:9999/proxy/8787/status
from dask.distributed import Client, LocalCluster
cluster = LocalCluster()
client = Client(cluster)
client
Failing Example
I am unable to access the dashboard with /proxy/8787/status in the dask labextension. When I try and go to http://localhost:9999/proxy/8787/status I get: [Errno 111] Connection refused
import dask_jobqueue as jq
from dask.distributed import Client
from tqdm.notebook import tqdm
partition='short,brief-low'
num_processes = 2
num_threads_per_processes = 6
mem = 3.2*num_processes*num_threads_per_processes*1.25
n_cores_per_job = num_processes*num_threads_per_processes
container = 'docker://rowangaffney/data_science_im_rs:latest'
env = 'py_geo'
clust = jq.SLURMCluster(queue=partition,
processes=num_processes,
cores=n_cores_per_job,
memory=str(mem)+'GB',
interface='ib0',
local_directory='$TMPDIR',
death_timeout=30,
python="singularity -vv exec {} /opt/conda/envs/{}/bin/python".format(container,env),
walltime='02:00:00',
job_extra=["--output=/dev/null","--error=/dev/null"])
cl=Client(clust)
clust.scale(n=2*num_processes)
with tqdm(total=2*num_processes) as pbar:
while (((cl.status == "running") and (len(cl.scheduler_info()["workers"]) < .9*2*num_processes))):
pbar.update(len(cl.scheduler_info()["workers"])-pbar.n)
pbar.update(len(cl.scheduler_info()["workers"])-pbar.n)
cl
Tagging @ynanyam as he can provide more details about HPC setup if needed.
Thanks!
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Comments: 18 (16 by maintainers)
It should be fixed with dask 2.20, do reopen if that’s not the case.
@rmg55, I recently ran into a similar issue and I tried different bokeh+dask+distributed combination and I couldn’t get it to work until I pinned dask, distributed, and bokeh to the following versions: