hvplot: hvplot.image() zoom causes axes limits to bounce around

Thanks for contacting us! Please read and follow these instructions carefully, then delete this introductory text to keep your issue easy to read. Note that the issue tracker is NOT the place for usage questions and technical assistance; post those at Discourse instead. Issues without the required information below may be closed immediately.

ALL software version info

hvplot 0.5.2 bokeh 2.0.1

Description of expected behavior and the observed behavior

Plotting image results in axes and colorbar limits jumping around. A zoom box draw partially outside valid pixels of image causes further jumping around of axes limits.

Complete, minimal, self-contained example code that reproduces the issue

https://gist.github.com/scottyhq/0e245fcd62d8a46b82a4186fcd8945e6#file-hvplot-zoom-ipynb

# Lots of window and colorbar rescaling happening when first plot, and upon zooming
band1.hvplot.image(x='x',y='y',
                   crs='epsg:32645', 
                   tiles='OSM', 
                   rasterize=True,
                   width=700, height=500, 
                   cmap='plasma', 
                   logz=True,
                   alpha=0.7)

Stack traceback and/or browser JavaScript console output

No error or traceback, but the behavior is buggy. See gif:

Screenshots or screencasts of the bug in action