plotly.py: Latex not working in jupyter notebook v7.

I recently upgraded to jupyter notebook v7 and I noticed that some plotly plots that previously rendered flawlessly now fail to render. I get the following output:

After some exploration I found out that it comes from an error using MathJax in jupyterlab-plotly. It tries to access MathJax.config.startup.output, but MathJax.config.startup is undefined.

It is very easy to reproduce this error:

• Create a new python environment (I tried with python 3.8).
• pip install jupyter plotly
• Open a jupyter notebook with jupyter notebook.
• Run a cell with the following code:

from plotly.graph_objects import Figure

Figure().update_layout(title="$Title$")