Render stored Matplotlib png output as a fallback when opening a notebook

[asteppke]

Actual behaviour

With the current ipympl and using %matplotlib widget as a backend VS code can render this example without issues:

%matplotlib widget

from matplotlib import pyplot as plt

fig, ax = plt.subplots()
ax.plot([0,1,2], [2,3,4] ,"o-")

Though, when saving and reloading the notebook file no image is shown (although a static image is available):

Expected behaviour

The small </> icon on the left allows to change the mimetype representation. When this is changed manually to png the alternative widget representation that was previously saved is shown correctly:

So VS code does not recognize that without a running/current widget available that the png static representation should be shown instead.

Environment data

• VS Code version: 1.63.2
• Jupyter Extension version v2021.11.1001550889
• Python Extension version v2021.12.1559732655
• OS (Windows | Mac | Linux distro) and version: Windows 10
• Python and/or Anaconda version: 3.9.9
• Type of virtual environment used (N/A | venv | virtualenv | conda | ...): conda
• Jupyter server running: Local

[martinRenou]

See jupyter/notebook#6181 for the approach we took in Jupyter Notebook: do a try/catch of the mimetype rendering logic, so that if the mimetype renderer fails to render, we fallback to another available mimetype.

[rchiodo]

Thanks for the bug. VS code doesn't allow for a fallback mimetype. On reload it just uses the widget data as that's what was selected before.

We don't support reloading widgets at the moment (see this bug for more info: #5424 (comment))

[DonJayamanne]

Solution

• When loading nb without widget state give pref to other mime types
• When executing a cell, use current mime type priority setting