Jupyter Server Notes 2021

[Zsailer]

Hello everyone,

Welcome to the Jupyter Server Team!

You can find us in our Gitter chat room or visit us at our weekly meetings!

We meet on Thursdays at 8:00am, Pacific Standard Time on Jupyter's Zoom Channel. You can add yourself to the weekly agenda here. Everyone is welcome!

Let's avoid using this thread for discussion. If you'd like to discuss something in the minutes, open a separate issue and reference this thread.

Meeting Notes

• December 16th, 2021
• December 9th, 2021
• December 2nd, 2021
• November 25th, 2021—cancelled
• November 18th, 2021
• November 11th, 2021
• November 4th, 2021
• October 28th, 2021
• October 21st, 2021
• October 14th, 2021
• October 7th, 2021
• September 30th, 2021
• September 23rd, 2021
• September 16th, 2021
• September 9th, 2021
• September 2nd, 2021
• August 26th, 2021
• August 19th, 2021
• August 12th, 2021
• August 5th, 2021
• July 29th, 2021
• July 22nd, 2021
• July 15th, 2021
• July 8th, 2021 - cancelled
• July 1st, 2021
• June 24th, 2021
• June 17th, 2021
• June 10th, 2021 - cancelled
• June 3rd, 2021
• May 27th, 2021
• May 20th — cancelled
• May 13th, 2021
• May 6th, 2021
• April 29th, 2021
• April 22nd, 2021
• April 15th, 2021
• April 8th, 2021
• April 1st, 2021
• March 25th, 2021 — cancelled
• March 18th, 2021
• March 11th, 2021
• March 4th, 2021
• February 25th, 2021
• February 18th, 2021
• February 11th, 2021
• February 4th, 2021
• January 28th, 2021
• January 21st, 2021
• January 14th, 2021
• January 7th, 2021

[Zsailer]

January 7th, 2021

Attendees

Name	affiliation	username
Kevin Bates	IBM	@kevin-bates
Zach Sailer	Apple	@Zsailer
Vidar T Fauske	JP Morgan Chase	@vidartf
Steven Silvester	Apple	@blink1073
Afshin T. Darian	Two Sigma	@afshin

Agenda + Minutes

• The pytest-jupyter repo - archive or clarify purpose?
  • Include LICENSE file in package pytest-jupyter#10
  • Archived the Github repo
    • Add archived message to README in repo.
  • What do we do about the PyPI package?
    • Looks like we can delete from PyPI
    • Can we archive or deprecate?
• New year, new list of meeting notes
  • Jupyter Server Notes 2021 #4
  • Let's leave the 2020 Notes issue pinned until the end of the month.
• Name a core Jupyter Server Team
  • Name a core Jupyter Server Team. #5
• pytest-tornasync conflicts with pytest-tornado
  • Alex tried to use Jupyter server's pytest plugin with nbdime, nbdime uses pytest-tornado, which just caused test to fail: Update to Jupyterlab 3.0 jupyter/nbdime#551 (comment)

    def jp_http_port(http_server_port):
    E fixture 'http_server_port' not found

• The dreaded open_browser trait
  • Handle open_browser trait in ServerApp and ExtensionApp differently jupyter_server#375
• Released Jupyter Server 1.2.0
• Add a repo for supplying MathJax resources (?)
  • What should the name of this repo be?
    • jupyter_server_mathjax

[Zsailer]

January 14th, 2021

Attendees

Name	affiliation	username
Kevin Bates	IBM	@kevin-bates
Zach Sailer	Apple	@Zsailer
Vidar T Fauske	JP Morgan Chase	@vidartf
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• Vidar:

  • https://github.com/jupyter-server/jupyter_server_mathjax
  • branch with traits. Is the mixin mattern the best way to add these trais config object? https://github.com/jupyter-server/jupyter_server_mathjax/blob/traits-mixin/jupyter_server_mathjax/traits.py

• Kevin:

  • Building Enterprise Gateway on server.
    • Finding a couple async-related issues in the session handler - will submit a PR today.
  • Authoring Kernel Environment Provisioning proposal for jupyter_client

[Zsailer]

January 21st, 2021

Attendees

Name	affiliation	username
Zach Sailer	Apple	@Zsailer
Pierre-Olivier Simonard	ioapps.io / Quansight	@pierrotsmnrd
Kevin Bates	IBM	@kevin-bates
Vidar T Fauske	JP Morgan Chase	@vidartf
Gonzalo Peña-Castellanos	Quansight	@goanpeca
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• Port jupyter/notebook#5941—enable support for answer_yes flag
• Pull Request #391 to add session management into Jupyter Server ( [name=Pierre] )
  • Fantastic demo from Pierre; thanks to @echarles for opening the PR!
  • There was some concern about the torndsession dependency. It hasn't been maintained much in the last few years.
  • There was also some concern around whether sessions for multi-user experience pose security risks. Perhaps this should only be used with a fully trusted group of users.
• Kernel Environment Provisioning Proposal; thank you, @kevin-bates!
  • [PROPOSAL] Kernel Provisioning jupyter/jupyter_client#608
  • If people have time this next week, please take a look at this proposal.
• Enable notebook ContentsManager subclasses in jupyter_server
  • Enable notebook ContentsManager in jupyter_server jupyter_server#392
  • And the mirror of this in 'notebook' package:
    • Allow jupyter_server-based contents managers in notebook jupyter/notebook#5957
• Re-enable default_url in ExtensionApps
  • Re-enable default_url in ExtensionApp jupyter_server#393

[Zsailer]

January 28th, 2021

Attendees

Name	affiliation	username
Zach Sailer	Apple	@Zsailer
Afshin T. Darian	Two Sigma	@afshin
Kevin Bates	IBM	@kevin-bates
Vidar T Fauske	JP Morgan Chase	@vidartf

Agenda + Minutes

• Failing tests on Windows, Python 3.6

  • Noticed in this PR: Enable notebook ContentsManager in jupyter_server jupyter_server#392
  • The underlying issue still hasn't been resolved.
    • Issue appears to be a race condition exposed by slower logging.
    • Updates will be posted when more is known.

• ExtensionApp not compatible with extending ServerApp?

  • Issue: ExtensionApp not compatible with extending ServerApp jupyter_server#395
  • Why doesn't ExtensionApp subclass ServerApp?
    • Jupyter Server is meant to be a headless server.
    • All extensions are equal in the eyes of Jupyter Server.
    • Today versus previously:
      • Previously, extensions (e.g. LabApp from JupyterLab) extended the server two different ways based on how it were launched:
        1. The extension module could include an extension application class (e.g. LabApp); it subclassed the server application. If the extension was launched through its entrypoint, this extension application class was used.
           • The result is something like, LabApp(ServerApp).
        2. Alteratively, if the server application was launched and the extension was enabled, the extension application was not used; rather, just the the handler appending and config loaded.
           • The result is something like ServerApp + "separate logic to appending handlers and load Lab specific config".
      • Today, extensions offers a single, consistent way to extend the server:
        1. Initialize the ServerApp, then initialize all ExtensionApps. Configure the server to decide which extension is the default.
           • The result is always, ServerApp + ExtensionApp(s)
           • ServerApp has an extension_manager; ExtensionApps have a serverapp property.
           • ExtensionApps do have a launch_instance method. This is simply a shortcut to automatically configure and initialize a ServerApp. This allows ExtensionApps to behave like a server application, but not drastically change how they extend the server.
    • In the previous approach, one extension was elevated above the rest—the one that subclasses the server application.
    • Today, all extensions are handled the same.
      • This makes it cleaner to run a single Jupyter Server with e.g. nbclassic, jupyterlab, voila, etc. side-by-side.
      • ExtensionApps are not, themselves, server applications.
        • Their traits and methods are self encapsulated in their own class
        • They should be able to affect the core server application and append handlers.
  • What's the best way to extend Jupyter Server? (e.g. like JupyterHub which spawns server subclasses with auth patched-in)?
    • Subclass ServerApp, not ExtensionApps.
    • To choose a specific frontend application as the default,
      1. enable the extension, e.g. put jpserver_extensions={"jupyterlab": True} somewhere.
      2. set the server applications default_url to the extension's endpoint, e.g. ServerApp.default_url="/lab"

• Review Issues:

  • Jupyter Server repo name: Repository name jupyter_server#356
    • Discussed not to change the name so that it matches the Python package name.
  • Have web.authenticated be the default: Have handlers be @web.authenticated by default ? jupyter_server#389
    • This might be too invasive of a change, but the principal is sound in general.
    • Alternative approach:
      • Add method in ServerApp that checks whether handlers are authenticated.
      • Add trait (and flag) in ServerApp to warn, exclude, modify, or allow handlers that are not authenticated. The default is allow, to keep backwards compatibility.

[kevin-bates]

February 4th, 2021

Attendees

Name	affiliation	username
Kevin Bates	IBM	@kevin-bates
Vidar Fauske	JPMorgan	@vidartf
Zach Sailer	Apple	@Zsailer
Steve Silvester	Apple	@blink1073
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• Some mapping kernel manager issues:
  • MappingKernelManager.restart_kernel should pass through "now" keyword jupyter_server#402
  • MappingKernelManager.start_kernel should use kernel_id for new kernel if it doesn't exist jupyter_server#403
• Tests problems and questions
  • Move tests module into the jupyter_server package?
  • Cross package integration testing
• Release Jupyter Server 1.3.0 today.
  • Switch to AsyncKernelManager
  • Improvements to ExtensionApp

[Zsailer]

February 11th, 2021

Attendees

Name	affiliation	username
Zach Sailer	Apple	@Zsailer
Vidar T Fauske	JP Morgan Chase	@vidartf
Kevin Bates	IBM	@kevin-bates
Pierre-Olivier Simonard	Quansight / ioapps	@pierrotsmnrd
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• file_to_run trait is broken: Open a file from command line jupyterlab/jupyterlab#8959
  • ServerApp and ExtensionApp need a new trait, file_url_prefix.
    • this trait tells the server what url-prefix it should use to open a file directly.
    • nbclassic uses /notebook
    • jupyterlab uses /doc
  • this uncovered some issues with file_to_run + root_dir. If these paths are incompatible, i.e. live on different branches of the filesystem, there is no helpful warnings/checks.
• Content-based modification detection:
  • Check file changes based on content instead of the last_modified metadata jupyter_server#409
  • Given adding a checksum to the model would be considered a version change, we felt it best to let this play out on the client (lab) side at this time.

[Zsailer]

February 18th, 2021

Attendees

Name	affiliation	username
Kevin Bates	IBM	@kevin-bates
Zach Sailer	Apple	@Zsailer
Carol Willing	Noteable	willingc
Pierre-Olivier Simonard	ioapps.io / Quansight	@pierrotsmnrd
Steven Silvester	Apple	@blink1073
Sylvain Corlay	QuantStack	@SylvainCorlay
Eric Charles	Datalayer / Quansight	@echarles
Vidar T Fauske	JP Morgan Chase	@vidartf
Jason Grout	Bloomberg	@jasongrout
A. T. Darian	Two Sigma	@afshin
Jeremy Tuloup	QuantStack	@jtpio

Agenda + Minutes

• Dependabot security alert on resource usage repo
  • marked dependency [Should be removed from minutes ?]
  • Jeremy: Should be fixed by: Update to JupyterLab 3.0 final packages jupyter-resource-usage#87
• jupyter_server_mathjax release 🎉
• Open PRs:
  • Tests moved into package: Add Tests to Distribution jupyter_server#416
    • Note If I can't put pytest_plugins in my conftest.py, where do I put it? pytest-dev/pytest#4039
  • Emit warning for load_jupyter_server_extension: Emit deprecation warning on old name jupyter_server#411
  • Track only this server's kernels: [Gateway] Track only this server's kernels jupyter_server#407
• Jupyter Server architecture variants (looking ahead to RTC).
  • Illustrations by @echarles
    
    
    
    
    

[Zsailer]

February 25th, 2021

Attendees

Name	affiliation	username
Vidar T Fauske	JP Morgan Chase	@vidartf
Zach Sailer	Apple	@Zsailer
Pierre-Olivier Simonard	ioapps.io / Quansight	@pierrotsmnrd
A. T. Darian	Two Sigma	@afshin
Mariko Wakabayashi	Twitter	@mwakaba2
Kevin Bates	IBM	@kevin-bates
Steven Silvester	Apple	@blink1073
Sylvain Corlay	QuantStack	@SylvainCorlay

Agenda + Minutes

• Change translation function alias
  • Change translation function alias jupyter_server#424
  • Question: will adding a deprecating warning raise a flood of warnings.
    • No, this is a 1-time warning.
  • Merging away!
• Unable to open a kernel if HTTP PATCH request is blocked by proxy
  • Unable to open a kernel if HTTP PATCH request is blocked by proxy jupyter_server#430
  • Why was this not an issue in Jupyter Lab 2.x?
    • PATCH requests were still made when updating sessions in JupyterLab.
    • Let's track down this change in JLab and post it on the issue for reference.
  • Falling back to GET/POST requests is a major change to Jupyter REST API
    • It would require a JEP.
    • Clients that want to support this change also need to handle this.
    • Is this common enough problem to warrant such a change?
      • For now, it makes the most sense to wait and see if this issue appears repeatedly before launching such a wide scale change.
• jupyter/telemetry: nested category filtering
  • Categories filtering for nested properties jupyter/telemetry#59
  • Looking for reviewers on the Jupyter telemetry repository.
  • Please reach out, or come to the weekly Jupyter Server meetings, if you're interested.

[Zsailer]

March 4th, 2021

Attendees

Name	affiliation	username
Zach Sailer	Apple	@Zsailer
Kevin Bates	IBM	@kevin-bates
Vidar T Fauske	JP Morgan Chase	@vidartf
Jeremy Tuloup	QuantStack	@jtpio
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• PATCH request change between JLab 2 and 3.
  • Unable to open a kernel if HTTP PATCH request is blocked by proxy jupyter_server#430
• terminals excluded from activity monitoring #432
  • Need to bring over a couple NB PRs
• jupyter_server-related issues are showing up on notebook repo.
  • We should port these to jupyter_server
  • Here's an easy issue filter link for ServerApp.
  • Can MeeseeksBot do the porting? Yup!

[blink1073]

March 11th, 2021

Attendees

Name	affiliation	username
Zach Sailer	Apple	@Zsailer
Vidar T Fauske	JP Morgan Chase	@vidartf
Kevin Bates	IBM	@kevin-bates
Steven Silvester	Apple	@blink1073
Afshin Darian	Two Sigma	@afshin

Agenda + Minutes

• Daylight savings time. Which TZ is the time linked to? 😃
• Updated/updating the notebook port list
  • Running list of Notebook PRs to port.  jupyter_server#110
• Improved automated publishing and packaging work in progress
  • leverage Github Actions to:
    • generate a changelog
    • generate a (draft) Github release that contains the tar/wheel files
  • changes to jupyter-packaging
    • thin layer on top of setuptools
    • new build backend that adds a pre-build step to pyproject.toml to build jupyter-like packages, i.e. includes an NPM builder before building the python package.
    • can use entrypoints instead of data_files
      • data_files still work, but we'll drop support for using data_files in develop mode.
      • static JS assets found using entrypoints

[blink1073]

March 18th, 2021

Attendess

Name	affiliation	username
Steven Silvester	Apple	@blink1073
Kevin Bates	IBM	@kevin-bates
A. T. Darian	Two Sigma	@afshin

Agenda + Minutes

• Current discussions for Realtime Collaboration on Authentication/Authorization across JupyerLab, Jupyter Server and JupyterHub
  • Alpha design document for Authentication will be discussed at next RTC meeting on Monday (meeting details on https://github.com/jupyterlab/rtc)
  • Same message will be posted at the today JupyterHub meeting (https://hackmd.io/YpwhVwbSSpCG19I0JNpqjQ)
• Packaging PR: Proposal: Improved integration with setuptools jupyter/jupyter-packaging#69
  • Should we offer specific functions?
    • wrap_cmdclass(pre_develop=None, pre_sdist=None, ....)
      • pre_develop, pre_sdist, pre_wheel
      • post_develop, post_sdist, post_wheel
• Code Scan: Recent code scans are flagging an issue in extension example code jupyter_server#447
  • PR: Escape user input in handlers flagged during code scans jupyter_server#449
  • Set up on fork? https://docs.github.com/en/github/finding-security-vulnerabilities-and-errors-in-your-code/configuring-code-scanning
• Password check: Make passwd and passwd_check compatible with jupyter notebook jupyter_server#448
  • Detect notebook password and use if server password is not set
  • Show a warning if we use the notebook password
• Notebook 6.3 - Go ahead an cut one - start with a changelog PR
• Add schema for allowable API? Break up and make add_handlers overrideable jupyterlab/jupyterlab_server#167
  • In conjunction with a list of allowed server extensions, a schema for allowed routes sounds like a reasonable solution. This would allow an application to be secure without relying on an external service.