Skip to content

Conversation

@krishnan-r
Copy link
Contributor

@krishnan-r krishnan-r commented Apr 13, 2022

  • Removes the kernel extension in favor of a simple python module that is invoked before starting the SparkSession.

  • This avoids injecting a variable into the user namespace, and fixes race conditions with restarting the kernel

  • For SWAN this would mean that instead of installing a kernelextension, we add a step to the sparkconnector to configure the monitor and connect the kernel to the frontend (potentially here)

TODO

  • Handle reloading the browser
  • Potentially refactor the cell<->job matching so that messages can be buffered if frontend is unavailable

Related to #7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants