-
Notifications
You must be signed in to change notification settings - Fork 134
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remote spawned server running but ... waiting to connect #250
Conversation
…of the HTTPRequest call
Thanks for submitting your first pull request! You are awesome! 🤗 |
for more information, see https://pre-commit.ci
Just spent the whole day chasing this down. With my sons help. Seeing if this fixes the issues for me :) |
This totally fixes the issue for SlurmSpawner too... I was going nuts chasing this down as well! Installed latest jupyterhub, batchspawner from conda-forge. Versions from
|
Thank you @rp2927 @jbeal-work @curtywang for working this, the equivalent fix from #247 will be part of version 1.3.0 I'm preparing to get released. |
Pleased to help.
Best,
Razvan
…--
Razvan N. Popescu
Research Computing Director
Office: (212) 851-9298
***@***.******@***.***>
Columbia Business School
At the Very Center of Business
From: Erik Sundell ***@***.***>
Date: Saturday, March 16, 2024 at 8:06 AM
To: jupyterhub/batchspawner ***@***.***>
Cc: Popescu, Razvan ***@***.***>, Mention ***@***.***>
Subject: Re: [jupyterhub/batchspawner] Remote spawned server running but ... waiting to connect (PR #250)
Thank you @rp2927<https://github.com/rp2927> @jbeal-work<https://github.com/jbeal-work> @curtywang<https://github.com/curtywang> for working this, the equivalent fix from #247<#247> will be part of version 1.3.0 I'm preparing to get released.
—
Reply to this email directly, view it on GitHub<#250 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/A35PBA6YXKFWPMEUJAO7JPLYYQYTFAVCNFSM6AAAAAASDZ3TNWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBRHE3DMMBSGE>.
You are receiving this because you were mentioned.Message ID: ***@***.***>
|
JupyterHub vers. 3.0.0 (python 3.9.7) -- Batchspawner for GridEngine successfully submits the remote server task, the job starts and binds to a reachable port, the Hub acknowledges the running job, but reports "...waiting to connect" and remains this way until (300sec) timeout (then successfully deletes the running job).
Turns out the Hub never receives the random port number generated in the /barchspawner/singleuser.py, run by the spawned job, because the _api_request method was never awaited (a discrete warning is posted in the spawner log).
This suggested fix adds a proper call to the now _api_request async method, and also changes the payload format to match the expected HTTPRequest arguments.