[Remote-SSH Bug]: Can't establish connection error on 0.114.x when using ProxyCommand via gateway server

[rjp23]

Is there an existing issue for this bug?

• I have searched the existing issues

Required Troubleshooting Steps

• I have followed these troubleshooting steps
• I have tried both values of the remote.SSH.useLocalServer setting

Connect Locally

It doesn’t connect successfully (different error message)

->

Connection hangs at this stage when running command locally

debug1: Authenticator provider $SSH_SK_PROVIDER did not resolve; disabling
debug1: auto-mux: Trying existing master at '/tmp/ssh-socket-username@server_name-22'
debug1: Requesting forwarding of dynamic forward LOCALHOST:50115 -> *
debug1: mux_client_request_session: master session id: 21

When trying to connect via extension, the error is that "could not establish a connection".

Expected Behavior

On version 0.113.1 a connection is established fine but this fails on 0.114.x

Steps To Reproduce

Running on macOS, Sonoma 14.6.1 with VSCode 1.93.1 (Universal).

In version 0.113.1 of Remote-SSH extension, everything works fine. When upgrading to an version 0.114.x, I get an error that I can not establish a connection. This is fully reproducable across different machines.

SSH config setup is below. I am proxying through a login gateway server to end up on one of it's nodes.

(I've altered server names below but should still be obvious)

Host server
  HostName login.server
  User username
  IdentityFile ~/.ssh/id_rsa_server 
  ForwardAgent yes
  ControlMaster auto
  ControlPath /tmp/ssh-socket-%r@%h-%p
  ControlPersist 600
  ForwardX11 yes
  ServerAliveInterval 30

Host node.server
  User username
  IdentityFile ~/.ssh/id_rsa_server
  ForwardAgent yes
  ProxyCommand ssh -Y server -W %h:%p
  ControlMaster auto
  ControlPath /tmp/ssh-socket-%r@%h-%p
  ControlPersist 600
  ForwardX11 yes
  ServerAliveInterval 30

Remote-SSH Log

Remote-SSH Log

[21:09:56.985] Log Level: 2
[21:09:56.993] SSH Resolver called for "ssh-remote+node.server", attempt 1
[21:09:56.993] "remote.SSH.useLocalServer": true
[21:09:56.993] "remote.SSH.useExecServer": true
[21:09:56.993] "remote.SSH.path": undefined
[21:09:56.993] "remote.SSH.configFile": undefined
[21:09:56.993] "remote.SSH.useFlock": true
[21:09:56.993] "remote.SSH.lockfilesInTmp": false
[21:09:56.993] "remote.SSH.localServerDownload": auto
[21:09:56.993] "remote.SSH.remoteServerListenOnSocket": false
[21:09:56.993] "remote.SSH.showLoginTerminal": false
[21:09:56.993] "remote.SSH.defaultExtensions": []
[21:09:56.993] "remote.SSH.loglevel": 2
[21:09:56.993] "remote.SSH.enableDynamicForwarding": true
[21:09:56.993] "remote.SSH.enableRemoteCommand": false
[21:09:56.993] "remote.SSH.serverPickPortsFromRange": {}
[21:09:56.993] "remote.SSH.serverInstallPath": {}
[21:09:56.993] "remote.SSH.permitPtyAllocation": false
[21:09:56.993] "remote.SSH.preferredLocalPortRange: undefined
[21:09:56.993] "remote.SSH.useCurlAndWgetConfigurationFiles: false
[21:09:56.999] VS Code version: 1.93.1
[21:09:56.999] Remote-SSH version: remote-ssh@0.114.0
[21:09:56.999] darwin arm64
[21:09:57.003] SSH Resolver called for host: node.server
[21:09:57.003] Setting up SSH remote "node.server"
[21:09:57.005] Acquiring local install lock: /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-remote-ssh-1afec7c4-install.lock
[21:09:57.005] Looking for existing server data file at /Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json
[21:09:57.005] No existing data file
[21:09:57.005] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[21:09:57.016] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "c3040495053b",
  "startMarker": "c3040495053b: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "11111a1a-1a1a-1aa1-1a11-11a11a1a1a11",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "c3040495053b:trigger_server_download",
  "getDownloadServerEndTrigger": "c3040495053b:trigger_server_download_end",
  "getProgressDownloading": "c3040495053b%%1%%",
  "getProgressInstalling": "c3040495053b%%2%%"
}
[21:09:57.017] Install and start server if needed
[21:09:57.020] PATH: /usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin
[21:09:57.020] Checking ssh with "ssh -V"
[21:09:57.040] > OpenSSH_9.7p1, LibreSSL 3.3.6

[21:09:57.042] askpass server listening on /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-223f64cc702f107a4fa220da1ae7544f30ac07ad.sock
[21:09:57.042] Spawning local server with {"serverId":1,"ipcHandlePath":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-1f5ac158f3a2e00ce4f2201b6f985de088e73b43.sock","sshCommand":"ssh","sshArgs":["-v","-T","-D","57874","-o","ConnectTimeout=15","node.server"],"serverDataFolderName":".vscode-server","dataFilePath":"/Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json"}
[21:09:57.042] Local server env: {"SSH_AUTH_SOCK":"/private/tmp/com.apple.launchd.m0YWCN33ir/Listeners","SHELL":"/bin/zsh","DISPLAY":"1","ELECTRON_RUN_AS_NODE":"1","SSH_ASKPASS":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/local-server/askpass.sh","VSCODE_SSH_ASKPASS_NODE":"/Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (Plugin).app/Contents/MacOS/Code Helper (Plugin)","VSCODE_SSH_ASKPASS_EXTRA_ARGS":"","VSCODE_SSH_ASKPASS_MAIN":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/askpass-main.js","VSCODE_SSH_ASKPASS_HANDLE":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-223f64cc702f107a4fa220da1ae7544f30ac07ad.sock"}
[21:09:57.043] Spawned 97327
[21:09:57.136] > local-server-1> Running ssh connection command: ssh -v -T -D 57874 -o ConnectTimeout=15 node.server
[21:09:57.137] > local-server-1> Spawned ssh, pid=97330
[21:09:57.140] stderr> OpenSSH_9.7p1, LibreSSL 3.3.6
[21:09:58.857] > ready: c3040495053b
[21:09:58.884] > Linux 3.10.0-1160.119.1.el7.x86_64 #1 SMP Tue Jun 4 14:43:51 UTC 2024
[21:09:58.884] Platform: linux
[21:09:58.914] > /bin/bash
[21:09:58.915] Parent Shell: bash
[21:09:58.915] Parent Shell pid: 97327
[21:09:58.949] > 18422
[21:09:58.949] Waiting for pid of spawned 'sh' subshell: '18422'...
[21:09:58.990] > c3040495053b: running
> Script executing under PID: 18422
[21:09:59.000] > Found existing installation at /home/users/username/.vscode-server...
> Starting VS Code CLI...
> printenv:
[21:09:59.002] >     MANPATH=/usr/man:/usr/share/man:/usr/X11R6/man:/usr/local/man:/usr/local/share/man:/usr/share/lmod/lmod/share/man::/opt/puppetlabs/puppet/share/man
>     XDG_SESSION_ID=2515
>     HOSTNAME=node.server
>     GIT_CEILING_DIRECTORIES=/gws/nopw/j04:/group_workspaces/server4
>     SHELL=/bin/bash
>     HISTSIZE=1000
>     LMOD_ROOT=/usr/share/lmod
>     SSH_CLIENT=130.246.130.29 47458 22
>     MODULEPATH_ROOT=/usr/share/modulefiles
>     LMOD_PACKAGE_PATH=/apps/modulefiles/.lmod
>     CONDA_SHLVL=1
>     CONDA_PROMPT_MODIFIER=(base) 
>     LMOD_PKG=/usr/share/lmod/lmod
>     QTDIR=/usr/lib64/qt-3.3
>     QTINC=/usr/lib64/qt-3.3/include
>     LMOD_VERSION=8.7.20
>     LMOD_ADMIN_FILE=/apps/modulefiles/.lmod/admin.list
>     QT_GRAPHICSSYSTEM_CHECKED=1
>     USER=username
>     LS_COLORS=
>     LMOD_sys=Linux
>     LMOD_MODULERCFILE=/apps/modulefiles/.modulerc.lua
>     CONDA_EXE=/home/users/username/miniconda3/bin/conda
>     SSH_AUTH_SOCK=/tmp/ssh-AsYLR3Nms5/agent.26813
>     HDF5_USE_FILE_LOCKING=FALSE
>     _CE_CONDA=
>     PATH=/home/users/username/miniconda3/bin:/home/users/username/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin:/apps/contrib/metomi/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/bin:/home/users/username/julia/julia-1.5.3/bin
>     MAIL=/var/spool/mail/username
>     CONDA_PREFIX=/home/users/username/miniconda3
>     PWD=/home/users/username
>     LANG=en_GB.UTF-8
>     MODULEPATH=/apps/server/modulefiles:/utils/modulefiles:/apps/modulefiles
>     LMOD_CMD=/usr/share/lmod/lmod/libexec/lmod
>     HISTCONTROL=ignoredups
>     SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
>     _CE_M=
>     HOME=/home/users/username
>     SHLVL=2
>     BASH_ENV=/home/users/username/.bashrc
>     LOGNAME=username
>     CONDA_PYTHON_EXE=/home/users/username/miniconda3/bin/python
>     QTLIB=/usr/lib64/qt-3.3/lib
>     SSH_CONNECTION=130.246.130.29 47458 130.246.130.158 22
>     MODULESHOME=/usr/share/lmod/lmod
>     LESSOPEN=||/usr/bin/lesspipe.sh %s
>     LMOD_SETTARG_FULL_SUPPORT=no
>     CONDA_DEFAULT_ENV=base
>     XDG_RUNTIME_DIR=/run/user/26291
>     LMOD_DIR=/usr/share/lmod/lmod/libexec
>     BASH_FUNC_module()=() {  if [ -z "${LMOD_SH_DBG_ON+x}" ]; then
>      case "$-" in 
>      *v*x*)
>      __lmod_sh_dbg='vx'
>      ;;
>      *v*)
>      __lmod_sh_dbg='v'
>      ;;
>      *x*)
>      __lmod_sh_dbg='x'
>      ;;
>      esac;
>      fi;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      set +$__lmod_sh_dbg;
>      echo "Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output" 1>&2;
>      fi;
>      eval "$($LMOD_CMD shell "$@")" && eval "$(${LMOD_SETTARG_CMD:-:} -s sh)";
>      __lmod_my_status=$?;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      echo "Shell debugging restarted" 1>&2;
>      set -$__lmod_sh_dbg;
>      fi;
>      unset __lmod_sh_dbg;
>      return $__lmod_my_status
>     }
>     BASH_FUNC_ml()=() {  eval "$($LMOD_DIR/ml_cmd "$@")"
>     }
>     _=/usr/bin/printenv
[21:09:59.005] > Removing old logfile at /home/users/username/.vscode-server/.cli.38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40.log
[21:09:59.008] > Spawned remote CLI: 18441
[21:09:59.010] > Waiting for server log...
[21:09:59.045] > Waiting for server log...
[21:09:59.078] > Waiting for server log...
[21:09:59.112] > Waiting for server log...
[21:09:59.145] > Waiting for server log...
[21:09:59.181] > Waiting for server log...
[21:09:59.221] > Waiting for server log...
[21:09:59.253] > Waiting for server log...
[21:09:59.284] > Waiting for server log...
[21:09:59.318] > Waiting for server log...
[21:09:59.352] > Waiting for server log...
[21:09:59.385] > Waiting for server log...
[21:09:59.418] > Waiting for server log...
[21:09:59.451] > Waiting for server log...
[21:09:59.485] > Waiting for server log...
[21:09:59.586] > c3040495053b: start
> listeningOn====
> osReleaseId==centos==
> arch==x86_64==
> vscodeArch==x64==
> bitness==64==
> tmpDir==/run/user/26291==
> platform==linux==
> unpackResult====
> didLocalDownload==0==
> downloadTime====
> installTime====
> serverStartTime==515==
> execServerToken==11111a1a-1a1a-1aa1-1a11-11a11a1a1a11==
> platformDownloadPath==cli-alpine-x64==
> c3040495053b: end
[21:09:59.586] Received install output: 
listeningOn====
osReleaseId==centos==
arch==x86_64==
vscodeArch==x64==
bitness==64==
tmpDir==/run/user/26291==
platform==linux==
unpackResult====
didLocalDownload==0==
downloadTime====
installTime====
serverStartTime==515==
execServerToken==11111a1a-1a1a-1aa1-1a11-11a11a1a1a11==
platformDownloadPath==cli-alpine-x64==

[21:09:59.586] Failed to parse remote port from server output
[21:09:59.586] Terminating local server
[21:09:59.588] Resolver error: Error: 
	at v.Create (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:501404)
	at t.handleInstallOutput (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:498726)
	at e (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:553139)
	at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
	at async /Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:575383
	at async t.withShowDetailsEvent (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:579059)
	at async /Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:549844
	at async T (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:547895)
	at async t.resolveWithLocalServer (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:549384)
	at async k (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:572515)
	at async t.resolve (/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:576470)
	at async /Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/extension.js:2:844816
[21:09:59.589] Local server exit: 15
[21:09:59.591] ------




[21:09:59.988] Opening exec server for ssh-remote+node.server
[21:10:00.071] Opening exec server for ssh-remote+node.server
[21:10:00.138] Acquiring local install lock: /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-remote-ssh-1afec7c4-install.lock
[21:10:00.138] Initizing new exec server for ssh-remote+node.server
[21:10:00.141] Looking for existing server data file at /Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json
[21:10:00.142] No existing data file
[21:10:00.142] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[21:10:00.144] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "a56a3ecdc460",
  "startMarker": "a56a3ecdc460: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "aa1aaa11-aa11-11aa-aa11-aaaa111a1aa1",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "a56a3ecdc460:trigger_server_download",
  "getDownloadServerEndTrigger": "a56a3ecdc460:trigger_server_download_end",
  "getProgressDownloading": "a56a3ecdc460%%1%%",
  "getProgressInstalling": "a56a3ecdc460%%2%%"
}
[21:10:00.145] Install and start server if needed
[21:10:00.153] askpass server listening on /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-1c3dbf01e52dd7544a89d8e9387afe7bbd8911fa.sock
[21:10:00.153] Spawning local server with {"serverId":2,"ipcHandlePath":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-4259a554ca67f348f8fbfdf38933157fd3130d63.sock","sshCommand":"ssh","sshArgs":["-v","-T","-D","57874","-o","ConnectTimeout=15","node.server"],"serverDataFolderName":".vscode-server","dataFilePath":"/Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json"}
[21:10:00.153] Local server env: {"SSH_AUTH_SOCK":"/private/tmp/com.apple.launchd.m0YWCN33ir/Listeners","SHELL":"/bin/zsh","DISPLAY":"1","ELECTRON_RUN_AS_NODE":"1","SSH_ASKPASS":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/local-server/askpass.sh","VSCODE_SSH_ASKPASS_NODE":"/Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (Plugin).app/Contents/MacOS/Code Helper (Plugin)","VSCODE_SSH_ASKPASS_EXTRA_ARGS":"","VSCODE_SSH_ASKPASS_MAIN":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/askpass-main.js","VSCODE_SSH_ASKPASS_HANDLE":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-1c3dbf01e52dd7544a89d8e9387afe7bbd8911fa.sock"}
[21:10:00.154] Spawned 97337
[21:10:00.219] > local-server-2> Running ssh connection command: ssh -v -T -D 57874 -o ConnectTimeout=15 node.server
[21:10:00.220] > local-server-2> Spawned ssh, pid=97340
[21:10:00.224] stderr> OpenSSH_9.7p1, LibreSSL 3.3.6
[21:10:01.977] > ready: a56a3ecdc460
[21:10:02.008] > Linux 3.10.0-1160.119.1.el7.x86_64 #1 SMP Tue Jun 4 14:43:51 UTC 2024
[21:10:02.009] Platform: linux
[21:10:02.037] > /bin/bash
[21:10:02.038] Parent Shell: bash
[21:10:02.038] Parent Shell pid: 97337
[21:10:02.076] > 18686
[21:10:02.076] Waiting for pid of spawned 'sh' subshell: '18686'...
[21:10:02.118] > a56a3ecdc460: running
> Script executing under PID: 18686
[21:10:02.134] > Found existing installation at /home/users/username/.vscode-server...
> Starting VS Code CLI...
> printenv:
>     MANPATH=/usr/man:/usr/share/man:/usr/X11R6/man:/usr/local/man:/usr/local/share/man:/usr/share/lmod/lmod/share/man::/opt/puppetlabs/puppet/share/man
>     XDG_SESSION_ID=2515
>     HOSTNAME=node.server
>     GIT_CEILING_DIRECTORIES=/gws/nopw/j04:/group_workspaces/server4
>     SHELL=/bin/bash
>     HISTSIZE=1000
>     LMOD_ROOT=/usr/share/lmod
>     SSH_CLIENT=130.246.130.29 47458 22
>     MODULEPATH_ROOT=/usr/share/modulefiles
>     LMOD_PACKAGE_PATH=/apps/modulefiles/.lmod
>     CONDA_SHLVL=1
>     CONDA_PROMPT_MODIFIER=(base) 
>     LMOD_PKG=/usr/share/lmod/lmod
>     QTDIR=/usr/lib64/qt-3.3
>     QTINC=/usr/lib64/qt-3.3/include
>     LMOD_VERSION=8.7.20
>     LMOD_ADMIN_FILE=/apps/modulefiles/.lmod/admin.list
>     QT_GRAPHICSSYSTEM_CHECKED=1
>     USER=username
>     LS_COLORS=
>     LMOD_sys=Linux
>     LMOD_MODULERCFILE=/apps/modulefiles/.modulerc.lua
>     CONDA_EXE=/home/users/username/miniconda3/bin/conda
>     SSH_AUTH_SOCK=/tmp/ssh-AsYLR3Nms5/agent.26813
>     HDF5_USE_FILE_LOCKING=FALSE
>     _CE_CONDA=
>     PATH=/home/users/username/miniconda3/bin:/home/users/username/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin:/apps/contrib/metomi/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/bin:/home/users/username/julia/julia-1.5.3/bin
>     MAIL=/var/spool/mail/username
>     CONDA_PREFIX=/home/users/username/miniconda3
>     PWD=/home/users/username
>     LANG=en_GB.UTF-8
>     MODULEPATH=/apps/server/modulefiles:/utils/modulefiles:/apps/modulefiles
>     LMOD_CMD=/usr/share/lmod/lmod/libexec/lmod
>     HISTCONTROL=ignoredups
>     SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
>     _CE_M=
>     HOME=/home/users/username
>     SHLVL=2
>     BASH_ENV=/home/users/username/.bashrc
>     LOGNAME=username
>     CONDA_PYTHON_EXE=/home/users/username/miniconda3/bin/python
>     QTLIB=/usr/lib64/qt-3.3/lib
>     SSH_CONNECTION=130.246.130.29 47458 130.246.130.158 22
>     MODULESHOME=/usr/share/lmod/lmod
>     LESSOPEN=||/usr/bin/lesspipe.sh %s
>     LMOD_SETTARG_FULL_SUPPORT=no
>     CONDA_DEFAULT_ENV=base
>     XDG_RUNTIME_DIR=/run/user/26291
>     LMOD_DIR=/usr/share/lmod/lmod/libexec
>     BASH_FUNC_module()=() {  if [ -z "${LMOD_SH_DBG_ON+x}" ]; then
>      case "$-" in 
>      *v*x*)
>      __lmod_sh_dbg='vx'
>      ;;
>      *v*)
>      __lmod_sh_dbg='v'
>      ;;
>      *x*)
>      __lmod_sh_dbg='x'
>      ;;
>      esac;
>      fi;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      set +$__lmod_sh_dbg;
>      echo "Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output" 1>&2;
>      fi;
>      eval "$($LMOD_CMD shell "$@")" && eval "$(${LMOD_SETTARG_CMD:-:} -s sh)";
>      __lmod_my_status=$?;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      echo "Shell debugging restarted" 1>&2;
>      set -$__lmod_sh_dbg;
>      fi;
>      unset __lmod_sh_dbg;
>      return $__lmod_my_status
>     }
>     BASH_FUNC_ml()=() {  eval "$($LMOD_DIR/ml_cmd "$@")"
>     }
>     _=/usr/bin/printenv
[21:10:02.137] > Removing old logfile at /home/users/username/.vscode-server/.cli.38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40.log
[21:10:02.141] > Spawned remote CLI: 18705
[21:10:02.143] stderr> cat: /home/users/username/.vscode-server/.cli.38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40.log: No such file or directory
[21:10:02.144] > Waiting for server log...
[21:10:02.179] > Waiting for server log...
[21:10:02.215] > Waiting for server log...
[21:10:02.250] > Waiting for server log...
[21:10:02.282] > Waiting for server log...
[21:10:02.318] > Waiting for server log...
[21:10:02.350] > Waiting for server log...
[21:10:02.389] > Waiting for server log...
[21:10:02.421] > Waiting for server log...
[21:10:02.454] > Waiting for server log...
[21:10:02.486] > Waiting for server log...
[21:10:02.520] > Waiting for server log...
[21:10:02.554] > Waiting for server log...
[21:10:02.624] > Waiting for server log...
> Waiting for server log...
[21:10:02.656] > a56a3ecdc460: start
> listeningOn====
> osReleaseId==centos==
> arch==x86_64==
> vscodeArch==x64==
> bitness==64==
> tmpDir==/run/user/26291==
> platform==linux==
> unpackResult====
> didLocalDownload==0==
> downloadTime====
> installTime====
> serverStartTime==519==
> execServerToken==aa1aaa11-aa11-11aa-aa11-aaaa111a1aa1==
> platformDownloadPath==cli-alpine-x64==
> a56a3ecdc460: end
[21:10:02.656] Received install output: 
listeningOn====
osReleaseId==centos==
arch==x86_64==
vscodeArch==x64==
bitness==64==
tmpDir==/run/user/26291==
platform==linux==
unpackResult====
didLocalDownload==0==
downloadTime====
installTime====
serverStartTime==519==
execServerToken==aa1aaa11-aa11-11aa-aa11-aaaa111a1aa1==
platformDownloadPath==cli-alpine-x64==

[21:10:02.657] Failed to parse remote port from server output
[21:10:02.657] Terminating local server
[21:10:02.659] Exec server for ssh-remote+node.server failed: Error
[21:10:02.659] Existing exec server for ssh-remote+node.server errored (Error)
[21:10:02.660] Acquiring local install lock: /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-remote-ssh-1afec7c4-install.lock
[21:10:02.660] Initizing new exec server for ssh-remote+node.server
[21:10:02.660] Error opening exec server for ssh-remote+node.server: Error
[21:10:02.661] Looking for existing server data file at /Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json
[21:10:02.661] No existing data file
[21:10:02.662] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[21:10:02.663] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "8031cfdd6aa2",
  "startMarker": "8031cfdd6aa2: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "1111a111-a1a1-1aa1-a1a1-1a1a11111a1a",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "8031cfdd6aa2:trigger_server_download",
  "getDownloadServerEndTrigger": "8031cfdd6aa2:trigger_server_download_end",
  "getProgressDownloading": "8031cfdd6aa2%%1%%",
  "getProgressInstalling": "8031cfdd6aa2%%2%%"
}
[21:10:02.665] Install and start server if needed
[21:10:02.665] Local server exit: 15
[21:10:02.671] askpass server listening on /var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-d498d0c0be4abd5cb165f46812ca0516af3305c6.sock
[21:10:02.671] Spawning local server with {"serverId":3,"ipcHandlePath":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-fd6c5c7c89c8452027c6bb7f01e00039e17cb409.sock","sshCommand":"ssh","sshArgs":["-v","-T","-D","57874","-o","ConnectTimeout=15","node.server"],"serverDataFolderName":".vscode-server","dataFilePath":"/Users/username/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-1afec7c4-38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40-0.114.0-es/data.json"}
[21:10:02.671] Local server env: {"SSH_AUTH_SOCK":"/private/tmp/com.apple.launchd.m0YWCN33ir/Listeners","SHELL":"/bin/zsh","DISPLAY":"1","ELECTRON_RUN_AS_NODE":"1","SSH_ASKPASS":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/local-server/askpass.sh","VSCODE_SSH_ASKPASS_NODE":"/Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (Plugin).app/Contents/MacOS/Code Helper (Plugin)","VSCODE_SSH_ASKPASS_EXTRA_ARGS":"","VSCODE_SSH_ASKPASS_MAIN":"/Users/username/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.0/out/askpass-main.js","VSCODE_SSH_ASKPASS_HANDLE":"/var/folders/_r/q74jqvq940s94yltpqj4vwl00000zl/T/vscode-ssh-askpass-d498d0c0be4abd5cb165f46812ca0516af3305c6.sock"}
[21:10:02.672] Spawned 97343
[21:10:02.746] > local-server-3> Running ssh connection command: ssh -v -T -D 57874 -o ConnectTimeout=15 node.server
[21:10:02.748] > local-server-3> Spawned ssh, pid=97346
[21:10:02.751] stderr> OpenSSH_9.7p1, LibreSSL 3.3.6
[21:10:04.577] > ready: 8031cfdd6aa2
[21:10:04.613] > Linux 3.10.0-1160.119.1.el7.x86_64 #1 SMP Tue Jun 4 14:43:51 UTC 2024
[21:10:04.613] Platform: linux
[21:10:04.642] > /bin/bash
[21:10:04.643] Parent Shell: bash
[21:10:04.643] Parent Shell pid: 97343
[21:10:04.675] > 19259
[21:10:04.675] Waiting for pid of spawned 'sh' subshell: '19259'...
[21:10:04.809] > 8031cfdd6aa2: running
> Script executing under PID: 19259
> Found existing installation at /home/users/username/.vscode-server...
> Starting VS Code CLI...
> printenv:
[21:10:04.810] >     MANPATH=/usr/man:/usr/share/man:/usr/X11R6/man:/usr/local/man:/usr/local/share/man:/usr/share/lmod/lmod/share/man::/opt/puppetlabs/puppet/share/man
>     XDG_SESSION_ID=2515
>     HOSTNAME=node.server
>     GIT_CEILING_DIRECTORIES=/gws/nopw/j04:/group_workspaces/server4
>     SHELL=/bin/bash
>     HISTSIZE=1000
>     LMOD_ROOT=/usr/share/lmod
>     SSH_CLIENT=130.246.130.29 47458 22
>     MODULEPATH_ROOT=/usr/share/modulefiles
>     LMOD_PACKAGE_PATH=/apps/modulefiles/.lmod
>     CONDA_SHLVL=1
>     CONDA_PROMPT_MODIFIER=(base) 
>     LMOD_PKG=/usr/share/lmod/lmod
>     QTDIR=/usr/lib64/qt-3.3
>     QTINC=/usr/lib64/qt-3.3/include
>     LMOD_VERSION=8.7.20
>     LMOD_ADMIN_FILE=/apps/modulefiles/.lmod/admin.list
>     QT_GRAPHICSSYSTEM_CHECKED=1
>     USER=username
>     LS_COLORS=
>     LMOD_sys=Linux
>     LMOD_MODULERCFILE=/apps/modulefiles/.modulerc.lua
>     CONDA_EXE=/home/users/username/miniconda3/bin/conda
>     SSH_AUTH_SOCK=/tmp/ssh-AsYLR3Nms5/agent.26813
>     HDF5_USE_FILE_LOCKING=FALSE
>     _CE_CONDA=
>     PATH=/home/users/username/miniconda3/bin:/home/users/username/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin:/apps/contrib/metomi/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/julia/julia-1.5.3/bin:/home/users/username/bin:/home/users/username/julia/julia-1.5.3/bin
>     MAIL=/var/spool/mail/username
>     CONDA_PREFIX=/home/users/username/miniconda3
>     PWD=/home/users/username
>     LANG=en_GB.UTF-8
>     MODULEPATH=/apps/server/modulefiles:/utils/modulefiles:/apps/modulefiles
>     LMOD_CMD=/usr/share/lmod/lmod/libexec/lmod
>     HISTCONTROL=ignoredups
>     SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
>     _CE_M=
>     HOME=/home/users/username
>     SHLVL=2
>     BASH_ENV=/home/users/username/.bashrc
>     LOGNAME=username
>     CONDA_PYTHON_EXE=/home/users/username/miniconda3/bin/python
>     QTLIB=/usr/lib64/qt-3.3/lib
>     SSH_CONNECTION=130.246.130.29 47458 130.246.130.158 22
>     MODULESHOME=/usr/share/lmod/lmod
>     LESSOPEN=||/usr/bin/lesspipe.sh %s
>     LMOD_SETTARG_FULL_SUPPORT=no
>     CONDA_DEFAULT_ENV=base
>     XDG_RUNTIME_DIR=/run/user/26291
>     LMOD_DIR=/usr/share/lmod/lmod/libexec
>     BASH_FUNC_module()=() {  if [ -z "${LMOD_SH_DBG_ON+x}" ]; then
>      case "$-" in 
>      *v*x*)
>      __lmod_sh_dbg='vx'
>      ;;
>      *v*)
>      __lmod_sh_dbg='v'
>      ;;
>      *x*)
>      __lmod_sh_dbg='x'
>      ;;
>      esac;
>      fi;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      set +$__lmod_sh_dbg;
>      echo "Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output" 1>&2;
>      fi;
>      eval "$($LMOD_CMD shell "$@")" && eval "$(${LMOD_SETTARG_CMD:-:} -s sh)";
>      __lmod_my_status=$?;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      echo "Shell debugging restarted" 1>&2;
>      set -$__lmod_sh_dbg;
>      fi;
>      unset __lmod_sh_dbg;
>      return $__lmod_my_status
>     }
>     BASH_FUNC_ml()=() {  eval "$($LMOD_DIR/ml_cmd "$@")"
>     }
>     _=/usr/bin/printenv
> Removing old logfile at /home/users/username/.vscode-server/.cli.38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40.log
> Spawned remote CLI: 19279
> Waiting for server log...
> Waiting for server log...
> Waiting for server log...
[21:10:04.835] > Waiting for server log...
[21:10:04.868] > Waiting for server log...
[21:10:04.903] > Waiting for server log...
[21:10:04.936] > Waiting for server log...
[21:10:04.970] > Waiting for server log...
[21:10:05.014] > Waiting for server log...
[21:10:05.115] > Waiting for server log...
> Waiting for server log...
> Waiting for server log...
[21:10:05.142] > Waiting for server log...
[21:10:05.174] > Waiting for server log...
[21:10:05.208] > Waiting for server log...
[21:10:05.321] > 8031cfdd6aa2: start
> listeningOn====
> osReleaseId==centos==
> arch==x86_64==
> vscodeArch==x64==
> bitness==64==
> tmpDir==/run/user/26291==
> platform==linux==
> unpackResult====
> didLocalDownload==0==
> downloadTime====
> installTime====
> serverStartTime==514==
> execServerToken==1111a111-a1a1-1aa1-a1a1-1a1a11111a1a==
> platformDownloadPath==cli-alpine-x64==
> 8031cfdd6aa2: end
[21:10:05.321] Received install output: 
listeningOn====
osReleaseId==centos==
arch==x86_64==
vscodeArch==x64==
bitness==64==
tmpDir==/run/user/26291==
platform==linux==
unpackResult====
didLocalDownload==0==
downloadTime====
installTime====
serverStartTime==514==
execServerToken==1111a111-a1a1-1aa1-a1a1-1a1a11111a1a==
platformDownloadPath==cli-alpine-x64==

[21:10:05.322] Failed to parse remote port from server output
[21:10:05.322] Terminating local server
[21:10:05.325] Exec server for ssh-remote+node.server failed: Error
[21:10:05.326] Error opening exec server for ssh-remote+node.server: Error
[21:10:05.328] Local server exit: 15

Anything else?

No response

[joshspicer]

Thanks for taking the time to open an issue and provide logs.

Could you also share the logs for the remote.SSH.useLocalServer disabled case? That may help me understand the root cause better.

[rjp23]

Thanks! Hope this is useful.

Remote-SSH Log

[10:34:50.968] Log Level: 2
[10:34:50.973] SSH Resolver called for "ssh-remote+node.server", attempt 1
[10:34:50.973] "remote.SSH.useLocalServer": false
[10:34:50.973] "remote.SSH.useExecServer": true
[10:34:50.973] "remote.SSH.showLoginTerminal": true
[10:34:50.973] "remote.SSH.remotePlatform": {}
[10:34:50.973] "remote.SSH.path": undefined
[10:34:50.973] "remote.SSH.configFile": undefined
[10:34:50.973] "remote.SSH.useFlock": true
[10:34:50.973] "remote.SSH.lockfilesInTmp": false
[10:34:50.973] "remote.SSH.localServerDownload": auto
[10:34:50.973] "remote.SSH.remoteServerListenOnSocket": false
[10:34:50.973] "remote.SSH.showLoginTerminal": true
[10:34:50.973] "remote.SSH.defaultExtensions": []
[10:34:50.973] "remote.SSH.loglevel": 2
[10:34:50.973] "remote.SSH.enableDynamicForwarding": true
[10:34:50.973] "remote.SSH.enableRemoteCommand": false
[10:34:50.973] "remote.SSH.serverPickPortsFromRange": {}
[10:34:50.974] "remote.SSH.serverInstallPath": {}
[10:34:50.974] "remote.SSH.permitPtyAllocation": false
[10:34:50.974] "remote.SSH.preferredLocalPortRange: undefined
[10:34:50.974] "remote.SSH.useCurlAndWgetConfigurationFiles: false
[10:34:50.979] VS Code version: 1.93.1
[10:34:50.979] Remote-SSH version: remote-ssh@0.114.3
[10:34:50.979] darwin arm64
[10:34:50.981] SSH Resolver called for host: node.server
[10:34:50.981] Setting up SSH remote "node.server"
[10:34:50.983] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[10:34:50.984] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "c9e48caa2be7",
  "startMarker": "c9e48caa2be7: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "a11aa111-aa1a-1a1a-a111-a11a11a1a1aa",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "c9e48caa2be7:trigger_server_download",
  "getDownloadServerEndTrigger": "c9e48caa2be7:trigger_server_download_end",
  "getProgressDownloading": "c9e48caa2be7%%1%%",
  "getProgressInstalling": "c9e48caa2be7%%2%%"
}
[10:34:50.986] Install and start server if needed
[10:34:56.564] PATH: /Users/rob/.juliaup/bin:/opt/homebrew/bin:/Users/rob/mambaforge/bin:/Users/rob/mambaforge/condabin:/Library/TeX/texbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/Library/Apple/usr/bin:/Library/TeX/texbin:/Applications/Little Snitch.app/Contents/Components
[10:34:56.564] Checking ssh with "ssh -V"
[10:34:56.578] > OpenSSH_9.7p1, LibreSSL 3.3.6

[10:34:56.582] Running script with connection command: ssh -T -D 60925 -o ConnectTimeout=15 'node.server' sh
[10:34:56.582] Generated SSH command: 'ssh -T -D 60925 -o ConnectTimeout=15 'node.server' sh << 'EOSSH'
# shellcheck shell=sh

echo "c9e48caa2be7: running"
echo "Script executing under PID: $$"

VSC_TMP="${XDG_RUNTIME_DIR:-/tmp}"

# Configuration
# set -u  ## TODO: Audit that none of these values can intentionally be empty
UUID="c9e48caa2be7"
COMMIT_ID="38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40"
QUALITY="stable"
TOKEN="f19af152-db3d-4e9d-b681-c36b67f6e3ba"
VSCODE_AGENT_FOLDER="$HOME/.vscode-server"
ALLOW_CLIENT_DOWNLOAD="1"
FORCE_CLIENT_DOWNLOAD="0"
CLI_NAME_IN_ARCHIVE="code"
IGNORE_WGET_CONFIG_FLAG=" --no-config "
IGNORE_CURL_CONFIG_FLAG=" --disable "
WGET_TRIES_SEGMENT="--tries=1"
LISTEN_ARGS="--on-host=127.0.0.1 --on-port"

CLI_NAME_ON_DISK="${CLI_NAME_IN_ARCHIVE}-${COMMIT_ID}"
CLI_PATH="${VSCODE_AGENT_FOLDER}/${CLI_NAME_ON_DISK}"
CLI_LOG_FILE="${VSCODE_AGENT_FOLDER}/.cli.${COMMIT_ID}.log"

# Marker strings
GET_DOWNLOAD_SERVER_START_TRIGGER="c9e48caa2be7:trigger_server_download"
GET_DOWNLOAD_SERVER_END_TRIGGER="c9e48caa2be7:trigger_server_download_end"
GET_PROGRESS_DOWNLOADING="c9e48caa2be7%%1%%"
GET_PROGRESS_INSTALLING="c9e48caa2be7%%2%%"
# set +u ## TODO: See above

UNPACK_RESULT=
DID_LOCAL_DOWNLOAD=0
DOWNLOAD_TIME=
INSTALL_TIME=
SERVER_START_TIME=

fail_with_exitcode() {
	echo "${UUID}: start"
	echo "exitCode==$1=="
	echo_common_results
	echo "${UUID}: end"
	exit 0
}

echo_common_results() {
	echo "listeningOn==$LISTENING_ON=="
	echo "osReleaseId==$OSRELEASEID=="
	echo "arch==$ARCH=="
	echo "vscodeArch==$VSCODE_ARCH=="
	echo "bitness==$BITNESS=="
	echo "tmpDir==$VSC_TMP=="
	echo "platform==$PLATFORM=="
	echo "unpackResult==$UNPACK_RESULT=="
	echo "didLocalDownload==$DID_LOCAL_DOWNLOAD=="
	echo "downloadTime==$DOWNLOAD_TIME=="
	echo "installTime==$INSTALL_TIME=="
	echo "serverStartTime==$SERVER_START_TIME=="
	echo "execServerToken==${TOKEN}=="
	echo "platformDownloadPath==$PLATFORM_DOWNLOAD_PATH=="
}

millis() {
	d=$(date +%s%N)
	# Test if 'd' contains any non-digit characters
	if [ -z "${d##*[!0-9]*}" ] || [ "$PLATFORM" != "linux" ]; then
	    # Fallback for MacOS or any date binary that doesn't handle '%N'
		echo $(($(date +%s)*1000))
		return
	fi
	echo $((d/1000000))
}

elapsed() {
	echo $(($(millis) - $1))
}

if [ ! -d "$VSCODE_AGENT_FOLDER" ]; then
	mkdir -p "$VSCODE_AGENT_FOLDER"

	error_code=$?
	if [ "${error_code}" -gt 0 ]; then
		echo "Creating the server install dir failed..."
		fail_with_exitcode 34
	fi
fi

printenv_indent() {
	echo "printenv:"
	printenv | sed 's/^/    /'
}

#
# Get OS name
#
OSRELEASEID=$(cat /etc/os-release 2>/dev/null | grep -a -E '^ID=' | sed 's/^[Ii][Dd]=//g' | sed 's/"//g')
if [ -z "$OSRELEASEID" ]
then
	OSRELEASEID=$(cat /usr/lib/os-release 2>/dev/null | grep -a -E '^ID=' | sed 's/^[Ii][Dd]=//g' | sed 's/"//g')
	if [ -z "$OSRELEASEID" ]
	then
		OSRELEASEID=$(uname -s)
	fi
fi

#
# Get host platform/architecture
#
UNAME=$(uname -s)
case $UNAME in
	Linux) PLATFORM=linux;;
	Darwin) PLATFORM=macOS;;
	*)
		echo "Unsupported platform: $UNAME"
		fail_with_exitcode 35
		;;
esac

BITNESS=$(getconf LONG_BIT)
ARCH=$(uname -m)
case $ARCH in
	x86_64) VSCODE_ARCH="x64";;
	armv7l | armv8l)
		VSCODE_ARCH="armhf"
		;;
	arm64 | aarch64)
		if [ "$BITNESS" = 32 ]; then
			# Can have 32-bit userland on 64-bit kernel
			VSCODE_ARCH="armhf"
		else
			VSCODE_ARCH="arm64"
		fi
		;;
	*)
		OSRELEASE=$(uname -r)
		case $OSRELEASE in
			*x86_64*) VSCODE_ARCH="x64";;
			*)
				echo "Unsupported architecture: $ARCH"
				fail_with_exitcode 27
			;;
		esac
		;;
esac

if [ "$PLATFORM" = linux ]; then
	if [ "$VSCODE_ARCH" = armhf ]; then
		PLATFORM_DOWNLOAD_PATH=cli-linux-armhf
	else
		PLATFORM_DOWNLOAD_PATH=cli-alpine-$VSCODE_ARCH
	fi
elif [ "$VSCODE_ARCH" = "arm64" ]; then
	PLATFORM_DOWNLOAD_PATH=cli-darwin-arm64
else
	PLATFORM_DOWNLOAD_PATH=cli-darwin-x64
fi

#
# Delete old CLIs if needed
#

# shellcheck disable=SC2010
TO_DELETE=$(ls -1 -t "$VSCODE_AGENT_FOLDER" | grep -E "code(-insiders)?-[a-fA-F0-9]{40}" | tail -n +6)
for CLI_TO_DELETE in $TO_DELETE; do
	target_dir="$VSCODE_AGENT_FOLDER/$CLI_TO_DELETE"
	echo "Deleting old install $target_dir"
	rm -rf "$target_dir"
done

do_client_download() {
	DID_LOCAL_DOWNLOAD=1
	echo "Trigger local server download"
	echo "${GET_DOWNLOAD_SERVER_START_TRIGGER}"
	echo artifact==$PLATFORM_DOWNLOAD_PATH==
	echo destFolder==$VSCODE_AGENT_FOLDER==
	echo destFolder2==/vscode-cli-$COMMIT_ID.tar.gz==
	echo "${GET_DOWNLOAD_SERVER_END_TRIGGER}"
	echo "Waiting for client to transfer server archive..."
	echo "Waiting for $VSCODE_AGENT_FOLDER/vscode-cli-$COMMIT_ID.tar.gz.done and vscode-server.tar.gz to exist"

	while true; do
		if [ -f "$VSCODE_AGENT_FOLDER/vscode-cli-$COMMIT_ID.tar.gz.done" ]; then
			if [ ! -f "$VSCODE_AGENT_FOLDER/vscode-cli-$COMMIT_ID.tar.gz" ]; then
				echo "Found flag but not server tar - server transfer failed"
				fail_with_exitcode 31
			fi

			echo "Found flag and server on host"
			rm "$VSCODE_AGENT_FOLDER/vscode-cli-$COMMIT_ID.tar.gz.done"
			break
		else
			printf ' '
			sleep 3
		fi
	done
}

do_client_download_or_fail() {
	error_code="${1:-"1"}"
	if [ "$DID_LOCAL_DOWNLOAD" = "1" ]; then
		echo "Already attempted local download, failing"
		fail_with_exitcode "$error_code"
	elif [ $ALLOW_CLIENT_DOWNLOAD = "1" ]; then
		do_client_download
	else
		fail_with_exitcode "$error_code"
	fi
}

is_program_from_busybox() {
	program=$1
	if command -v busybox > /dev/null 2>&1
	then
		# Check symlink from program to busybox
		if [ -L "$(command -v "$program")" ] && [ "$(readlink -f "$(command -v "$program")")" = "$(command -v busybox)" ]
		then
			echo "Program '$program' is provided by busybox" >&2
			echo 'yes'
			return
		fi
	fi
	echo 'no'
}

supports_flag() {
    program="$1"
    flag="$2"

    if command -v "$program" > /dev/null 2>&1; then
        if "$program" --help 2>&1 | grep -q -- "$flag"
		then
			echo "Program '$program' appears to support flag '$flag'" >&2
			echo 'yes'
			return
		fi
    fi
		echo "Program '$program' is not available or does not appear to support flag '$flag'" >&2
        echo 'no'
}

do_host_download() {
	start=$(millis)
	echo "${GET_PROGRESS_DOWNLOADING}"

	DOWNLOAD_URL=https://update.code.visualstudio.com/commit:$COMMIT_ID/$PLATFORM_DOWNLOAD_PATH/${QUALITY}

	if command -v wget > /dev/null 2>&1
	then
		echo "Downloading with wget"
		IS_WGET_BUSYBOX=$(is_program_from_busybox wget)

		echo "wget is from busybox: $IS_WGET_BUSYBOX"

		if [ "$IS_WGET_BUSYBOX" = 'no' ]
		then
			# Not busybox.
			# Assuming its GNU wget or similar

			if [ -n "$IGNORE_WGET_CONFIG_FLAG" ] && [ "$(supports_flag 'wget' '--no-config')" = "no" ]; then
				echo "Detected that this version of wget does not support '--no-config'. Will not ignore wget default configuration files."
				IGNORE_WGET_CONFIG_FLAG=""
			fi

			WGET_ERRORS=$(2>&1 wget ${IGNORE_WGET_CONFIG_FLAG} ${WGET_TRIES_SEGMENT} --connect-timeout=7 --dns-timeout=7 -nv -O vscode-cli-$COMMIT_ID.tar.gz ${DOWNLOAD_URL})
		else
			# Is busybox.
			# Remove flags for the sake of compatibility

			WGET_ERRORS=$(2>&1 wget -O vscode-cli-$COMMIT_ID.tar.gz ${DOWNLOAD_URL})
		fi

		error_code=$?
		if [ $error_code -ne 0 ]
		then
			echo "wget download failed"
			echo "$WGET_ERRORS"
			printenv_indent

			do_client_download_or_fail 25
		else
			echo "Download complete"
			DOWNLOAD_TIME=$(elapsed $start)
		fi
	else
		command -v curl > /dev/null 2>&1
		error_code=$?
		if [ $error_code -eq 0 ]
		then
			echo "Downloading with curl"
			CURL_STATUS_CODE_RESULT=$(curl ${IGNORE_CURL_CONFIG_FLAG} --connect-timeout 7 -L $DOWNLOAD_URL --output vscode-cli-$COMMIT_ID.tar.gz -w "%{http_code}")
			error_code=$?
			curl_status_code_if_2xx=$(echo "$CURL_STATUS_CODE_RESULT" | grep -E "^2[0-9]{2}$")
			if [ $error_code -ne 0 ] || [ -z "$curl_status_code_if_2xx" ]
			then
				echo "curl download failed"
				echo "HTTP status code: $CURL_STATUS_CODE_RESULT"
				printenv_indent

				do_client_download_or_fail 25
			else
				echo "Download complete"
				DOWNLOAD_TIME=$(elapsed $start)
			fi
		else
			printenv_indent
			echo "Neither wget nor curl is installed"

			do_client_download_or_fail 26
		fi
	fi
}

do_install() {
	start=$(millis)
	echo "${GET_PROGRESS_INSTALLING}"
	UNPACK_RESULT="success"
	echo "tar --version: $(tar --version)"
	tar -xf vscode-cli-$COMMIT_ID.tar.gz --no-same-owner
	TAR_EXIT=$?
	INSTALL_TIME=$(elapsed $start)

	if [ $TAR_EXIT -ne 0 ]
	then
		echo "ERROR: tar exited with a non-zero exit code: $TAR_EXIT"
		UNPACK_RESULT="error"
		do_client_download_or_fail "37"
		do_install
		return
	fi

	mv "$CLI_NAME_IN_ARCHIVE" "$CLI_PATH"

	# cheap sanity check
	
	if ! eval "$CLI_PATH --version"
	then
		UNPACK_RESULT="missingFiles"
		echo "ERROR: $CLI_PATH don't exist"
		do_client_download_or_fail "37"
		do_install
		return
	fi

	# Delete the leftover folder which might have -web prefix, and the .tar.gz
	rm -rf vscode-cli*
}

#
# Install if needed
#
if [ ! -f "$CLI_PATH" ]
then
	echo "Installing to $VSCODE_AGENT_FOLDER..."
	STASHED_WORKING_DIR="$(pwd)"
	cd "$VSCODE_AGENT_FOLDER" || fail_with_exitcode 38

	if [ $FORCE_CLIENT_DOWNLOAD = "1" ]; then
		do_client_download
	else
		do_host_download
	fi

	do_install
	cd "$STASHED_WORKING_DIR" || fail_with_exitcode 38
else
	echo "Found existing installation at $VSCODE_AGENT_FOLDER..."
fi


#
# Start the server
#
start_server() {
	echo "Starting VS Code CLI..."
	printenv_indent
	start=$(millis)
	if [ -f $CLI_LOG_FILE ]; then
		echo "Removing old logfile at $CLI_LOG_FILE"
		rm "$CLI_LOG_FILE" # See #6265
	fi

	# Stop exporting VSCODE_AGENT_FOLDER once https://github.com/microsoft/vscode/pull/228287 is available and replace with:
	# --extensions-dir "$VSCODE_AGENT_FOLDER/extensions" --user-data-dir "$VSCODE_AGENT_FOLDER/data"
	# See https://github.com/microsoft/vscode-internalbacklog/issues/2604, https://github.com/microsoft/vscode-remote-release/issues/10255
	export VSCODE_AGENT_FOLDER

	VSCODE_CLI_REQUIRE_TOKEN=${TOKEN} "$CLI_PATH" command-shell --cli-data-dir "$VSCODE_AGENT_FOLDER/cli" --parent-process-id $$ ${LISTEN_ARGS} > "$CLI_LOG_FILE" 2>&1 < /dev/null &
	CLI_PID=$!
	echo "Spawned remote CLI: $!"

	count=0
	max_retries=15
	while [ $count -lt $max_retries ]; do
		count=$((count + 1))
		LISTENING_ON=$(cat "$CLI_LOG_FILE" | grep -a -E 'Listening on .+' | grep -v grep | sed 's/Listening on //')
		if [ "$LISTENING_ON" != '' ]
		then
			break
		fi

		# "If sig is 0 (the null signal), error checking is performed but no signal is actually sent. 
		# The null signal can be used to check the validity of pid.""
		# Source: https://pubs.opengroup.org/onlinepubs/007908799/xsh/kill.html
		if ! kill -0 $CLI_PID > /dev/null; then
			echo "Exec server process not found"
			cat $CLI_LOG_FILE
			break
		fi

		echo "Waiting for server log..."
		sleep .03
	done
	SERVER_START_TIME=$(elapsed $start)
}

start_server

# What we echo below cannot be wider than 80 characters
echo "${UUID}: start"
echo_common_results
echo "${UUID}: end"

while true; do sleep 180; printf ' '; done
EOSSH'
[10:34:57.402] > Access to this system is monitored and restricted to authorised users. If you
> do not have authorisation to use this system, you should not proceed beyond
> this point and should disconnect immediately.
> 
> Unauthorised use could lead to prosecution.
[10:34:57.403] Got some output, clearing connection timeout
[10:34:59.613] > c9e48caa2be7: running
> Script executing under PID: 11870
[10:34:59.625] > Found existing installation at /home/users/username/.vscode-server...
> Starting VS Code CLI...
> printenv:
[10:34:59.646] >     MANPATH=/usr/man:/usr/share/man:/usr/X11R6/man:/usr/local/man:/usr/local/share/man:/usr/share/lmod/lmod/share/man::/opt/puppetlabs/puppet/share/man
>     XDG_SESSION_ID=2568
>     GIT_CEILING_DIRECTORIES=/gws/nopw/j04:/group_workspaces/jasmin4
>     SHELL=/bin/bash
>     LMOD_ROOT=/usr/share/lmod
>     SSH_CLIENT=130.246.130.29 34700 22
>     MODULEPATH_ROOT=/usr/share/modulefiles
>     LMOD_PACKAGE_PATH=/apps/modulefiles/.lmod
>     CONDA_SHLVL=1
>     CONDA_PROMPT_MODIFIER=(base) 
>     LMOD_PKG=/usr/share/lmod/lmod
>     QTDIR=/usr/lib64/qt-3.3
>     QTINC=/usr/lib64/qt-3.3/include
>     LMOD_VERSION=8.7.20
>     LMOD_ADMIN_FILE=/apps/modulefiles/.lmod/admin.list
>     QT_GRAPHICSSYSTEM_CHECKED=1
>     USER=username
>     LS_COLORS=
>     LMOD_sys=Linux
>     LMOD_MODULERCFILE=/apps/modulefiles/.modulerc.lua
>     CONDA_EXE=/home/users/username/miniconda3/bin/conda
>     SSH_AUTH_SOCK=/tmp/ssh-VCyi0o4Wqm/agent.11869
>     HDF5_USE_FILE_LOCKING=FALSE
>     _CE_CONDA=
>     PATH=/home/users/username/miniconda3/bin:/home/users/username/miniconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/opt/puppetlabs/bin:/home/users/username/julia/julia-1.5.3/bin
>     MAIL=/var/mail/username
>     CONDA_PREFIX=/home/users/username/miniconda3
>     PWD=/home/users/username
>     LANG=en_US.UTF-8
>     MODULEPATH=/apps/jasmin/modulefiles:/utils/modulefiles:/apps/modulefiles
>     LMOD_CMD=/usr/share/lmod/lmod/libexec/lmod
>     SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
>     _CE_M=
>     HOME=/home/users/username
>     SHLVL=2
>     BASH_ENV=/home/users/username/.bashrc
>     LOGNAME=username
>     CONDA_PYTHON_EXE=/home/users/username/miniconda3/bin/python
>     QTLIB=/usr/lib64/qt-3.3/lib
>     SSH_CONNECTION=130.246.130.29 34700 130.246.130.158 22
>     MODULESHOME=/usr/share/lmod/lmod
>     LESSOPEN=||/usr/bin/lesspipe.sh %s
>     LMOD_SETTARG_FULL_SUPPORT=no
>     CONDA_DEFAULT_ENV=base
>     XDG_RUNTIME_DIR=/run/user/26291
>     LMOD_DIR=/usr/share/lmod/lmod/libexec
>     BASH_FUNC_module()=() {  if [ -z "${LMOD_SH_DBG_ON+x}" ]; then
>      case "$-" in 
>      *v*x*)
>      __lmod_sh_dbg='vx'
>      ;;
>      *v*)
>      __lmod_sh_dbg='v'
>      ;;
>      *x*)
>      __lmod_sh_dbg='x'
>      ;;
>      esac;
>      fi;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      set +$__lmod_sh_dbg;
>      echo "Shell debugging temporarily silenced: export LMOD_SH_DBG_ON=1 for Lmod's output" 1>&2;
>      fi;
>      eval "$($LMOD_CMD shell "$@")" && eval "$(${LMOD_SETTARG_CMD:-:} -s sh)";
>      __lmod_my_status=$?;
>      if [ -n "${__lmod_sh_dbg:-}" ]; then
>      echo "Shell debugging restarted" 1>&2;
>      set -$__lmod_sh_dbg;
>      fi;
>      unset __lmod_sh_dbg;
>      return $__lmod_my_status
>     }
>     BASH_FUNC_ml()=() {  eval "$($LMOD_DIR/ml_cmd "$@")"
>     }
>     _=/usr/bin/printenv
> Removing old logfile at /home/users/username/.vscode-server/.cli.38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40.log
> Spawned remote CLI: 12056
> Waiting for server log...
[10:34:59.675] > Waiting for server log...
[10:34:59.707] > Waiting for server log...
[10:34:59.741] > Waiting for server log...
[10:34:59.775] > Waiting for server log...
[10:34:59.808] > Waiting for server log...
[10:34:59.844] > Waiting for server log...
[10:34:59.877] > Waiting for server log...
[10:34:59.917] > Waiting for server log...
[10:34:59.946] > Waiting for server log...
[10:34:59.981] > Waiting for server log...
[10:35:00.015] > Waiting for server log...
[10:35:00.050] > Waiting for server log...
[10:35:00.093] > Waiting for server log...
[10:35:00.126] > Waiting for server log...
[10:35:00.160] > c9e48caa2be7: start
> listeningOn====
> osReleaseId==centos==
> arch==x86_64==
> vscodeArch==x64==
> bitness==64==
> tmpDir==/run/user/26291==
> platform==linux==
> unpackResult====
> didLocalDownload==0==
> downloadTime====
> installTime====
> serverStartTime==530==
> execServerToken==a11aa111-aa1a-1a1a-a111-a11a11a1a1aa==
> platformDownloadPath==cli-alpine-x64==
[10:35:00.186] > c9e48caa2be7: end
[10:35:00.186] Received install output: 
listeningOn====
osReleaseId==centos==
arch==x86_64==
vscodeArch==x64==
bitness==64==
tmpDir==/run/user/26291==
platform==linux==
unpackResult====
didLocalDownload==0==
downloadTime====
installTime====
serverStartTime==530==
execServerToken==a11aa111-aa1a-1a1a-a111-a11a11a1a1aa==
platformDownloadPath==cli-alpine-x64==

[10:35:00.188] Failed to parse remote port from server output
[10:35:00.192] Resolver error: Error: 
	at v.Create (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:501404)
	at t.handleInstallOutput (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:498726)
	at t.tryInstall (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:616460)
	at async /Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:575788
	at async t.withShowDetailsEvent (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:579017)
	at async k (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:572574)
	at async t.resolve (/Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:576428)
	at async /Users/rob/.vscode/extensions/ms-vscode-remote.remote-ssh-0.114.3/out/extension.js:2:844803
[10:35:00.199] ------




[10:35:00.500] Opening exec server for ssh-remote+node.server
[10:35:00.512] Opening exec server for ssh-remote+node.server
[10:35:00.518] Initizing new exec server for ssh-remote+node.server
[10:35:00.519] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[10:35:00.523] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "96e27a540796",
  "startMarker": "96e27a540796: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "a111a111-1a11-111a-aaa1-1a11aa1a11a1",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "96e27a540796:trigger_server_download",
  "getDownloadServerEndTrigger": "96e27a540796:trigger_server_download_end",
  "getProgressDownloading": "96e27a540796%%1%%",
  "getProgressInstalling": "96e27a540796%%2%%"
}
[10:35:00.524] Install and start server if needed
[10:35:09.450] getPlatformForHost was canceled
[10:35:09.451] Exec server for ssh-remote+node.server failed: Error: Connecting was canceled
[10:35:09.451] Existing exec server for ssh-remote+node.server errored (Error: Connecting was canceled)
[10:35:09.451] Initizing new exec server for ssh-remote+node.server
[10:35:09.451] Using commit id "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40" and quality "stable" for server
[10:35:09.452] Error opening exec server for ssh-remote+node.server: Error: Connecting was canceled
[10:35:09.453] Script variables:
 {
  "InstallExitCode.24": "AlreadyInProgress",
  "InstallExitCode.25": "ServerDownloadFailed",
  "InstallExitCode.26": "NoDownloaderAvailable",
  "InstallExitCode.27": "UnsupportedArch",
  "InstallExitCode.28": "StatusCheckFailed",
  "InstallExitCode.29": "NeedInsidersArch",
  "InstallExitCode.30": "NoDownloaderAvailableForStatusCheck",
  "InstallExitCode.31": "ServerTransferFailed",
  "InstallExitCode.32": "ServerFailedToStart",
  "InstallExitCode.33": "NeedInsidersWindows",
  "InstallExitCode.34": "CreateInstallDirFailed",
  "InstallExitCode.35": "UnsupportedPlatform",
  "InstallExitCode.36": "ServerTerminatedCVE20201416",
  "InstallExitCode.37": "UnpackFailed",
  "InstallExitCode.38": "ChangeDirFailed",
  "InstallExitCode.AlreadyInProgress": "24",
  "InstallExitCode.ServerDownloadFailed": "25",
  "InstallExitCode.NoDownloaderAvailable": "26",
  "InstallExitCode.NoDownloaderAvailableForStatusCheck": "30",
  "InstallExitCode.UnsupportedArch": "27",
  "InstallExitCode.StatusCheckFailed": "28",
  "InstallExitCode.NeedInsidersArch": "29",
  "InstallExitCode.ServerTransferFailed": "31",
  "InstallExitCode.ServerFailedToStart": "32",
  "InstallExitCode.NeedInsidersWindows": "33",
  "InstallExitCode.CreateInstallDirFailed": "34",
  "InstallExitCode.UnsupportedPlatform": "35",
  "InstallExitCode.ServerTerminatedCVE20201416": "36",
  "InstallExitCode.UnpackFailed": "37",
  "InstallExitCode.ChangeDirFailed": "38",
  "InstallUnpackCode.Success": "success",
  "InstallUnpackCode.Error": "error",
  "InstallUnpackCode.MissingFiles": "missingFiles",
  "uuid": "db5599470599",
  "startMarker": "db5599470599: running",
  "commitId": "38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40",
  "quality": "stable",
  "token": "111aaa11-aa11-1a11-111a-1a11aaa1aaa1",
  "vscodeAgentFolder": "$HOME/.vscode-server",
  "allowClientDownload": "1",
  "forceClientDownload": "0",
  "cliNameInArchive": "code",
  "ignoreWgetConfigFlag": " --no-config ",
  "ignoreCurlConfigFlag": " --disable ",
  "wgetTriesSegment": "--tries=1",
  "listenArgs": "--on-host=127.0.0.1 --on-port",
  "getDownloadServerStartTrigger": "db5599470599:trigger_server_download",
  "getDownloadServerEndTrigger": "db5599470599:trigger_server_download_end",
  "getProgressDownloading": "db5599470599%%1%%",
  "getProgressInstalling": "db5599470599%%2%%"
}
[10:35:09.455] Install and start server if needed

[joshspicer]

For folks able to repro, if possible could you please provide the contents of the log files that look similar to /home/<user>/.vscode-server/.cli.<hash>.log. (Note the leading . in the hidden file .cli.xxxx.log)

[joshspicer]

Connection hangs at this stage when running command locally

I missed this at the beginning - do you mean that when you try to SSH outside of this extension you also see a hang? If so, wouldn't that mean the issue is not related to this extension?

I have copied your SSH configuration settings and can successfully connect with the latest pre-release build of the extension.

If i'm understanding right, please first correct your SSH configuration to work outside of the extension. Since that configuration is specific to your environment we can't provide too much additional guidance (other than I can confirm this works for me with a similar set up). If after you can directly SSH, please provide updated logs as well as your server log. Thanks :)