Collection of FileExistsError and/or PermissionError crashes during venv creation

[carlosperate]

Creating this issue to collect the cases where we encounter an error like this:

Traceback (most recent call last):
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823' -> 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823.FAILED'

In many cases this seems to be a "secondary" error, where something else has failed beforehand, and then quen trying to rename the venv we get a different error.

For this reason is better to keep these individual issues open, as the first problem might be different. There is a chance that they all have similar problems manifesting in different ways, but as that is not clear yet let's look at them individually.

[carlosperate]

From #1500:

mu.log

Version: 1.1.0.beta.4
Locale: en_GB
Platform: Windows 10 10.0.19041 AMD64

First it errors when trying to upgrade pip, and then we a FileExistsError trying to rename the venv to venv.FAILED':

2021-04-22 21:09:00,315 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 101; output: Unable to create process using 'C:\Users\jason hart\AppData\Local\Programs\Mu Editor\Python\python.exe -m pip install --upgrade pip'
2021-04-22 21:09:00,315 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\jason hart\AppData\Local\python\mu\mu_venv-38-20210422-210256 as C:\Users\jason hart\AppData\Local\python\mu\mu_venv-38-20210422-210256.FAILED
Traceback (most recent call last):
  File "C:\Users\jason hart\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 494, in ensure_and_create
    self.create()
  File "C:\Users\jason hart\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 624, in create
    self.upgrade_pip()
  File "C:\Users\jason hart\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 671, in upgrade_pip
    raise VirtualEnvironmentCreateError("Unable to upgrade pip")
mu.virtual_environment.VirtualEnvironmentCreateError: Unable to upgrade pip

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\jason hart\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
FileExistsError: [WinError 183] Cannot create a file when that file already exists: 'C:\\Users\\jason hart\\AppData\\Local\\python\\mu\\mu_venv-38-20210422-210256' -> 'C:\\Users\\jason hart\\AppData\\Local\\python\\mu\\mu_venv-38-20210422-210256.FAILED'

mu/mu/virtual_environment.py

Lines 459 to 468 in 38f905a

	def quarantine_failed_venv(self):
	error_dirpath = self.path + ".FAILED"
	try:
	os.rename(self.path, error_dirpath)
	except OSError:
	logger.exception(
	"Unable to quarantine %s as %s", self.path, error_dirpath
	)
	else:
	logger.info("Quarantined %s as %s", self.path, error_dirpath)

[carlosperate]

From #1506:

mu.log
Version: 1.1.0.beta.4
Locale: zh_MO
Platform: Windows 10 10.0.19041 AMD64

This one is a bit odd, looks like it fails to create the C:\Users\<user>\mu_code\templates directory (after it checks if the directory existed with os.path.exists) as the excepthook logs the error, the crash handler creates this GH issue, but it looks like Mu actually continued operation?

2021-04-25 22:21:34,589 - mu.logic:828(setup) DEBUG: Creating directory: C:\Users\kioki\mu_code\templates
2021-04-25 22:21:34,589 - root:173(excepthook) ERROR: Unrecoverable error
Traceback (most recent call last):
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\__main__.py", line 9, in <module>
    main()
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\__main__.py", line 5, in main
    run()
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\app.py", line 344, in run
    editor.setup(setup_modes(editor, editor_window))
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\logic.py", line 829, in setup
    shutil.copytree(path("templates", "web/"), template_path)
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\shutil.py", line 554, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\shutil.py", line 455, in _copytree
    os.makedirs(dst, exist_ok=dirs_exist_ok)
  File "C:\Users\kioki\AppData\Local\Programs\Mu Editor\Python\lib\os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [WinError 183] 當檔案已存在時，無法建立該檔案。: 'C:\\Users\\kioki\\mu_code\\templates'
2021-04-25 22:21:34,619 - mu.logic:831(setup) DEBUG: Creating directory: C:\Users\kioki\mu_code\static

mu/mu/logic.py

Lines 827 to 829 in 38f905a

	if not os.path.exists(template_path):
	logger.debug("Creating directory: {}".format(template_path))
	shutil.copytree(path("templates", "web/"), template_path)

[carlosperate]

From #1535:

No log yet
Version: 1.1.0.beta.4
Locale: zh_TW
Platform: Windows 10 10.0.19041 AMD64

No log this time, but from the original exception it looks the same as the previous #1556 (comment).
It also looks like there might be some unicode issues as well, interestingly #1556 (comment) is also in a Chinese dialect.

Traceback (most recent call last):
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\__main__.py", line 9, in <module>
    main()
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\__main__.py", line 5, in main
    run()
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\app.py", line 344, in run
    editor.setup(setup_modes(editor, editor_window))
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\logic.py", line 798, in setup
    os.makedirs(wd)
  File "C:\Users\a1536\AppData\Local\Programs\Mu Editor\Python\lib\os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [WinError 183] ���已������建�該���: 'C:\\Users\\a1536\\mu_code'

mu/mu/logic.py

Lines 827 to 829 in 38f905a

	if not os.path.exists(template_path):
	logger.debug("Creating directory: {}".format(template_path))
	shutil.copytree(path("templates", "web/"), template_path)

[carlosperate]

From #1523:

Log pasted in #1523 (comment)
Version: 1.1.0.beta.4
Locale: pl_PL
Platform: Windows 10 10.0.19041 AMD64

There are some issue installing the dependencies, so then when it tries to verify if they are present it fails, and then at the quarantining step it fails with a FileExistsError.

2021-05-01 09:48:32,140 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 1; output: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pgzero'
2021-05-01 09:48:32,144 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\soare\AppData\Local\python\mu\mu_venv-38-20210430-083410 as C:\Users\soare\AppData\Local\python\mu\mu_venv-38-20210430-083410.FAILED
Traceback (most recent call last):
  File "C:\Users\soare\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 495, in ensure_and_create
    self.ensure()
  File "C:\Users\soare\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 524, in ensure
    self.ensure_key_modules()
  File "C:\Users\soare\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 602, in ensure_key_modules
    raise VirtualEnvironmentEnsureError(
mu.virtual_environment.VirtualEnvironmentEnsureError: Failed to import: pgzero

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\soare\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
FileExistsError: [WinError 183] Nie można utworzyć pliku, który już istnieje: 'C:\\Users\\soare\\AppData\\Local\\python\\mu\\mu_venv-38-20210430-083410' -> 'C:\\Users\\soare\\AppData\\Local\\python\\mu\\mu_venv-38-20210430-083410.FAILED'

mu/mu/virtual_environment.py

Lines 459 to 468 in 38f905a

	def quarantine_failed_venv(self):
	error_dirpath = self.path + ".FAILED"
	try:
	os.rename(self.path, error_dirpath)
	except OSError:
	logger.exception(
	"Unable to quarantine %s as %s", self.path, error_dirpath
	)
	else:
	logger.info("Quarantined %s as %s", self.path, error_dirpath)

[carlosperate]

From #1553:

mu.txt
REMEMBER TO ATTACH YOUR LOG FILE

Version: 1.1.0.beta.4
Locale: en_IN
Platform: Windows 10 10.0.18362 AMD64

Interestingly in this case we hit both the FileExistsError and PermissionError.

First we get a FileExistsError while creating the venv and then a PermissionError when trying to rename it to x.FAILED:

2021-05-10 10:24:05,789 - mu.virtual_environment:491(ensure_and_create) DEBUG: Checking virtual environment; attempt #1.
2021-05-10 10:24:12,257 - mu.virtual_environment:633(create_venv) INFO: Creating virtualenv: C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823
2021-05-10 10:24:12,318 - mu.virtual_environment:634(create_venv) INFO: Virtualenv name: mu_venv-38-20210509-222823
2021-05-10 10:24:12,318 - mu.virtual_environment:634(create_venv) INFO: Virtualenv name: mu_venv-38-20210509-222823
2021-05-10 10:24:16,036 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 1; output: FileExistsError: [WinError 183] Cannot create a file when that file already exists: 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823\\Lib\\site-packages'
2021-05-10 10:24:16,239 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823 as C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823.FAILED
Traceback (most recent call last):
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 494, in ensure_and_create
    self.create()
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 623, in create
    self.create_venv()
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 654, in create_venv
    raise VirtualEnvironmentCreateError(
mu.virtual_environment.VirtualEnvironmentCreateError: Unable to create a virtual environment using C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\pythonw.exe at C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823' -> 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823.FAILED'
2021-05-10 10:24:16,474 - mu.virtual_environment:410(relocate) DEBUG: Virtual environment set up mu_venv-38-20210510-102416 at C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210510-102416

mu/mu/virtual_environment.py

Lines 637 to 657 in 38f905a

	ok, output = self.run_subprocess(
	sys.executable,
	"-m",
	"virtualenv",
	"-p",
	sys.executable,
	"-q",
	self.path,
	env=env,
	)
	if ok:
	logger.info(
	"Created virtual environment using %s at %s",
	sys.executable,
	self.path,
	)
	else:
	raise VirtualEnvironmentCreateError(
	"Unable to create a virtual environment using %s at %s"
	% (sys.executable, self.path)
	)

mu/mu/virtual_environment.py

Lines 459 to 468 in 38f905a

	def quarantine_failed_venv(self):
	error_dirpath = self.path + ".FAILED"
	try:
	os.rename(self.path, error_dirpath)
	except OSError:
	logger.exception(
	"Unable to quarantine %s as %s", self.path, error_dirpath
	)
	else:
	logger.info("Quarantined %s as %s", self.path, error_dirpath)

Then after other errors we get a FileExistsError when trying to rename it to x.FAILED (before we got a PermissionError):

021-05-10 10:29:02,189 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 1; output: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pgzero'
2021-05-10 10:29:02,189 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823 as C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210509-222823.FAILED
Traceback (most recent call last):
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 495, in ensure_and_create
    self.ensure()
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 524, in ensure
    self.ensure_key_modules()
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 602, in ensure_key_modules
    raise VirtualEnvironmentEnsureError(
mu.virtual_environment.VirtualEnvironmentEnsureError: Failed to import: pgzero

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\idea\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
FileExistsError: [WinError 183] Cannot create a file when that file already exists: 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823' -> 'C:\\Users\\idea\\AppData\\Local\\python\\mu\\mu_venv-38-20210509-222823.FAILED'
2021-05-10 10:29:02,267 - mu.virtual_environment:410(relocate) DEBUG: Virtual environment set up mu_venv-38-20210510-102902 at C:\Users\idea\AppData\Local\python\mu\mu_venv-38-20210510-102902

mu/mu/virtual_environment.py

Lines 459 to 468 in 38f905a

	def quarantine_failed_venv(self):
	error_dirpath = self.path + ".FAILED"
	try:
	os.rename(self.path, error_dirpath)
	except OSError:
	logger.exception(
	"Unable to quarantine %s as %s", self.path, error_dirpath
	)
	else:
	logger.info("Quarantined %s as %s", self.path, error_dirpath)

[carlosperate]

From #1555:

mu.log

Version: 1.1.0.beta.4
Locale: fr_CH
Platform: Windows 10 10.0.19041 AMD64

So in this it fails to upgrade pip (#1532 (comment)), and then when it tries to quarantine the venv it fails with the FileExistsError:

2021-05-10 11:22:09,182 - mu.virtual_environment:660(upgrade_pip) DEBUG: About to upgrade pip; interpreter C:\Users\ENVY 17-r185\AppData\Local\python\mu\mu_venv-38-20210510-112116\scripts\python.exe exists
2021-05-10 11:22:09,351 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 101; output: Unable to create process using 'C:\Users\ENVY 17-r185\AppData\Local\Programs\Mu Editor\Python\python.exe -m pip install --upgrade pip'
2021-05-10 11:22:09,374 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\ENVY 17-r185\AppData\Local\python\mu\mu_venv-38-20210510-112116 as C:\Users\ENVY 17-r185\AppData\Local\python\mu\mu_venv-38-20210510-112116.FAILED
Traceback (most recent call last):
  File "C:\Users\ENVY 17-r185\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 494, in ensure_and_create
    self.create()
  File "C:\Users\ENVY 17-r185\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 624, in create
    self.upgrade_pip()
  File "C:\Users\ENVY 17-r185\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 671, in upgrade_pip
    raise VirtualEnvironmentCreateError("Unable to upgrade pip")
mu.virtual_environment.VirtualEnvironmentCreateError: Unable to upgrade pip

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\ENVY 17-r185\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
FileExistsError: [WinError 183] Impossible de créer un fichier déjà existant: 'C:\\Users\\ENVY 17-r185\\AppData\\Local\\python\\mu\\mu_venv-38-20210510-112116' -> 'C:\\Users\\ENVY 17-r185\\AppData\\Local\\python\\mu\\mu_venv-38-20210510-112116.FAILED'

mu/mu/virtual_environment.py

Lines 660 to 671 in 38f905a

	logger.debug(
	"About to upgrade pip; interpreter %s %s",
	self.interpreter,
	"exists" if os.path.exists(self.interpreter) else "doesn't exist",
	)
	ok, output = self.run_subprocess(
	self.interpreter, "-m", "pip", "install", "--upgrade", "pip"
	)
	if ok:
	logger.info("Upgraded pip")
	else:
	raise VirtualEnvironmentCreateError("Unable to upgrade pip")

mu/mu/virtual_environment.py

Lines 459 to 468 in 38f905a

	def quarantine_failed_venv(self):
	error_dirpath = self.path + ".FAILED"
	try:
	os.rename(self.path, error_dirpath)
	except OSError:
	logger.exception(
	"Unable to quarantine %s as %s", self.path, error_dirpath
	)
	else:
	logger.info("Quarantined %s as %s", self.path, error_dirpath)

[carlosperate]

From #1559:

mu.log
Version: 1.1.0.beta.4
Locale: en_GB
Platform: Windows 10 10.0.18362 AMD64

In this case it looks like the way it fails to quarantine a venv changes between the first time the Mu editor was launched, to the second. More info in #1559 (comment)

By the end it fails install and then verify one of the packaged wheels:

2021-05-12 10:00:25,111 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 1; output: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pgzero'
2021-05-12 10:00:25,111 - mu.virtual_environment:464(quarantine_failed_venv) ERROR: Unable to quarantine C:\Users\alice\AppData\Local\python\mu\mu_venv-38-20210512-084040 as C:\Users\alice\AppData\Local\python\mu\mu_venv-38-20210512-084040.FAILED
Traceback (most recent call last):
  File "C:\Users\alice\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 495, in ensure_and_create
    self.ensure()
  File "C:\Users\alice\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 524, in ensure
    self.ensure_key_modules()
  File "C:\Users\alice\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 602, in ensure_key_modules
    raise VirtualEnvironmentEnsureError(
mu.virtual_environment.VirtualEnvironmentEnsureError: Failed to import: pgzero

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\alice\AppData\Local\Programs\Mu Editor\Python\lib\site-packages\mu\virtual_environment.py", line 462, in quarantine_failed_venv
    os.rename(self.path, error_dirpath)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'C:\\Users\\alice\\AppData\\Local\\python\\mu\\mu_venv-38-20210512-084040' -> 'C:\\Users\\alice\\AppData\\Local\\python\\mu\\mu_venv-38-20210512-084040.FAILED'

It also errors trying to create a venv because the site-packages folder (or some content inside) already exists?

2021-05-12 10:00:25,280 - mu.virtual_environment:491(ensure_and_create) DEBUG: Checking virtual environment; attempt #2.
2021-05-12 10:00:25,280 - mu.virtual_environment:633(create_venv) INFO: Creating virtualenv: C:\Users\alice\AppData\Local\python\mu\mu_venv-38-20210512-100025
2021-05-12 10:00:25,280 - mu.virtual_environment:634(create_venv) INFO: Virtualenv name: mu_venv-38-20210512-100025
2021-05-12 10:00:33,437 - mu.virtual_environment:379(run_subprocess) DEBUG: Process returned 1; output: FileExistsError: [WinError 183] Cannot create a file when that file already exists: 'C:\\Users\\alice\\AppData\\Local\\python\\mu\\mu_venv-38-20210512-100025\\Lib\\site-packages'

[tjguk]

First thank you so much @carlosperate for doing all this spadework.

Quarantine Errors

First, if an attempt to quarantine fails, that won't cause any problem in the future: it's a housekeeping exercise to make it easier to spot the current venv folder. As far as I can see from the tracebacks above, the quarantine code correctly logs any OSError exception and then carries on: it doesn't cause the remainder of the venv creation to fail. All the exceptions we've seen are instances of subclasses of OSError (FileNotFoundError, PermissionError etc.).

However I am concerned by the FileExistsError where we appear to be renaming to an existing .FAILED folder. It still won't cause a problem, and I'm assuming it's a race condition of sorts, where we manage to make two attempts in a single second. But still it feels fragile.

In short, while we could add some kind of collision detection logic to the quarantine mechanism, I don't really want to do so as it's not really solving a problem

Permission / Access Errors when creating

I can only assume that these are attempts to run in a restricted environment. We're already doing what we can to catch those and output the error message (and try again). The fallback plan is basically #693 where we allow users to specify one or more directories via the command line as an option for school admins etc.

As a workaround, now I think about it, the user ought to be able to overwrite the dirpath entry in venv.json (eg to be c:/temp/myvenv and on the next time round, we'll attempt to create a new venv at that position.

Upgrading Pip

This is probably where I'm least sure what to do -- or, rather, where to do it. I think we probably want to patch the installer build mechanism to specify a version of virtualenv which will vendor the version of pip which we need (whichever that is). I'll see if I can come to a quick conclusion on which that is.

[carlosperate]

This is probably where I'm least sure what to do -- or, rather, where to do it. I think we probably want to patch the installer build mechanism to specify a version of virtualenv which will vendor the version of pip which we need (whichever that is). I'll see if I can come to a quick conclusion on which that is.

The current issues are related to the user venv pip installations, so figuring out the smallest version of virtualenv packing pip v19.0 or v19.3 (info in #1441 (comment)) should do the trick.

Looking at the wheels included in the virtualenv (multiple links needed due to the wheels moving around between versions, in all cases the pip v19.1.1 wheel included is only for Python 3.4, which Mu does not support):

• virtualenv 20.0.24: pip v20.1.1
  • https://github.com/gaborbernat/virtualenv/blob/20.0.24/src/virtualenv/seed/wheels/embed/__init__.py#L7
• virtualenv 20.0.0: pip v20.0.2
  • https://github.com/gaborbernat/virtualenv/blob/20.0.0/src/virtualenv/seed/embed/wheels/__init__.py#L3
• virtualenv 16.7.6: pip v19.3
  • https://github.com/gaborbernat/virtualenv/tree/16.7.6/virtualenv_support

The current minimum version of virtualenv currently specified in setup.py is v16.0.0;, which packs pip v10:

• 73521e1
• https://github.com/gaborbernat/virtualenv/tree/16.0.0/virtualenv_support

I think this PR will be enough for this? Or do you need we need something else? #1573