Description
What happened?
E.g. when I have Chrome 134.0.6998.178 preinstalled on the system, and I instruct Selenium Manager to use Chrome 134.0.6998.165, it'll only download (and thus the tests I presume, will only use) the requested version of ChromeDriver. The version of Chrome, however, won't be downloaded and used unless force-browser-download
is set.
I guess this is only the case when the versions are deemed compatible (like only the last segment of the version number is different). However, in our experiences, this can still cause inconsistencies between environments. Only using force-browser-download
resulted in our test runs to consistently yield the same results, even between different operating systems (and local/CI environments).
I'd expect that when the exact version is specified, then indeed that version will be used.
This might be a Chrome-only issue, as I only tested this with Chrome.
How can we reproduce the issue?
- Start with a system that has Chrome preinstalled and
.cache\selenium
empty. In my example, the Chrome version is the current latest 134.0.6998.178. - Instruct Selenium Manager to use a slightly different version, in my example 134.0.6998.165, with the following command:
.\selenium-manager.exe --browser chrome --browser-version 134.0.6998.165
. - Observe that
.cache\selenium
only contains the corresponding ChromeDriver version, but not Chrome. When setting the browser version via the .NET API ofSelenium.WebDriver
, this also results in the local Chrome version being used to run UI tests. - Now run
.\selenium-manager.exe --browser chrome --browser-version 134.0.6998.165 --force-browser-download
. - Observe that
.cache\selenium
now contains both the corresponding ChromeDriver and Chrome executables. When setting the browser version via the .NET API ofSelenium.WebDriver
, this also results in the local Chrome version being used to run UI tests.
Note that while the repro steps above are with CLI commands of Selenium Manager, since this is the minimal repro, I'm not actually using Selenium Manager directly; rather, my app uses the .NET Selenium.WebDriver
NuGet package.
Relevant log output
Output of .\selenium-manager.exe --browser chrome --browser-version 134.0.6998.165 --debug
:
[2025-03-26T16:29:04.649Z DEBUG] chromedriver not found in PATH
[2025-03-26T16:29:04.649Z DEBUG] chrome detected at C:\Program Files\Google\Chrome\Application\chrome.exe
[2025-03-26T16:29:04.649Z DEBUG] Running command: wmic datafile where name='C:\\Program Files\\Google\\Chrome\\Application\\chrome.exe' get Version /value
[2025-03-26T16:29:04.744Z DEBUG] Output: "\r\r\n\r\r\nVersion=134.0.6998.178\r\r\n\r\r\n\r\r\n\r"
[2025-03-26T16:29:04.745Z DEBUG] Detected browser: chrome 134.0.6998.178
[2025-03-26T16:29:04.746Z DEBUG] Required driver: chromedriver 134.0.6998.165
[2025-03-26T16:29:04.747Z DEBUG] Acquiring lock: C:\Users\lehoc\.cache\selenium\chromedriver\win64\134.0.6998.165\sm.lock
[2025-03-26T16:29:04.747Z DEBUG] Discovering versions from https://googlechromelabs.github.io/chrome-for-testing/known-good-versions-with-downloads.json
[2025-03-26T16:29:04.957Z DEBUG] Downloading chromedriver 134.0.6998.165 from https://storage.googleapis.com/chrome-for-testing-public/134.0.6998.165/win64/chromedriver-win64.zip
[2025-03-26T16:29:05.748Z INFO ] Driver path: C:\Users\lehoc\.cache\selenium\chromedriver\win64\134.0.6998.165\chromedriver.exe
[2025-03-26T16:29:05.748Z INFO ] Browser path: C:\Program Files\Google\Chrome\Application\chrome.exe
Output of .\selenium-manager.exe --browser chrome --browser-version 134.0.6998.165 --force-browser-download --debug
:
[2025-03-26T16:30:15.603Z DEBUG] chromedriver not found in PATH
[2025-03-26T16:30:15.604Z DEBUG] Required browser: chrome 134.0.6998.165
[2025-03-26T16:30:15.605Z DEBUG] Acquiring lock: C:\Users\lehoc\.cache\selenium\chrome\win64\134.0.6998.165\sm.lock
[2025-03-26T16:30:15.605Z DEBUG] Discovering versions from https://googlechromelabs.github.io/chrome-for-testing/known-good-versions-with-downloads.json
[2025-03-26T16:30:15.836Z DEBUG] Downloading chrome 134.0.6998.165 from https://storage.googleapis.com/chrome-for-testing-public/134.0.6998.165/win64/chrome-win64.zip
[2025-03-26T16:30:23.768Z DEBUG] chrome 134.0.6998.165 is available at C:\Users\lehoc\.cache\selenium\chrome\win64\134.0.6998.165\chrome.exe
[2025-03-26T16:30:23.769Z DEBUG] Required driver: chromedriver 134.0.6998.165
[2025-03-26T16:30:23.770Z DEBUG] Acquiring lock: C:\Users\lehoc\.cache\selenium\chromedriver\win64\134.0.6998.165\sm.lock
[2025-03-26T16:30:23.770Z DEBUG] Discovering versions from https://googlechromelabs.github.io/chrome-for-testing/known-good-versions-with-downloads.json
[2025-03-26T16:30:24.019Z DEBUG] Downloading chromedriver 134.0.6998.165 from https://storage.googleapis.com/chrome-for-testing-public/134.0.6998.165/win64/chromedriver-win64.zip
[2025-03-26T16:30:24.573Z INFO ] Driver path: C:\Users\lehoc\.cache\selenium\chromedriver\win64\134.0.6998.165\chromedriver.exe
[2025-03-26T16:30:24.573Z INFO ] Browser path: C:\Users\lehoc\.cache\selenium\chrome\win64\134.0.6998.165\chrome.exe
Operating System
Windows 11, presumably also Ubuntu 24.04 because we've seen issues in GitHub Actions with that too
Selenium version
.NET Selenium.WebDriver 4.28.0
What are the browser(s) and version(s) where you see this issue?
Chrome 134.0.6998.x
What are the browser driver(s) and version(s) where you see this issue?
ChromeDrvier 134.0.6998.x
Are you using Selenium Grid?
no