[🐛 Bug]: selenium-manager segmentation fault

[benhutton]

What happened?

TLDR: When running selenium-manager, I get a segmentation fault.

Long version: When running my ruby rspec capybara tests, I get errors like this:

7) email subscriptions sign up for lists                                                                                                                                                                                                                                                                                                                                                                                      
     Failure/Error: visit '/'                                                                                                                                                                                                                                                                                                                                                                                                             
                                                                                                                                                                                                                                                                                                                                                                                                                                          
     NoMethodError:                                                                                                                                                                                                                                                                                                                                                                                                                       
       undefined method `positive?' for nil:NilClass                                                                                                                                                                                                                                                                                                                                                                                      
                                                                                                                                                                                                                                                                                                                                                                                                                                          
                 if status.exitstatus.positive?                                                                                                                                                                                                                                                                                                                                                                                           
                                     ^^^^^^^^^^                                                                                                                                                                                                                                                                                                                                                                                           
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/selenium_manager.rb:80:in `run'                                                                                                                                                                                                                                                                                    
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/selenium_manager.rb:41:in `driver_path'                                                                                                                                                                                                                                                                            
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/service.rb:107:in `binary_path'                                                                                                                                                                                                                                                                                    
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/service.rb:74:in `initialize'                                                                                                                                                                                                                                                                                      
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/service.rb:32:in `new'                                                                                                                                                                                                                                                                                             
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/service.rb:32:in `chrome'                                                                                                                                                                                                                                                                                          
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/chrome/driver.rb:35:in `initialize'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/driver.rb:47:in `new'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver/common/driver.rb:47:in `for'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/lib/selenium/webdriver.rb:88:in `for'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/capybara-3.38.0/lib/capybara/selenium/driver.rb:83:in `browser'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/capybara-3.38.0/lib/capybara/selenium/driver.rb:104:in `visit'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/capybara-3.38.0/lib/capybara/session.rb:280:in `visit'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/capybara-3.38.0/lib/capybara/dsl.rb:52:in `call'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/capybara-3.38.0/lib/capybara/dsl.rb:52:in `visit'
     # /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/rspec-rails-6.0.1/lib/rspec/rails/example/feature_example_group.rb:29:in `visit'
     # ./spec/features/homepage/email_subscriptions_spec.rb:88:in `block (2 levels) in <top (required)>'

That got me playing around with https://github.com/SeleniumHQ/selenium/blob/trunk/rb/lib/selenium/webdriver/common/selenium_manager.rb#L41. When I run selenium-manager directly (see "Relevant log output" section), I get a segfault, which is probably messing with Open3 and causing the error that I'm seeing.

How can we reproduce the issue?

See the relevant log output. I am running the selenium-manager executable out of my ruby gem's bin directory. I see the same issue for both chromedriver and geckodriver.

Relevant log output

$ /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/bin/linux/selenium-manager --driver chromedriver --trace
TRACE   Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG   Using shell command to find out chrome version
DEBUG   Running command: "google-chrome --version"
DEBUG   Output: "Google Chrome 110.0.5481.177 "
DEBUG   The version of chrome is 110.0.5481.177
TRACE   Writing metadata to /home/ben/.cache/selenium/selenium-manager.json
DEBUG   Detected browser: chrome 110
TRACE   Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG   Reading chromedriver version from https://chromedriver.storage.googleapis.com/LATEST_RELEASE_110
[1]    296300 segmentation fault (core dumped)   --driver chromedriver --trace

$ /home/ben/.rbenv/versions/3.1.3/lib/ruby/gems/3.1.0/gems/selenium-webdriver-4.8.1/bin/linux/selenium-manager --driver geckodriver --trace
TRACE   Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG   Using shell command to find out firefox version
DEBUG   Running command: "firefox -v"
DEBUG   Output: "Mozilla Firefox 110.0"
DEBUG   The version of firefox is 110.0
TRACE   Writing metadata to /home/ben/.cache/selenium/selenium-manager.json
DEBUG   Detected browser: firefox 110
TRACE   Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
[1]    297570 segmentation fault (core dumped)   --driver geckodriver --trace

Operating System

Ubuntu 22.10

Selenium version

Ruby 4.8.1

What are the browser(s) and version(s) where you see this issue?

Google Chrome 110.0.5481.177 and Mozilla Firefox 110.0

What are the browser driver(s) and version(s) where you see this issue?

I'm not sure selenium-manager gets far enough

Are you using Selenium Grid?

I don't think so

[github-actions]

@benhutton, thank you for creating this issue. We will troubleshoot it as soon as we can.

---

Info for maintainers

Triage this issue by using labels.

If information is missing, add a helpful comment and then I-issue-template label.

If the issue is a question, add the I-question label.

If the issue is valid but there is no time to troubleshoot it, consider adding the help wanted label.

If the issue requires changes or fixes from an external project (e.g., ChromeDriver, GeckoDriver, MSEdgeDriver, W3C), add the applicable G-* label, and it will provide the correct link and auto-close the issue.

After troubleshooting the issue, please add the R-awaiting answer label.

Thank you!

[diemol]

Selenium Manager is not meant to be run directly for now, it should be transparent to users. However we can have a look.

@bonigarcia could you please check?

[benhutton]

thanks!

Just to be clear, I am only running it directly to demonstrate the error. I am mainly just letting it run transparently, and that's where it's failing

[bonigarcia]

@benhutton What is the architecture of your computer? You can check it running the command uname -m

This is my output in Linux:

boni@slimbook:/var/lib/gems/3.0.0/gems/selenium-webdriver-4.8.1/bin/linux$ uname -m
x86_64

boni@slimbook:/var/lib/gems/3.0.0/gems/selenium-webdriver-4.8.1/bin/linux$ ./selenium-manager --browser chrome --debug
DEBUG	Using shell command to find out chrome version
DEBUG	Running command: "google-chrome --version"
DEBUG	Output: "Google Chrome 110.0.5481.100 "
DEBUG	The version of chrome is 110.0.5481.100
DEBUG	Detected browser: chrome 110
DEBUG	Reading chromedriver version from https://chromedriver.storage.googleapis.com/LATEST_RELEASE_110
DEBUG	Required driver: chromedriver 110.0.5481.77
DEBUG	Running command: "chromedriver --version"
DEBUG	Output: ""
DEBUG	Driver URL: https://chromedriver.storage.googleapis.com/110.0.5481.77/chromedriver_linux64.zip
DEBUG	File extracted to /home/boni/.cache/selenium/chromedriver/linux64/110.0.5481.77/chromedriver (14452880 bytes)
INFO	/home/boni/.cache/selenium/chromedriver/linux64/110.0.5481.77/chromedriver

boni@slimbook:/var/lib/gems/3.0.0/gems/selenium-webdriver-4.8.1/bin/linux$ ./selenium-manager --driver geckodriver --debug
DEBUG	Using shell command to find out firefox version
DEBUG	Running command: "firefox -v"
DEBUG	Output: "Mozilla Firefox 110.0"
DEBUG	The version of firefox is 110.0
DEBUG	Detected browser: firefox 110
DEBUG	Required driver: geckodriver 0.32.2
DEBUG	Running command: "geckodriver --version"
DEBUG	Output: ""
DEBUG	Driver URL: https://github.com/mozilla/geckodriver/releases/download/v0.32.2/geckodriver-v0.32.2-linux64.tar.gz
INFO	/home/boni/.cache/selenium/geckodriver/linux64/0.32.2/geckodriver

[benhutton]

Same.

$ uname -m
x86_64

[bonigarcia]

It seems the problem happens when connecting to the driver repository, but it is difficult to know the cause of the problem. To try debugging it, I have built a selenium-manager binary that logs the traces of the dependencies as well. Moreover, this binary uses the latest dependencies versions (just in case the problem is due to a bug in these crates).

@benhutton Can you please have a try with this binary?

Please download it from here: selenium-manager_linux-x64

And execute it, for instance, as follows:

selenium-manager --driver chromedriver --trace

Thanks a lot in advance.

[benhutton]

Here you go @bonigarcia

$ ./selenium-manager --driver chromedriver --trace
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Using shell command to find out chrome version
DEBUG	Running command: "google-chrome --version"
DEBUG	Output: "Google Chrome 110.0.5481.177 "
DEBUG	The version of chrome is 110.0.5481.177
TRACE	Writing metadata to /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Detected browser: chrome 110
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Reading chromedriver version from https://chromedriver.storage.googleapis.com/LATEST_RELEASE_110
DEBUG	starting new connection: https://chromedriver.storage.googleapis.com/
[1]    750214 segmentation fault (core dumped)  ./selenium-manager --driver chromedriver --trace

[bonigarcia]

Thanks a lot for your help debugging this issue, @benhutton. Thanks to these traces, I can see that the problem happens inside one of the selenium-manager dependencies, concretely in reqwest (used for handling HTTP connections). The last logged trace is this one.

To try to narrow the cause of the problem, I changed how the HTTP client is configured by default in selenium-manager. @benhutton Do you mind repeating the test (i.e., executing selenium-manager --driver chromedriver --trace) using the following binaries:

a) [without accepting invalid certs] : selenium-manager_linux-x64
b) [without rustls-tls] : selenium-manager_linux-x64
c) [without accepting invalid certs nor rustls-tls] : selenium-manager_linux-x64

Many thanks again.

[benhutton]

a)

 ./selenium-manager --driver chromedriver --trace
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Using shell command to find out chrome version
DEBUG	Running command: "google-chrome --version"
DEBUG	Output: "Google Chrome 110.0.5481.177 "
DEBUG	The version of chrome is 110.0.5481.177
TRACE	Writing metadata to /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Detected browser: chrome 110
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Reading chromedriver version from https://chromedriver.storage.googleapis.com/LATEST_RELEASE_110
DEBUG	starting new connection: https://chromedriver.storage.googleapis.com/
[1]    6761 segmentation fault (core dumped)  ./selenium-manager --driver chromedriver --trace

b)

./selenium-manager --driver chromedriver --trace
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Using shell command to find out chrome version
DEBUG	Running command: "google-chrome --version"
DEBUG	Output: "Google Chrome 110.0.5481.177 "
DEBUG	The version of chrome is 110.0.5481.177
TRACE	Writing metadata to /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Detected browser: chrome 110
TRACE	Reading metadata from /home/ben/.cache/selenium/selenium-manager.json
DEBUG	Reading chromedriver version from https://chromedriver.storage.googleapis.com/LATEST_RELEASE_110
[1]    7131 segmentation fault (core dumped)  ./selenium-manager --driver chromedriver --trace

c)

./selenium-manager --driver chromedriver --trace
[1]    7342 segmentation fault (core dumped)  ./selenium-manager --driver chromedriver --trace