test_ttk_guionly test failures on macOS with Tcl/Tk 8.6.10

[ned-deily]

BPO	42507
Nosy	@terryjreedy, @ronaldoussoren, @vstinner, @ned-deily, @serhiy-storchaka

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2020-11-30.02:46:40.854>
labels = ['OS-mac', '3.8', 'expert-tkinter', '3.9', '3.10']
title = 'test_ttk_guionly test failures on macOS with Tcl/Tk 8.6.10'
updated_at = <Date 2021-01-27.11:55:43.827>
user = 'https://github.com/ned-deily'

bugs.python.org fields:

activity = <Date 2021-01-27.11:55:43.827>
actor = 'vstinner'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['macOS', 'Tkinter']
creation = <Date 2020-11-30.02:46:40.854>
creator = 'ned.deily'
dependencies = []
files = []
hgrepos = []
issue_num = 42507
keywords = []
message_count = 12.0
messages = ['382109', '382121', '382175', '382206', '382296', '382328', '382364', '382428', '382441', '382446', '382447', '385764']
nosy_count = 5.0
nosy_names = ['terry.reedy', 'ronaldoussoren', 'vstinner', 'ned.deily', 'serhiy.storchaka']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = None
url = 'https://bugs.python.org/issue42507'
versions = ['Python 3.8', 'Python 3.9', 'Python 3.10']

Linked PRs

• gh-86673: Harden test_ttk.test_element_create_image #123335
• [3.13] gh-86673: Harden test_ttk.test_element_create_image (GH-123335) #124654
• [3.12] gh-86673: Harden test_ttk.test_element_create_image (GH-123335) #124655
• gh-86673: Loosen test_ttk.test_identify() requirements #125335
• [3.13] gh-86673: Loosen test_ttk.test_identify() requirements (GH-125335) #125390
• [3.12] gh-86673: Loosen test_ttk.test_identify() requirements (GH-125335) #125391

[ned-deily]

As of 3.9.1rc1 (and coming soon to 3.10.x and 3.8.x), we now provide a new additional macOS universal2 installer variant that, for various reasons, provides a built-in version of Tcl/Tk 8.6.10, instead of 8.6.8 as has been provided with the 10.9 installer variant. Using 8.6.10 on nacOS, six test_ttk_guionly tests fail while passing using 8.6.8 ib nacOS. Similar results were obtained when running the tests on either macOS 10.15.7 or 11.0.1. The failures:

======================================================================
FAIL: test_identify (tkinter.test.test_ttk.test_widgets.ComboboxTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 334, in test_identify
    self.assertIn(self.entry.identify(5, 5),
AssertionError: '' not found in ('textarea', 'Combobox.button')

======================================================================
FAIL: test_identify (tkinter.test.test_ttk.test_widgets.EntryTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 334, in test_identify
    self.assertIn(self.entry.identify(5, 5),
AssertionError: '' not found in ('textarea', 'Combobox.button')

======================================================================
FAIL: test_command (tkinter.test.test_ttk.test_widgets.SpinboxTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 1155, in test_command
    self.assertTrue(success)
AssertionError: [] is not true

======================================================================
FAIL: test_identify (tkinter.test.test_ttk.test_widgets.SpinboxTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 334, in test_identify
    self.assertIn(self.entry.identify(5, 5),
AssertionError: 'Spinbox.field' not found in ('textarea', 'Combobox.button')

======================================================================
FAIL: test_bbox (tkinter.test.test_ttk.test_widgets.TreeviewTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 1353, in test_bbox
    self.assertIsBoundingBox(bbox)
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/widget_tests.py", line 197, in assertIsBoundingBox
    self.assertIsInstance(bbox, tuple)
AssertionError: '' is not an instance of <class 'tuple'>

======================================================================
FAIL: test_identify (tkinter.test.test_ttk.test_widgets.WidgetTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_widgets.py", line 68, in test_identify
    self.assertEqual(self.widget.identify(
AssertionError: '' != 'label'
+ label

https://www.python.org/downloads/release/python-391rc1/

[serhiy-storchaka]

Try to test with 6cc2c41 (PR-23474). All of failing tests were modified to make them passing on Windows, so I expect that this can help on macOS too (in most cases). If it does not help I will propose other changes for testing.

[ned-deily]

I tested on 3.9 with the backport of #67662 merged. The six failures are still there plus there is now an additional failure:

======================================================================
FAIL: test_horizontal_range (tkinter.test.test_ttk.test_extensions.LabeledScaleTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/tkinter/test/test_ttk/test_extensions.py", line 121, in test_horizontal_range
    self.assertEqual(prev_xcoord, int(linfo_1['x']))
AssertionError: 12 != 0

[serhiy-storchaka]

I have no ideas. Try to add more calls of update() in these tests.

[serhiy-storchaka]

Can I get a remote access to machine with macOS?