Skip to content

[net11.0] Screenshot baseline mismatches after main merge (Shell, TabbedPage, Image, Flyout) #34586

Open
Open
[net11.0] Screenshot baseline mismatches after main merge (Shell, TabbedPage, Image, Flyout)#34586
Labels
Known Build Errors/triagedIssue has been reviewed
@PureWeen

Description

@PureWeen
PureWeen
opened on Mar 20, 2026

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Build error leg or test failing: Shell, TabbedPage UITests on Android API30
Pull request: #34550

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Description

After merging main → net11.0 (PR #34550), UITests fail with screenshot baseline mismatches. The root cause is the Material3 package (#33450) changing BottomNavigationView.MaxItemCount from 5 → 6 on net11.0, which altered bottom tab layout rendering.

Status

16 of the original 26 snapshots have been fixed by PR #34601, which clamps MaxItemCount back to 5 and updates the affected baselines. Issue16918Test was split to its own Known Build Error (#34624) since it has a different root cause (MacCatalyst flaky, not MaxItemCount). The pattern above now only covers the 9 remaining unfixed VerifyShell_ snapshots*.

Remaining unfixed snapshots (9)

Snapshot Test Platform Notes
VerifyShell_IsVisible.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorSetToNull.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarDisabledColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarForegroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColorAndUnSelectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarUnselectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline

Split to separate Known Build Errors

Fixed by PR #34601 (removed from pattern)

16 snapshots with updated baselines (click to expand)
  • DynamicFontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • DynamicTabSectionVisibility.png
  • FontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • ImageDoesNotDisappearWhenSwitchingTab.png
  • Issue32993TabBarUpdatesCorrectlyInRTLMode.png
  • NavigationBarLayoutWithMixedHasNavigationBar.png
  • ShellAppearanceUpdatesWhenChangingBetweenTabs.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_1.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_2.png
  • ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout.png
  • TabBarIconsShouldAutoscaleShell.png
  • TabBarShouldBeVisibleOnMacCatalyst.png
  • VerifyShell_TabBarBackgroundColorAndForegroundColor.png
  • VerifyShell_TabBarForegroundColor.png
  • VerifyShell_TabBarForegroundColorAndUnSelectedColor.png
  • VerifyTabbedPageMenuItemTextColor.png

Resolution

Once PR #34601 merges and the remaining 9 VerifyShell_* snapshots are confirmed passing (or baselines updated), close this issue.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Error message validated: [Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/24/2026 8:07:14 PM UTC

Report

Build Definition Step Name Console log Pull Request
1389602 dotnet/maui Controls (vlatest) Shell Log #34600
1389354 dotnet/maui Controls (vlatest) Shell Log
1385910 dotnet/maui Controls (vlatest) Shell Log #34790
1385176 dotnet/maui Controls (vlatest) Shell Log #35028
1384850 dotnet/maui Controls (vlatest) Shell Log #34573
1384804 dotnet/maui Controls (vlatest) Shell Log #35001
1384769 dotnet/maui Controls (vlatest) Shell Log
1384155 dotnet/maui Controls (vlatest) Shell Log #31159
1384069 dotnet/maui Controls (vlatest) Shell Log
1383888 dotnet/maui Controls (vlatest) Shell Log
1383543 dotnet/maui Controls (vlatest) Shell Log
1383461 dotnet/maui Controls (vlatest) Shell Log #35001
1382887 dotnet/maui Controls (vlatest) Shell Log
1382099 dotnet/maui Controls (vlatest) Shell Log
1381853 dotnet/maui Controls (vlatest) Shell Log #34996
1381821 dotnet/maui Controls (vlatest) Shell Log
1381784 dotnet/maui Controls (vlatest) Shell Log #34978
1381780 dotnet/maui Controls (vlatest) Shell Log
1379907 dotnet/maui Controls (vlatest) Shell Log
1378994 dotnet/maui Controls (vlatest) Shell Log
1378708 dotnet/maui Controls (vlatest) Shell Log
1362580 dotnet/maui Controls Shell Log
1357500 dotnet/maui Controls Shell Log #32529
Build Definition Test Pull Request
1391786 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1391682 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #35094
1391788 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1391774 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1391532 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35074
1391021 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34758
1391115 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2957292 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1390613 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34699
2957284 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1390611 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #35011
1389981 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2956713 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2956585 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1388732 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34737
1388730 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #31672
1388870 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1388620 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34007
1388617 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34632
1388618 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34615
1388619 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34637
1388422 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1388407 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387759 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387748 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387757 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387755 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387756 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387750 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387738 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1387730 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1384766 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1384047 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386941 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #35037
2955634 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386833 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386831 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386830 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386824 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386606 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #35031
1386564 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34573
1386687 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34831
1386274 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386269 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1386224 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1385823 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1385666 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34844
1385664 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #31790
1385278 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1385211 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1384827 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34980
1384193 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34923
1384115 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #35016
1383960 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34804
1384000 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34758
2953794 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1383651 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34637
1383561 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1383415 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34996
1382435 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34710
1381972 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34969
1381953 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1381751 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34935
1381750 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34907
1381752 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34704
1381593 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34991
1381544 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34989
1381541 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34981
1380836 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34984
1380395 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1380424 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34970
1380318 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34983
1380249 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34959
1380238 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1379656 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #33335
1379653 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34614
1379652 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #28335
1379645 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34699
1379651 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #33312
1379649 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible #34923
1376773 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2949744 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1375765 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1374433 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2948283 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1371822 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34882
2942074 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1350456 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Android).VerifyShell_TabBarBackgroundColorSetToNull #34618
1350369 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1350390 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue14587(Android).ImageDoesNotDisappearWhenSwitchingTab
1349891 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34601
1350231 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue14587(Android).ImageDoesNotDisappearWhenSwitchingTab
1348174 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #33231
1343658 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34107

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
8 84 117

Metadata

Metadata

Assignees

No one assigned

    Labels

    Known Build Errors/triagedIssue has been reviewed

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions