Skip to content

CI failure on tvOS: test run failed, errors reading device logs, wall clock adjustment detected #128707

Closed

Description

@svick

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1437353
Build error leg or test failing: System.Runtime.Tests.WorkItemExecution
Pull request: #126200

Error Message

DO NOT USE JSON BELOW IF THIS IS A BUILD BREAK otherwise build analysis will allow pull requests to merge that break the build worse. For a build break, do not use this issue form. Make a regular new issue.

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Errors while reading device logs: Wall Clock adjustment detected - results might be strange while using --end",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
[06:34:42] dbug: Test log server listening on: 0.0.0.0:55876
[06:34:42] dbug: 
[06:34:42] dbug: Running /private/tmp/helix/working/C5320A38/p/microsoft.dotnet.xharness.cli/11.0.0-prerelease.26230.4/tools/net8.0/any/../../../runtimes/any/native/mlaunch/bin/mlaunch
[06:34:44] dbug: Process mlaunch exited with 0
[06:34:44] dbug: Starting the application
[06:34:44] dbug: 
[06:34:44] dbug: Running /private/tmp/helix/working/C5320A38/p/microsoft.dotnet.xharness.cli/11.0.0-prerelease.26230.4/tools/net8.0/any/../../../runtimes/any/native/mlaunch/bin/mlaunch
[06:34:46] dbug: Process mlaunch exited with 1
[06:34:46] dbug: Test run failed
[06:34:52] dbug: Errors while reading device logs: Wall Clock adjustment detected - results might be strange while using --end
[06:34:52] dbug: Device log captured in /tmp/helix/working/C5320A38/w/A56F093F/uploads/device-DNCENGTVOS-059-20260528_063442.log
[06:34:52] dbug: 
[06:34:52] dbug: Running /bin/bash
[06:34:52] dbug: Running devicectl with elevated privileges via sudo is unlikely to work properly. Please do not do this.
[06:34:52] dbug: 06:34:52  Acquired tunnel connection to device.
[06:34:52] dbug: 06:34:52  Enabling developer disk image services.
[06:34:52] dbug: 06:34:52  Acquired usage assertion.
[06:34:52] dbug: ERROR: Failed to retrieve the file node for /Library/Caches/Documents/test-results.xml (com.apple.dt.CoreDeviceError error 7000 (0x1B58))
[06:34:52] dbug: Process bash exited with 1
[06:34:52] dbug: Failed to copy results file from device (attempt 1). Expected at: /tmp/helix/working/C5320A38/w/A56F093F/uploads/test-tvos-device-20260528_063442.log
[06:34:52] dbug: Retrying results file copy (attempt 2) after 5s delay...
[06:34:57] dbug: 
[06:34:57] dbug: Running /bin/bash
[06:34:57] dbug: Running devicectl with elevated privileges via sudo is unlikely to work properly. Please do not do this.
[06:34:57] dbug: 06:34:57  Acquired tunnel connection to device.
[06:34:58] dbug: 06:34:58  Enabling developer disk image services.
[06:34:58] dbug: 06:34:58  Acquired usage assertion.
[06:34:58] dbug: ERROR: Failed to retrieve the file node for /Library/Caches/Documents/test-results.xml (com.apple.dt.CoreDeviceError error 7000 (0x1B58))
[06:34:58] dbug: Process bash exited with 1
[06:34:58] dbug: Failed to copy results file from device (attempt 2). Expected at: /tmp/helix/working/C5320A38/w/A56F093F/uploads/test-tvos-device-20260528_063442.log
[06:34:58] dbug: Retrying results file copy (attempt 3) after 10s delay...
[06:35:08] dbug: 
[06:35:08] dbug: Running /bin/bash
[06:35:08] dbug: Running devicectl with elevated privileges via sudo is unlikely to work properly. Please do not do this.
[06:35:08] dbug: 06:35:08  Acquired tunnel connection to device.
[06:35:08] dbug: 06:35:08  Enabling developer disk image services.
[06:35:08] dbug: 06:35:08  Acquired usage assertion.
[06:35:08] dbug: ERROR: Failed to retrieve the file node for /Library/Caches/Documents/test-results.xml (com.apple.dt.CoreDeviceError error 7000 (0x1B58))
[06:35:08] dbug: Process bash exited with 1
[06:35:08] dbug: Failed to copy results file from device (attempt 3). Expected at: /tmp/helix/working/C5320A38/w/A56F093F/uploads/test-tvos-device-20260528_063442.log
[06:35:08] dbug: Retrying results file copy (attempt 4) after 20s delay...
[06:35:28] dbug: 
[06:35:28] dbug: Running /bin/bash
[06:35:28] dbug: Running devicectl with elevated privileges via sudo is unlikely to work properly. Please do not do this.
[06:35:30] dbug: 06:35:30  Acquired tunnel connection to device.
[06:35:30] dbug: 06:35:30  Enabling developer disk image services.
[06:35:30] dbug: 06:35:30  Acquired usage assertion.
[06:35:30] dbug: ERROR: Failed to retrieve the file node for /Library/Caches/Documents/test-results.xml (com.apple.dt.CoreDeviceError error 7000 (0x1B58))
[06:35:30] dbug: Process bash exited with 1
[06:35:30] dbug: Failed to copy results file from device (attempt 4). Expected at: /tmp/helix/working/C5320A38/w/A56F093F/uploads/test-tvos-device-20260528_063442.log
[06:35:30] dbug: Test results file not found, app may have crashed before tests started.
[06:35:30] dbug: Attempting to retrieve crash report from device...
[06:35:30] dbug: 
[06:35:30] dbug: Running /private/tmp/helix/working/C5320A38/p/microsoft.dotnet.xharness.cli/11.0.0-prerelease.26230.4/tools/net8.0/any/../../../runtimes/any/native/mlaunch/bin/mlaunch
[06:35:31] dbug: Process mlaunch exited with 0
[06:35:31] dbug: Found crash report: System.Text.Encodings.Web.Tests.cpu_resource-2026-05-22-142154.ips

(Note that the crash report is old and irrelevant.)

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1437353
Error message validated: [Errors while reading device logs: Wall Clock adjustment detected - results might be strange while using --end]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 5/28/2026 3:42:42 PM UTC

Report

Build Repository Test Pull Request
1508982 dotnet/runtime System.Diagnostics.TraceSource.Tests.WorkItemExecution
1508917 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130724
1508897 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130722
1508374 dotnet/runtime System.Globalization.CalendarsWithConfigSwitch.Tests.WorkItemExecution
1507280 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130651
1507181 dotnet/runtime System.IO.Compression.ZipFile.Tests.WorkItemExecution
1507290 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130652
1507089 dotnet/runtime System.Diagnostics.DiagnosticSource.Switches.Tests.WorkItemExecution
1507176 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1507172 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1507107 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1507086 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1499665 dotnet/runtime System.Formats.Tar.Manual.Tests.WorkItemExecution
1499248 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130346
1499661 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1505679 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130356
1505820 dotnet/runtime iOS.CoreCLR.R2R.Test.WorkItemExecution #130300
1505682 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130355
1505374 dotnet/runtime System.Net.Primitives.Functional.Tests.WorkItemExecution
1505016 dotnet/runtime System.Diagnostics.FileVersionInfo.Tests.WorkItemExecution
1504972 dotnet/runtime System.Net.Primitives.Functional.Tests.WorkItemExecution
1505013 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1505006 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1504968 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130574
1504386 dotnet/runtime System.Net.Primitives.Functional.Tests.WorkItemExecution
1503537 dotnet/runtime System.IO.Pipes.Tests.WorkItemExecution #130469
1503536 dotnet/runtime System.Net.NameResolution.Pal.Tests.WorkItemExecution #130468
1499642 dotnet/runtime iOS.Device.Aot.Test.WorkItemExecution
1502946 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130356
1502949 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130355
1502636 dotnet/runtime System.ComponentModel.EventBasedAsync.Tests.WorkItemExecution
1502635 dotnet/runtime System.Globalization.Tests.WorkItemExecution
1502303 dotnet/runtime System.Globalization.Tests.WorkItemExecution
1501158 dotnet/runtime System.Collections.Tests.BitArray_CtorTests.Clone_LongLength_Works #130402
1501559 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1501202 dotnet/runtime System.Diagnostics.TextWriterTraceListener.Tests.WorkItemExecution
1501214 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130343
1500996 dotnet/runtime Microsoft.Extensions.Logging.Tests.WorkItemExecution #130168
1501174 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1500869 dotnet/runtime Microsoft.Extensions.Diagnostics.Tests.WorkItemExecution #130340
1500901 dotnet/runtime System.Data.DataSetExtensions.Tests.WorkItemExecution #130328
1500857 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130342
1500854 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130343
1500658 dotnet/runtime System.Collections.Specialized.Tests.WorkItemExecution
1500425 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130385
1499654 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130328
1500276 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130269
1500595 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130392
1500024 dotnet/runtime System.Diagnostics.Tools.Tests.WorkItemExecution
1499832 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130341
1499581 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130360
1500022 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1499481 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130356
1499478 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130355
1499399 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130345
1499408 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1499295 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1493929 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130195
1499030 dotnet/runtime System.Globalization.IOS.Tests.WorkItemExecution
1499027 dotnet/runtime iOS.Device.Aot.Test.WorkItemExecution
1499011 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1498949 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130342
1498944 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130210
1498958 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130343
1498648 dotnet/runtime System.Xml.XmlSerializer.ReflectionOnly.Tests.WorkItemExecution #130168
1498414 dotnet/runtime System.Xml.XmlSerializer.ReflectionOnly.Tests.WorkItemExecution
1498243 dotnet/runtime System.Xml.XmlSerializer.ReflectionOnly.Tests.WorkItemExecution #130269
1498362 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130194
1497883 dotnet/runtime System.Net.Security.Unit.Tests.WorkItemExecution #130168
1496784 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130292
1496783 dotnet/runtime System.Net.Security.Unit.Tests.WorkItemExecution #130168
1496347 dotnet/runtime System.Xml.XmlSerializer.ReflectionOnly.Tests.WorkItemExecution
1496248 dotnet/runtime System.Xml.XmlSerializer.ReflectionOnly.Tests.WorkItemExecution #124721
1496266 dotnet/runtime System.Diagnostics.TraceSource.Config.Tests.WorkItemExecution
1495952 dotnet/runtime System.Formats.Nrbf.Tests.WorkItemExecution
1496316 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #129357
1496253 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #129355
1495674 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130259
1495838 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130262
1495180 dotnet/runtime System.Diagnostics.Debug.Tests.WorkItemExecution
1495192 dotnet/runtime System.IO.Compression.Tests.WorkItemExecution
1495189 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution
1495183 dotnet/runtime System.Runtime.Tests.WorkItemExecution
1494859 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130232
1494829 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1494925 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130235
1494825 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #129357
1494308 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1494284 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130207
1494245 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130207
1493986 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1493925 dotnet/runtime iOS.Device.ExportManagedSymbols.Test.WorkItemExecution #130194
1493682 dotnet/runtime System.Runtime.Tests.WorkItemExecution #130099
1493305 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #130168
1493092 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution #129845
1492827 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1492735 dotnet/runtime System.Diagnostics.Tests.FileVersionInfoTest.FileVersionInfo_CustomManagedAssembly #130061
1492684 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1492589 dotnet/runtime System.Runtime.Caching.Tests.WorkItemExecution
1492240 dotnet/runtime System.Net.Security.Unit.Tests.WorkItemExecution
Displaying 100 of 189 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 65 189

Activity

  1. dotnet-policy-service commented on May 28, 2026

    @dotnet-policy-service
    Contributor

    Tagging subscribers to 'os-tvos': @vitek-karas, @kotlarmilos, @steveisok, @akoeplinger
    See info in area-owners.md if you want to be subscribed.

  2. dotnet-policy-service commented on May 28, 2026

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @akoeplinger, @matouskozak, @simonrozsival
    See info in area-owners.md if you want to be subscribed.

  3. removed
    untriagedNew issue has not been triaged by the area owner
    on Jul 11, 2026
  4. added this to the Future milestone on Jul 11, 2026
  5. matouskozak commented on Jul 14, 2026

    @matouskozak
    Member

    This error message Errors while reading device logs: Wall Clock adjustment detected - results might be strange while using --end is not a failure message. @vitek-karas fixed xharness to not report it as error but a warning. I think we should close this issue as it's matching a vast range of failures on a message that is not relevant.

  6. kotlarmilos commented on Jul 15, 2026

    @kotlarmilos
    Member

    Yes, this is wrong and it masks real failures. Closing this issue. If we want to keep it open then a new regex is needed.

  7. locked and limited conversation to collaborators on Aug 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Known Build ErrorUse this to report build issues in the .NET Helix tabarea-Infrastructure-monoblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'os-tvosApple tvOS

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions