eventpipe/gcdump test failing on large number of PRs

[jkotas]

Raw output file:      /root/helix/work/workitem/tracing/eventpipe/Reports/tracing.eventpipe/gcdump/gcdump/gcdump.output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun gcdump.dll ''
  0.0s: ==TEST STARTING==
  1.6s: Environment is clean.
  1.6s: Started sending sentinel events...
  1.6s: Connecting to EventPipe...
  2.1s: Connected to EventPipe with sessionID '0x7f14008f60'
  2.1s: Creating EventPipeEventSource...
  2.3s: EventPipeEventSource created
  2.4s: Dynamic.All callback registered
  2.4s: Running optional trace validator
  3.0s: Finished running optional trace validator
  3.0s: Starting stream processing...
  3.4s: Saw new provider 'Microsoft-Windows-DotNETRuntime'
  3.6s: Saw sentinel event
  3.6s: Starting event generating action...
  3.6s: Stopping event generating action
  3.6s: Stopped sending sentinel events
  3.6s: Sending StopTracing command...
  3.8s: Saw new provider 'Microsoft-DotNETCore-EventPipe'
  3.8s: Saw new provider 'Microsoft-Windows-DotNETRuntimeRundown'
  3.9s: Finished StopTracing command
  3.9s: Stopping stream processing
  3.9s: Dropped 0 events
  3.9s: Reader task finished
  3.9s: Validating optional callback...
Test failed due to missing GC heap events.
_bulkTypeCount =          300
_bulkNodeCount =          1944
_bulkEdgeCount =          2825
_bulkRootEdgeCount =      226
_bulkRootStaticVarCount = 185
  3.9s: ==TEST FINISHED: FAILED!==
Expected: 100
Actual: 255

[jkotas]

8 CoreCLR legs failed on this in #39356 https://dev.azure.com/dnceng/public/_build/results?buildId=730698&view=ms.vss-test-web.build-test-results-tab&runId=22603798&resultId=102658&paneView=attachments

[jkotas]

I am disabling the test in #39362
cc @hoyosjs @tommcdon

[jkotas]

Failed in #39082 https://dev.azure.com/dnceng/public/_build/results?buildId=730857&view=ms.vss-test-web.build-test-results-tab&runId=22608916&paneView=debug&resultId=102828

[josalem]

CC @davmason, can you take a look at this?

[v-haren]

failed again in job: runtime 20200715.46

failed tests:
tracing/eventpipe/gcdump/gcdump/gcdump.sh
tracing\eventpipe\gcdump\gcdump\gcdump.cmd

Error message

Return code:      1
Raw output file:      /home/helixbot/work/B4070954/w/A8B10944/e/tracing/eventpipe/Reports/tracing.eventpipe/gcdump/gcdump/gcdump.output.txt
Raw output:
BEGIN EXECUTION
/home/helixbot/work/B4070954/p/corerun gcdump.dll ''
  0.0s: ==TEST STARTING==
  1.7s: Environment is clean.
  1.8s: Started sending sentinel events...
  1.8s: Connecting to EventPipe...
  2.3s: Connected to EventPipe with sessionID '0x7f26f8009050'
  2.3s: Creating EventPipeEventSource...
  2.4s: EventPipeEventSource created
  2.5s: Dynamic.All callback registered
  2.5s: Running optional trace validator
  2.9s: Finished running optional trace validator
  2.9s: Starting stream processing...
  3.1s: Saw new provider 'Microsoft-Windows-DotNETRuntime'
  3.2s: Saw sentinel event
  3.2s: Starting event generating action...
  3.2s: Stopping event generating action
  3.2s: Stopped sending sentinel events
  3.2s: Sending StopTracing command...
  3.4s: Saw new provider 'Microsoft-DotNETCore-EventPipe'
  3.4s: Saw new provider 'Microsoft-Windows-DotNETRuntimeRundown'
  3.4s: Finished StopTracing command
  3.4s: Stopping stream processing
  3.4s: Dropped 0 events
  3.4s: Reader task finished
  3.4s: Validating optional callback...
Test failed due to missing GC heap events.
_bulkTypeCount =          269
_bulkNodeCount =          1868
_bulkEdgeCount =          2359
_bulkRootEdgeCount =      157
_bulkRootStaticVarCount = 171
  3.4s: ==TEST FINISHED: FAILED!==
Expected: 100
Actual: 255
END EXECUTION - FAILED
Test Harness Exitcode is : 1
To run the test:
> set CORE_ROOT=/home/helixbot/work/B4070954/p
> /home/helixbot/work/B4070954/w/A8B10944/e/tracing/eventpipe/gcdump/gcdump/gcdump.sh
Expected: True
Actual:   False


Stack trace
   at tracing_eventpipe._gcdump_gcdump_gcdump_._gcdump_gcdump_gcdump_sh() in /__w/1/s/artifacts/tests/coreclr/Linux.x64.Checked/TestWrappers/tracing.eventpipe/tracing.eventpipe.XUnitWrapper.cs:line 334