[runtime-perf][release/6.0] Runs are failing with error NU1102 and other issues

[LoopedBard3]

Runs are failing with error NU1102 and other issues. The change to #2670 should likely be backported to release 6.0 also, and release6.0 may need to have the performance-setup updated to use release/6.0 performance.