Clean up the main CI steps

[justinchuby]

          LGTM thanks! There is a step in the ci job

      - name: Upload IR profiling results
        if: matrix.name == 'py311' || matrix.name == 'py311-onnx-weekly'
        uses: actions/upload-artifact@v3
        with:
          name: IR profiling results
          path: tests/ir/serde_test_profiles

That can be removed too.

Originally posted by @justinchuby in #1609 (review)