Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track PGO profiles in depinfo #100801

Merged
merged 1 commit into from
Sep 7, 2022
Merged

Conversation

Kobzol
Copy link
Contributor

@Kobzol Kobzol commented Aug 20, 2022

This PR makes sure that PGO profiles (-Cprofile-use and -Cprofile-sample-use) are tracked in depinfo, so that when they change, the compilation session will be invalidated.

This approach was discussed on Zulip.

I tried it locally and it seems that the code is recompiled just with this change, and #100413 is not even needed. But it's possible that not everything required is recompiled, so we will probably want to land both changes.

Another approach to implement this could be to store the PGO profiles in sess.parse_sess.file_depinfo when the session is being created, but then the paths would have to be converted to a string and then to a symbol, which seemed unnecessarily complicated.

CC @michaelwoerister

r? @Eh2406

@rustbot rustbot added the T-compiler Relevant to the compiler team, which will review and decide on the PR/issue. label Aug 20, 2022
@rust-highfive rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Aug 20, 2022
@rust-log-analyzer

This comment has been minimized.

@Kobzol Kobzol force-pushed the track-pgo-profile-paths branch 2 times, most recently from 0a9e256 to aec34d6 Compare August 20, 2022 13:55
@Eh2406
Copy link
Contributor

Eh2406 commented Aug 20, 2022

Looks reasonable, but I am not a reviewer on the rust repo.

@Kobzol
Copy link
Contributor Author

Kobzol commented Aug 20, 2022

r? @michaelwoerister

@michaelwoerister
Copy link
Member

Thanks a lot, @Kobzol! Looks good.

@bors r+ rollup=never (I prefer to not rollup PRs that modify run-make tests -- those are too flaky)

@bors
Copy link
Contributor

bors commented Aug 22, 2022

📌 Commit aec34d6ed5d3ef87b34d4e6323848160f5d97298 has been approved by michaelwoerister

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Aug 22, 2022
@bors
Copy link
Contributor

bors commented Aug 25, 2022

⌛ Testing commit aec34d6ed5d3ef87b34d4e6323848160f5d97298 with merge 71b88e490749a284c99f46df5bad873b27a413c3...

@bors
Copy link
Contributor

bors commented Aug 25, 2022

💔 Test failed - checks-actions

@bors bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Aug 25, 2022
@rust-log-analyzer

This comment has been minimized.

@rustbot rustbot added the T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. label Aug 25, 2022
@Kobzol
Copy link
Contributor Author

Kobzol commented Aug 29, 2022

Fixed the MSVC CI failure.

@rustbot ready

@Kobzol
Copy link
Contributor Author

Kobzol commented Aug 30, 2022

@michaelwoerister Probably the PR will have to be reapproved.

@michaelwoerister
Copy link
Member

@bors r+

@bors
Copy link
Contributor

bors commented Sep 6, 2022

📌 Commit 925644e has been approved by michaelwoerister

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 6, 2022
@bors
Copy link
Contributor

bors commented Sep 7, 2022

⌛ Testing commit 925644e with merge ff479b1...

@bors
Copy link
Contributor

bors commented Sep 7, 2022

☀️ Test successful - checks-actions
Approved by: michaelwoerister
Pushing ff479b1 to master...

@bors bors added the merged-by-bors This PR was explicitly merged by bors. label Sep 7, 2022
@bors bors merged commit ff479b1 into rust-lang:master Sep 7, 2022
@rustbot rustbot added this to the 1.65.0 milestone Sep 7, 2022
@Kobzol Kobzol deleted the track-pgo-profile-paths branch September 7, 2022 06:10
@rust-timer
Copy link
Collaborator

Finished benchmarking commit (ff479b1): comparison URL.

Overall result: ❌ regressions - ACTION NEEDED

Next Steps: If you can justify the regressions found in this perf run, please indicate this with @rustbot label: +perf-regression-triaged along with sufficient written justification. If you cannot justify the regressions please open an issue or create a new PR that fixes the regressions, add a comment linking to the newly created issue or PR, and then add the perf-regression-triaged label to this PR.

@rustbot label: +perf-regression
cc @rust-lang/wg-compiler-performance

Instruction count

This is a highly reliable metric that was used to determine the overall result at the top of this comment.

mean1 range count2
Regressions ❌
(primary)
- - 0
Regressions ❌
(secondary)
2.0% [1.8%, 2.4%] 6
Improvements ✅
(primary)
- - 0
Improvements ✅
(secondary)
- - 0
All ❌✅ (primary) - - 0

Max RSS (memory usage)

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions ❌
(primary)
- - 0
Regressions ❌
(secondary)
2.1% [2.1%, 2.1%] 1
Improvements ✅
(primary)
-2.8% [-2.8%, -2.8%] 1
Improvements ✅
(secondary)
- - 0
All ❌✅ (primary) -2.8% [-2.8%, -2.8%] 1

Cycles

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions ❌
(primary)
2.7% [2.0%, 3.4%] 2
Regressions ❌
(secondary)
- - 0
Improvements ✅
(primary)
-2.7% [-3.1%, -2.3%] 2
Improvements ✅
(secondary)
- - 0
All ❌✅ (primary) 0.0% [-3.1%, 3.4%] 4

Footnotes

  1. the arithmetic mean of the percent change 2 3

  2. number of relevant changes 2 3

@rustbot rustbot added the perf-regression Performance regression. label Sep 7, 2022
@Kobzol
Copy link
Contributor Author

Kobzol commented Sep 7, 2022

PGO is not used when compiling the perf. suite benchmarks and keccak has been bimodal lately, so this is just noise.

@rustbot label: +perf-regression-triaged

@rustbot rustbot added the perf-regression-triaged The performance regression has been triaged. label Sep 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
merged-by-bors This PR was explicitly merged by bors. perf-regression Performance regression. perf-regression-triaged The performance regression has been triaged. S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. T-compiler Relevant to the compiler team, which will review and decide on the PR/issue. T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants