Skip to content

[benchmark] Rename InsertCharacter to String.insert #20837

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

palimondo
Copy link
Contributor

Applying new Benchmark Naming Convention #20334

@palimondo palimondo requested a review from eeckstein November 28, 2018 20:53
@palimondo
Copy link
Contributor Author

@eeckstein I'll try to kill two birds with one stone here 😜:

This can be used to validate working of #20807, because the new naming convention hasn't landed yet and the Benchmark Check will complain that the new names don't match the UpperCamelCase convention…

…but given these are quite recent additions, could we rename them for real, without disturbing the long-term performance tracking?

@palimondo palimondo changed the title [benchmark] Rename InserCharacter to String.insert [benchmark] Rename InsertCharacter to String.insert Nov 28, 2018
@eeckstein
Copy link
Contributor

could we rename them for real, without disturbing the long-term performance tracking?

Renaming them will make these benchmarks useless until we do a rebase.
Therefore I prefer to apply the new naming conventions only on new benchmarks.

@palimondo
Copy link
Contributor Author

What is the rebase in this case?

@palimondo
Copy link
Contributor Author

@eeckstein ^^

...also, analyzing weird memory behavior of these benchmarks with @milseman in #20807 (comment), we've discovered these benchmarks need to be corrected to perform linear work regardless of N/--num-iters. If that fix changes reported times it might make sense to couple that with this rename, right?

@milseman
Copy link
Member

milseman commented Dec 3, 2018

Along the lines of what Erik said, a rename alone doesn't give us value in converging or improving performance for Swift. But, if a benchmark is flawed, and we fix that flaw, we should update to follow the new naming convention. This could be fixing the benchmark to be linear in time/space with iteration count, readjusting the multiplier to run in a targeted time frame, etc.

@CodaFi
Copy link
Contributor

CodaFi commented Nov 18, 2019

There hasn't been movement here in a year. It seems like the consensus is that we shouldn't take this without some more work. I'm going to close this out, but if you would like to pursue this please reopen it and respond to the feedback, or give us a new pull request.

Thanks @palimondo!

@CodaFi CodaFi closed this Nov 18, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants