Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ft-benchmark] benchmarknet #11826

Merged
merged 4 commits into from
Jul 22, 2024
Merged

[ft-benchmark] benchmarknet #11826

merged 4 commits into from
Jul 22, 2024

Conversation

MCJOHN974
Copy link
Contributor

No description provided.

@@ -11,3 +11,6 @@ pub const STATELESSNET: &str = "statelessnet";

/// Pre-release testing environment.
pub const MOCKNET: &str = "mocknet";

/// Used by ft-benchmark. TODO: Put link to ft-benchmark docs.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can use http://go/crt-benchmark as a link here.

near_primitives_core::chains::BENCHMARKNET => {
let mut config_store = Self::new(None);
let mut config = RuntimeConfig::clone(config_store.get_config(PROTOCOL_VERSION));
config.congestion_control_config.max_tx_gas = 10u64.pow(8);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think a good value for max and min gas would be 100 PGas, so higher than the current value.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, we can also use an old "unlimited" value: 9_223_372_036_854_775_807

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Btw I seen high tps on gcp without changing this values

@@ -136,6 +138,18 @@ impl RuntimeConfigStore {
let genesis_runtime_config = RuntimeConfig::initial_testnet_config();
Self::new(Some(&genesis_runtime_config))
}
near_primitives_core::chains::BENCHMARKNET => {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to add a detailed comment here:

// In benchmarknet, we are measuring the peak throughput that the NEAR network can handle while still being stable.
// This requires increasing the limits below that are set too conservatively.

@@ -130,12 +132,26 @@ impl RuntimeConfigStore {
/// first protocol versions.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The line 131 got out of date, it needs to include "except testnet and benchmarknet"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It says "for first protocol versions" while we are overriding only last.

Copy link

codecov bot commented Jul 22, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.82%. Comparing base (229d287) to head (eb13f17).

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #11826      +/-   ##
==========================================
+ Coverage   71.80%   71.82%   +0.02%     
==========================================
  Files         796      796              
  Lines      163200   163216      +16     
  Branches   163200   163216      +16     
==========================================
+ Hits       117182   117232      +50     
+ Misses      40973    40947      -26     
+ Partials     5045     5037       -8     
Flag Coverage Δ
backward-compatibility 0.23% <0.00%> (-0.01%) ⬇️
db-migration 0.23% <0.00%> (-0.01%) ⬇️
genesis-check 1.35% <0.00%> (-0.01%) ⬇️
integration-tests 37.80% <6.25%> (+0.05%) ⬆️
linux 71.57% <100.00%> (+0.02%) ⬆️
linux-nightly 71.39% <100.00%> (+<0.01%) ⬆️
macos 54.68% <100.00%> (+1.61%) ⬆️
pytests 1.62% <0.00%> (-0.01%) ⬇️
sanity-checks 1.42% <0.00%> (-0.01%) ⬇️
unittests 66.27% <100.00%> (+0.01%) ⬆️
upgradability 0.28% <0.00%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@MCJOHN974 MCJOHN974 force-pushed the akashin/benchmark_override branch from e8cb966 to 2ed14a6 Compare July 22, 2024 14:28
@MCJOHN974 MCJOHN974 marked this pull request as ready for review July 22, 2024 14:28
@MCJOHN974 MCJOHN974 requested a review from a team as a code owner July 22, 2024 14:28
@MCJOHN974 MCJOHN974 requested a review from saketh-are July 22, 2024 14:28
@MCJOHN974 MCJOHN974 enabled auto-merge July 22, 2024 14:28
@MCJOHN974 MCJOHN974 added this pull request to the merge queue Jul 22, 2024
Merged via the queue into master with commit 1ab9b42 Jul 22, 2024
30 checks passed
@MCJOHN974 MCJOHN974 deleted the akashin/benchmark_override branch July 22, 2024 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants