Skip to content

Switch from hyper and tokio to reqwest for profiling #1378

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Switch from hyper and tokio to reqwest for profiling #1378

wants to merge 1 commit into from

Conversation

@realFlowControl
Copy link
Member

@realFlowControl realFlowControl commented Nov 28, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@realFlowControl realFlowControl force-pushed the florian/reqwest branch 3 times, most recently from 1487fcb to 8dac497 Compare November 28, 2025 16:27
@codecov-commenter
Copy link

codecov-commenter commented Nov 28, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 64.66165% with 47 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.15%. Comparing base (5409e70) to head (a88ecc0).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1378      +/-   ##
==========================================
- Coverage   71.23%   71.15%   -0.09%     
==========================================
  Files         395      394       -1     
  Lines       63378    63365      -13     
==========================================
- Hits        45150    45086      -64     
- Misses      18228    18279      +51
Components Coverage Δ
libdd-crashtracker 60.01% <ø> (+0.06%) ⬆️
libdd-crashtracker-ffi 15.79% <ø> (+0.35%) ⬆️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.18% <ø> (+0.17%) ⬆️
libdd-data-pipeline-ffi 77.01% <ø> (-0.63%) ⬇️
libdd-common 80.92% <ø> (-0.23%) ⬇️
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 80.17% <64.66%> (+0.42%) ⬆️
libdd-profiling-ffi 62.74% <87.50%> (+0.60%) ⬆️
datadog-sidecar 36.19% <ø> (-0.80%) ⬇️
datdog-sidecar-ffi 12.40% <ø> (-4.00%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.05% <ø> (-0.02%) ⬇️
datadog-tracer-flare 59.74% <ø> (-2.33%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Nov 28, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-11-28 17:11:08

Comparing candidate commit a88ecc0 in PR branch florian/reqwest with baseline commit 5409e70 in branch main.

Found 4 performance improvements and 8 performance regressions! Performance is the same for 43 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+6.480µs; +6.508µs] or [+14.174%; +14.234%]
  • 🟥 throughput [-2726719.978op/s; -2714010.024op/s] or [-12.467%; -12.409%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-590.007ns; -583.331ns] or [-8.910%; -8.809%]
  • 🟩 throughput [+14600879.634op/s; +14752314.450op/s] or [+9.669%; +9.769%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.948µs; +4.998µs] or [+9.260%; +9.352%]
  • 🟥 throughput [-1600396.874op/s; -1585918.483op/s] or [-8.552%; -8.475%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.573µs; +4.620µs] or [+9.110%; +9.203%]
  • 🟥 throughput [-1678501.440op/s; -1662949.684op/s] or [-8.426%; -8.348%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+6.491µs; +6.520µs] or [+14.201%; +14.265%]
  • 🟥 throughput [-2732827.488op/s; -2719384.833op/s] or [-12.491%; -12.429%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-588.127ns; -582.677ns] or [-8.885%; -8.802%]
  • 🟩 throughput [+14591334.071op/s; +14717008.433op/s] or [+9.659%; +9.742%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.820µs 26.305µs ± 10.143µs 18.254µs ± 0.340µs 34.988µs 44.045µs 45.130µs 74.337µs 307.23% 0.971 0.986 38.46% 0.717µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.899µs; 27.711µs] or [-5.344%; +5.344%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.321µs 205.842µs ± 0.269µs 205.832µs ± 0.180µs 206.005µs 206.306µs 206.491µs 206.622µs 0.38% 0.419 -0.121 0.13% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4839756.955op/s 4858108.935op/s ± 6338.520op/s 4858328.514op/s ± 4255.296op/s 4862857.400op/s 4867798.328op/s 4869611.083op/s 4870419.847op/s 0.25% -0.413 -0.130 0.13% 448.201op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.168µs 18.260µs ± 0.072µs 18.248µs ± 0.040µs 18.294µs 18.378µs 18.483µs 18.684µs 2.39% 1.921 6.521 0.39% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53521537.246op/s 54764176.019op/s ± 214243.038op/s 54799277.021op/s ± 120927.156op/s 54913703.577op/s 55026592.526op/s 55037504.128op/s 55041729.957op/s 0.44% -1.865 6.154 0.39% 15149.271op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.926µs 11.020µs ± 0.044µs 11.014µs ± 0.024µs 11.044µs 11.096µs 11.149µs 11.213µs 1.80% 0.910 1.976 0.40% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 89184952.440op/s 90746827.045op/s ± 362059.376op/s 90790491.861op/s ± 201159.638op/s 90968108.874op/s 91286592.915op/s 91424574.000op/s 91523836.679op/s 0.81% -0.873 1.851 0.40% 25601.464op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.805µs; 205.879µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4857230.477op/s; 4858987.393op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.250µs; 18.270µs] or [-0.055%; +0.055%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54734483.994op/s; 54793868.043op/s] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.014µs; 11.026µs] or [-0.055%; +0.055%] None None None
normalization/normalize_name/normalize_name/good throughput [90696649.097op/s; 90797004.992op/s] or [-0.055%; +0.055%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.009µs 535.963µs ± 0.454µs 535.945µs ± 0.299µs 536.227µs 536.761µs 537.089µs 537.259µs 0.25% 0.317 -0.218 0.08% 0.032µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1861298.652op/s 1865800.288op/s ± 1578.311op/s 1865864.535op/s ± 1041.667op/s 1866905.250op/s 1868260.542op/s 1868838.918op/s 1869127.230op/s 0.17% -0.313 -0.222 0.08% 111.603op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.181µs 381.951µs ± 0.361µs 381.946µs ± 0.237µs 382.173µs 382.544µs 382.831µs 383.233µs 0.34% 0.308 0.116 0.09% 0.026µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2609381.293op/s 2618137.386op/s ± 2476.654op/s 2618173.539op/s ± 1624.332op/s 2619958.502op/s 2622009.871op/s 2622861.914op/s 2623425.916op/s 0.20% -0.302 0.106 0.09% 175.126op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.190µs 195.693µs ± 0.232µs 195.703µs ± 0.170µs 195.857µs 196.085µs 196.225µs 196.280µs 0.29% 0.079 -0.395 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5094768.049op/s 5110047.857op/s ± 6048.154op/s 5109793.322op/s ± 4453.570op/s 5114336.545op/s 5120483.909op/s 5122448.388op/s 5123202.919op/s 0.26% -0.074 -0.398 0.12% 427.669op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.568µs 37.904µs ± 0.098µs 37.904µs ± 0.071µs 37.976µs 38.049µs 38.081µs 38.141µs 0.62% -0.335 -0.110 0.26% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26218700.830op/s 26382894.023op/s ± 68468.845op/s 26382294.322op/s ± 49147.614op/s 26429065.633op/s 26501455.848op/s 26540337.869op/s 26618119.519op/s 0.89% 0.349 -0.089 0.26% 4841.478op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.773µs 45.987µs ± 0.129µs 45.975µs ± 0.047µs 46.023µs 46.098µs 46.225µs 47.491µs 3.30% 8.034 91.113 0.28% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21056813.388op/s 21745438.521op/s ± 59592.756op/s 21750922.693op/s ± 22364.669op/s 21773139.132op/s 21800204.181op/s 21817895.430op/s 21846993.368op/s 0.44% -7.797 87.444 0.27% 4213.844op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.901µs; 536.026µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1865581.549op/s; 1866019.027op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.901µs; 382.001µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617794.146op/s; 2618480.627op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.661µs; 195.725µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5109209.641op/s; 5110886.073op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.890µs; 37.917µs] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26373404.899op/s; 26392383.146op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.969µs; 46.005µs] or [-0.039%; +0.039%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21737179.538op/s; 21753697.504op/s] or [-0.038%; +0.038%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.402ms 61.016ms ± 1.730ms 60.805ms ± 0.085ms 60.873ms 61.257ms 70.106ms 79.848ms 31.32% 8.843 82.802 2.83% 0.122ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.776ms; 61.256ms] or [-0.393%; +0.393%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.602µs 85.967µs ± 0.234µs 85.940µs ± 0.045µs 85.993µs 86.085µs 86.267µs 89.050µs 3.62% 11.512 148.995 0.27% 0.017µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.934µs; 85.999µs] or [-0.038%; +0.038%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.018µs 5.079µs ± 0.040µs 5.077µs ± 0.036µs 5.116µs 5.141µs 5.143µs 5.148µs 1.41% 0.336 -1.396 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.074µs; 5.085µs] or [-0.108%; +0.108%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.702ms 14.769ms ± 0.035ms 14.763ms ± 0.015ms 14.779ms 14.849ms 14.901ms 14.928ms 1.12% 1.803 4.500 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.764ms; 14.774ms] or [-0.033%; +0.033%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.035ms 6.340ms ± 0.097ms 6.374ms ± 0.025ms 6.396ms 6.423ms 6.431ms 6.565ms 3.00% -1.615 1.771 1.52% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.327ms; 6.354ms] or [-0.211%; +0.211%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.856ns 192.507ns ± 1.832ns 192.100ns ± 1.212ns 193.455ns 195.980ns 197.834ns 198.416ns 3.29% 0.985 0.444 0.95% 0.130ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.253ns; 192.760ns] or [-0.132%; +0.132%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.530ms 10.562ms ± 0.015ms 10.561ms ± 0.008ms 10.568ms 10.584ms 10.606ms 10.637ms 0.73% 1.089 3.128 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.560ms; 10.564ms] or [-0.019%; +0.019%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.441µs 2.474µs ± 0.017µs 2.471µs ± 0.010µs 2.483µs 2.508µs 2.523µs 2.543µs 2.91% 1.110 1.396 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.472µs; 2.477µs] or [-0.094%; +0.094%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.441µs 146.815µs ± 1.835µs 146.485µs ± 0.534µs 147.195µs 148.741µs 153.927µs 164.810µs 12.51% 5.990 49.854 1.25% 0.130µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.561µs; 147.070µs] or [-0.173%; +0.173%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.450µs 34.108µs ± 1.163µs 33.570µs ± 0.066µs 33.725µs 36.554µs 36.600µs 38.445µs 14.52% 1.751 1.336 3.40% 0.082µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.947µs; 34.269µs] or [-0.472%; +0.472%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 158.250µs 158.975µs ± 0.250µs 158.950µs ± 0.121µs 159.049µs 159.401µs 159.983µs 160.032µs 0.68% 1.384 3.753 0.16% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [158.940µs; 159.009µs] or [-0.022%; +0.022%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.386ns 254.488ns ± 14.346ns 248.195ns ± 3.425ns 257.322ns 288.859ns 298.364ns 307.794ns 24.01% 1.864 2.605 5.62% 1.014ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.500ns; 256.476ns] or [-0.781%; +0.781%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.913µs ± 0.004µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.950µs 0.98% 3.067 31.122 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 253157761.757op/s 255586903.829op/s ± 281365.240op/s 255626201.686op/s ± 115810.494op/s 255713255.404op/s 255857521.888op/s 256002880.213op/s 257038180.025op/s 0.55% -2.989 30.553 0.11% 19895.527op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.733µs 78.349µs ± 0.751µs 78.212µs ± 0.500µs 78.861µs 79.721µs 80.312µs 80.759µs 3.26% 0.488 -0.003 0.96% 0.053µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12382528.021op/s 12764624.692op/s ± 121861.601op/s 12785842.895op/s ± 81775.420op/s 12847881.898op/s 12948361.185op/s 13003271.147op/s 13032225.129op/s 1.93% -0.438 -0.066 0.95% 8616.916op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.851µs 71.006µs ± 0.648µs 70.946µs ± 0.470µs 71.434µs 72.161µs 72.726µs 72.974µs 2.86% 0.530 -0.092 0.91% 0.046µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13703588.085op/s 14084494.154op/s ± 128039.777op/s 14095159.018op/s ± 93302.346op/s 14185706.210op/s 14273227.750op/s 14303041.688op/s 14316193.127op/s 1.57% -0.486 -0.170 0.91% 9053.779op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.917µs 3.917µs 0.14% -1.909 13.762 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255266035.446op/s 255619360.995op/s ± 173452.030op/s 255616896.292op/s ± 109757.235op/s 255728509.977op/s 255850379.026op/s 255919479.183op/s 256914580.526op/s 0.51% 1.934 13.983 0.07% 12264.911op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.868µs 68.153µs ± 0.691µs 68.066µs ± 0.508µs 68.600µs 69.236µs 69.953µs 70.317µs 3.31% 0.580 -0.056 1.01% 0.049µs 1 200
credit_card/is_card_number/378282246310005 throughput 14221323.065op/s 14674411.920op/s ± 148016.015op/s 14691671.010op/s ± 108907.676op/s 14784086.369op/s 14880616.538op/s 14928545.629op/s 14954882.037op/s 1.79% -0.532 -0.146 1.01% 10466.313op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.141µs 52.214µs ± 0.033µs 52.219µs ± 0.024µs 52.238µs 52.263µs 52.281µs 52.302µs 0.16% -0.111 -0.440 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19119857.207op/s 19151810.190op/s ± 12039.911op/s 19150232.376op/s ± 8629.715op/s 19159830.459op/s 19172223.666op/s 19176818.104op/s 19178776.766op/s 0.15% 0.114 -0.440 0.06% 851.350op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.035µs ± 0.004µs 6.035µs ± 0.003µs 6.038µs 6.042µs 6.047µs 6.051µs 0.26% 0.711 0.723 0.07% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165264247.758op/s 165686457.502op/s ± 108548.966op/s 165696495.522op/s ± 77481.116op/s 165769337.175op/s 165830656.316op/s 165861362.710op/s 165910258.070op/s 0.13% -0.707 0.710 0.07% 7675.571op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.921µs 0.22% -1.470 11.356 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255006179.188op/s 255574534.290op/s ± 195389.268op/s 255564959.476op/s ± 119865.630op/s 255690916.583op/s 255833296.826op/s 255917482.772op/s 256961888.442op/s 0.55% 1.495 11.556 0.08% 13816.108op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.134µs 64.512µs ± 0.184µs 64.486µs ± 0.118µs 64.627µs 64.841µs 65.009µs 65.072µs 0.91% 0.622 0.131 0.28% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15367647.320op/s 15501180.857op/s ± 44039.897op/s 15507326.667op/s ± 28476.295op/s 15533772.151op/s 15559711.477op/s 15586807.614op/s 15592289.613op/s 0.55% -0.607 0.108 0.28% 3114.091op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.134µs 58.410µs ± 0.174µs 58.374µs ± 0.096µs 58.492µs 58.749µs 58.980µs 59.029µs 1.12% 1.179 1.428 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16940750.611op/s 17120595.105op/s ± 50729.404op/s 17130986.119op/s ± 28056.318op/s 17154246.227op/s 17183642.381op/s 17195975.127op/s 17201713.291op/s 0.41% -1.161 1.372 0.30% 3587.111op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.921µs 0.21% -1.077 7.313 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255063768.935op/s 255616674.223op/s ± 186967.122op/s 255600443.635op/s ± 119042.190op/s 255735054.883op/s 255887315.912op/s 255960340.590op/s 256815323.267op/s 0.48% 1.095 7.430 0.07% 13220.572op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.551µs 54.799µs ± 0.165µs 54.751µs ± 0.095µs 54.870µs 55.141µs 55.343µs 55.417µs 1.22% 1.265 1.504 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18045073.636op/s 18248703.994op/s ± 54857.447op/s 18264402.681op/s ± 31639.889op/s 18290853.659op/s 18308082.836op/s 18323653.164op/s 18331431.072op/s 0.37% -1.247 1.445 0.30% 3879.007op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.140µs 52.212µs ± 0.038µs 52.210µs ± 0.022µs 52.231µs 52.284µs 52.316µs 52.321µs 0.21% 0.516 0.149 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19112639.945op/s 19152851.058op/s ± 13823.469op/s 19153570.787op/s ± 7982.962op/s 19161526.529op/s 19173628.882op/s 19177916.572op/s 19179081.376op/s 0.13% -0.512 0.143 0.07% 977.467op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.034µs ± 0.004µs 6.034µs ± 0.002µs 6.036µs 6.040µs 6.041µs 6.055µs 0.35% 1.090 4.743 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165147416.744op/s 165721147.906op/s ± 99433.131op/s 165730809.358op/s ± 65633.818op/s 165784131.304op/s 165863891.770op/s 165911913.153op/s 165927137.659op/s 0.12% -1.080 4.683 0.06% 7030.984op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ throughput [255547909.313op/s; 255625898.346op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.245µs; 78.453µs] or [-0.133%; +0.133%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12747735.847op/s; 12781513.538op/s] or [-0.132%; +0.132%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.916µs; 71.096µs] or [-0.127%; +0.127%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14066749.072op/s; 14102239.236op/s] or [-0.126%; +0.126%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255595322.212op/s; 255643399.778op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.057µs; 68.249µs] or [-0.141%; +0.141%] None None None
credit_card/is_card_number/378282246310005 throughput [14653898.324op/s; 14694925.516op/s] or [-0.140%; +0.140%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.210µs; 52.219µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19150141.574op/s; 19153478.806op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.035µs; 6.036µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 throughput [165671413.659op/s; 165701501.345op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255547455.217op/s; 255601613.363op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.486µs; 64.537µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15495077.351op/s; 15507284.363op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.386µs; 58.434µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17113564.497op/s; 17127625.712op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255590762.378op/s; 255642586.068op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.776µs; 54.822µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18241101.279op/s; 18256306.708op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.206µs; 52.217µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19150935.259op/s; 19154766.858op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.034µs; 6.035µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165707367.430op/s; 165734928.382op/s] or [-0.008%; +0.008%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a88ecc0 1764348985 florian/reqwest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.256µs 3.197µs ± 1.383µs 3.000µs ± 0.031µs 3.022µs 3.648µs 13.561µs 14.695µs 389.84% 7.331 55.083 43.15% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.005µs; 3.389µs] or [-5.996%; +5.996%] None None None

Baseline

Omitted due to size.

@realFlowControl
Switch from hyper and tokio to reqwest
a88ecc0 
Co-authored-by: Gemini <gemini@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@realFlowControl @codecov-commenter