Skip to content

profiling: use C++ api #1382

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

profiling: use C++ api #1382

wants to merge 3 commits into from

Conversation

@danielsn
Copy link
Contributor

@danielsn danielsn commented Dec 3, 2025

  • profiling: Initial C++ API
  • better api
  • better example

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@codecov-commenter
Copy link

codecov-commenter commented Dec 3, 2025

Codecov Report

❌ Patch coverage is 0% with 86 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.11%. Comparing base (aeae62b) to head (86723e2).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1382      +/-   ##
==========================================
- Coverage   71.17%   71.11%   -0.06%     
==========================================
  Files         395      396       +1     
  Lines       63389    63467      +78     
==========================================
+ Hits        45114    45137      +23     
- Misses      18275    18330      +55
Components Coverage Δ
libdd-crashtracker 60.15% <ø> (+0.18%) ⬆️
libdd-crashtracker-ffi 16.74% <ø> (+1.30%) ⬆️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.81% <ø> (-0.19%) ⬇️
libdd-data-pipeline-ffi 76.59% <ø> (-1.05%) ⬇️
libdd-common 81.15% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 78.94% <0.00%> (-0.82%) ⬇️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.83% <ø> (+0.46%) ⬆️
datdog-sidecar-ffi 15.65% <ø> (+2.33%) ⬆️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 89.88% <ø> (-0.18%) ⬇️
datadog-tracer-flare 63.49% <ø> (+2.43%) ⬆️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 3, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-12-03 21:40:14

Comparing candidate commit 86723e2 in PR branch dsn/r-and-d-profiling-cxx with baseline commit aeae62b in branch main.

Found 0 performance improvements and 12 performance regressions! Performance is the same for 43 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+3.783µs; +3.942µs] or [+5.269%; +5.490%]
  • 🟥 throughput [-726829.793op/s; -696898.524op/s] or [-5.218%; -5.003%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.174µs; +4.342µs] or [+6.093%; +6.339%]
  • 🟥 throughput [-872497.751op/s; -837850.632op/s] or [-5.977%; -5.739%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+7.400µs; +7.428µs] or [+16.189%; +16.251%]
  • 🟥 throughput [-3059753.417op/s; -3046731.447op/s] or [-13.986%; -13.927%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.928µs; +4.965µs] or [+9.224%; +9.292%]
  • 🟥 throughput [-1591256.253op/s; -1580294.889op/s] or [-8.502%; -8.444%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+5.183µs; +5.243µs] or [+10.322%; +10.441%]
  • 🟥 throughput [-1883109.614op/s; -1862616.852op/s] or [-9.456%; -9.353%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+7.372µs; +7.411µs] or [+16.157%; +16.244%]
  • 🟥 throughput [-3063366.877op/s; -3047992.596op/s] or [-13.977%; -13.906%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.896ns 192.550ns ± 2.175ns 192.171ns ± 1.393ns 193.503ns 197.131ns 200.200ns 201.001ns 4.59% 1.276 1.751 1.13% 0.154ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.249ns; 192.852ns] or [-0.157%; +0.157%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.361µs 34.855µs ± 0.903µs 34.442µs ± 0.043µs 34.532µs 36.732µs 36.758µs 39.264µs 14.00% 1.946 2.858 2.58% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.730µs; 34.980µs] or [-0.359%; +0.359%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.952ms 14.997ms ± 0.031ms 14.992ms ± 0.011ms 15.003ms 15.039ms 15.100ms 15.187ms 1.30% 3.067 13.696 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.992ms; 15.001ms] or [-0.028%; +0.028%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.417µs 2.442µs ± 0.021µs 2.438µs ± 0.014µs 2.453µs 2.498µs 2.507µs 2.509µs 2.90% 1.363 1.896 0.86% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.439µs; 2.445µs] or [-0.119%; +0.119%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.894ms 61.439ms ± 2.488ms 61.086ms ± 0.057ms 61.164ms 61.432ms 80.253ms 82.970ms 35.83% 7.868 60.813 4.04% 0.176ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.094ms; 61.784ms] or [-0.561%; +0.561%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.678µs 146.624µs ± 1.740µs 146.369µs ± 0.414µs 146.778µs 148.502µs 153.775µs 164.126µs 12.13% 6.360 54.744 1.18% 0.123µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.382µs; 146.865µs] or [-0.164%; +0.164%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.626µs 25.138µs ± 9.121µs 18.085µs ± 0.199µs 32.709µs 41.933µs 51.666µs 61.859µs 242.05% 1.035 0.725 36.20% 0.645µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.873µs; 26.402µs] or [-5.029%; +5.029%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.154ms 6.394ms ± 0.044ms 6.396ms ± 0.015ms 6.412ms 6.450ms 6.502ms 6.525ms 2.02% -2.214 11.237 0.69% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.388ms; 6.400ms] or [-0.096%; +0.096%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.038µs 5.103µs ± 0.047µs 5.081µs ± 0.025µs 5.147µs 5.183µs 5.187µs 5.191µs 2.17% 0.510 -1.280 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.096µs; 5.109µs] or [-0.128%; +0.128%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.924µs 0.30% -0.799 11.404 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254860743.571op/s 255603334.869op/s ± 180000.002op/s 255622661.365op/s ± 99586.471op/s 255712414.852op/s 255819770.985op/s 255868460.730op/s 256839107.124op/s 0.48% 0.826 11.556 0.07% 12727.922op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 80.242µs 81.184µs ± 0.459µs 81.128µs ± 0.322µs 81.516µs 82.014µs 82.166µs 82.208µs 1.33% 0.292 -0.593 0.56% 0.032µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12164297.277op/s 12318156.500op/s ± 69554.867op/s 12326212.830op/s ± 49139.201op/s 12367494.823op/s 12424073.923op/s 12447539.486op/s 12462251.438op/s 1.10% -0.269 -0.603 0.56% 4918.272op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 75.114µs 75.654µs ± 0.155µs 75.635µs ± 0.073µs 75.728µs 75.908µs 76.121µs 76.357µs 0.95% 0.513 2.962 0.20% 0.011µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13096362.047op/s 13218085.843op/s ± 27112.615op/s 13221417.842op/s ± 12714.874op/s 13231769.724op/s 13261109.744op/s 13284396.625op/s 13313040.123op/s 0.69% -0.484 2.915 0.20% 1917.151op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.920µs 0.21% -1.550 12.358 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255099723.931op/s 255612688.481op/s ± 186486.904op/s 255623172.242op/s ± 109182.038op/s 255708925.613op/s 255851838.821op/s 255943232.160op/s 256962621.389op/s 0.52% 1.576 12.567 0.07% 13186.615op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.235µs 72.765µs ± 0.176µs 72.782µs ± 0.083µs 72.861µs 73.025µs 73.203µs 73.229µs 0.62% -0.358 0.612 0.24% 0.012µs 1 200
credit_card/is_card_number/378282246310005 throughput 13655717.783op/s 13743014.362op/s ± 33200.420op/s 13739707.416op/s ± 15594.730op/s 13755928.150op/s 13802237.248op/s 13827972.425op/s 13843751.793op/s 0.76% 0.376 0.621 0.24% 2347.624op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 53.053µs 53.125µs ± 0.037µs 53.120µs ± 0.023µs 53.144µs 53.200µs 53.229µs 53.258µs 0.26% 0.777 0.805 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18776521.837op/s 18823636.054op/s ± 13143.945op/s 18825341.521op/s ± 8036.347op/s 18832246.755op/s 18841926.734op/s 18848836.793op/s 18849103.650op/s 0.13% -0.773 0.795 0.07% 929.417op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.430µs 6.439µs ± 0.005µs 6.438µs ± 0.004µs 6.442µs 6.449µs 6.455µs 6.457µs 0.29% 0.717 0.189 0.09% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154879733.842op/s 155304757.659op/s ± 132470.564op/s 155327252.182op/s ± 84614.329op/s 155399786.090op/s 155474945.107op/s 155524609.422op/s 155532848.227op/s 0.13% -0.713 0.179 0.09% 9367.083op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.919µs 3.932µs 0.51% -0.096 23.426 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254341258.131op/s 255634942.606op/s ± 190932.064op/s 255640320.772op/s ± 94117.683op/s 255740554.059op/s 255820216.315op/s 255867761.750op/s 257040414.353op/s 0.55% 0.153 23.514 0.07% 13500.936op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.915µs 65.125µs ± 0.115µs 65.111µs ± 0.076µs 65.186µs 65.348µs 65.440µs 65.619µs 0.78% 0.955 1.180 0.18% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15239456.893op/s 15355109.349op/s ± 27081.489op/s 15358351.223op/s ± 17998.414op/s 15376462.096op/s 15387500.810op/s 15400647.443op/s 15404823.250op/s 0.30% -0.943 1.137 0.18% 1914.950op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.168µs 58.379µs ± 0.126µs 58.364µs ± 0.087µs 58.451µs 58.647µs 58.810µs 58.814µs 0.77% 1.060 1.342 0.22% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17002685.535op/s 17129549.999op/s ± 36863.613op/s 17133935.827op/s ± 25418.595op/s 17158928.820op/s 17176443.281op/s 17183473.056op/s 17191655.171op/s 0.34% -1.045 1.296 0.21% 2606.651op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.917µs 3.919µs 3.933µs 0.54% 1.172 15.560 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254283867.712op/s 255637654.499op/s ± 194257.751op/s 255662098.094op/s ± 89743.704op/s 255745011.122op/s 255835843.721op/s 255911560.556op/s 256745596.442op/s 0.42% -1.135 15.460 0.08% 13736.097op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.999µs 55.429µs ± 0.183µs 55.394µs ± 0.101µs 55.527µs 55.729µs 56.066µs 56.315µs 1.66% 1.179 3.301 0.33% 0.013µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17757101.492op/s 18041364.530op/s ± 59317.822op/s 18052591.188op/s ± 33047.594op/s 18081288.137op/s 18123081.577op/s 18141510.233op/s 18182061.096op/s 0.72% -1.141 3.140 0.33% 4194.403op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.734µs 53.016µs ± 0.125µs 53.075µs ± 0.078µs 53.121µs 53.161µs 53.193µs 53.251µs 0.33% -0.433 -1.169 0.23% 0.009µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18778848.260op/s 18862170.295op/s ± 44411.318op/s 18841085.809op/s ± 27759.729op/s 18900965.394op/s 18932039.451op/s 18956293.774op/s 18962983.654op/s 0.65% 0.438 -1.163 0.23% 3140.354op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.429µs 6.439µs ± 0.006µs 6.438µs ± 0.004µs 6.443µs 6.451µs 6.454µs 6.458µs 0.32% 0.677 -0.164 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154839275.735op/s 155302644.713op/s ± 148548.853op/s 155337537.317op/s ± 99159.191op/s 155415893.653op/s 155501118.150op/s 155524229.249op/s 155556917.805op/s 0.14% -0.673 -0.171 0.10% 10503.990op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255578388.600op/s; 255628281.138op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.120µs; 81.247µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12308516.864op/s; 12327796.136op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.633µs; 75.676µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13214328.296op/s; 13221843.391op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255586843.189op/s; 255638533.772op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.740µs; 72.789µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number/378282246310005 throughput [13738413.103op/s; 13747615.621op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [53.120µs; 53.130µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [18821814.430op/s; 18825457.679op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.438µs; 6.440µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/x371413321323331 throughput [155286398.513op/s; 155323116.805op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255608481.259op/s; 255661403.954op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.109µs; 65.141µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15351356.115op/s; 15358862.583op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.361µs; 58.396µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17124441.057op/s; 17134658.942op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255610732.243op/s; 255664576.755op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.403µs; 55.454µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18033143.651op/s; 18049585.410op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.999µs; 53.034µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [18856015.313op/s; 18868325.276op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.438µs; 6.440µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155282057.271op/s; 155323232.155op/s] or [-0.013%; +0.013%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.330µs 161.417µs ± 0.307µs 161.379µs ± 0.148µs 161.525µs 161.894µs 162.474µs 163.156µs 1.10% 1.591 6.527 0.19% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.375µs; 161.460µs] or [-0.026%; +0.026%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.453ns 257.869ns ± 13.579ns 253.486ns ± 4.366ns 257.675ns 292.074ns 297.037ns 298.826ns 17.89% 1.681 1.664 5.25% 0.960ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.987ns; 259.751ns] or [-0.730%; +0.730%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.261µs 204.915µs ± 0.387µs 204.856µs ± 0.289µs 205.180µs 205.631µs 205.957µs 206.128µs 0.62% 0.712 0.119 0.19% 0.027µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4851359.587op/s 4880098.855op/s ± 9207.960op/s 4881476.756op/s ± 6893.403op/s 4886980.006op/s 4892371.626op/s 4894776.876op/s 4895689.398op/s 0.29% -0.703 0.100 0.19% 651.101op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.564µs 18.687µs ± 0.156µs 18.634µs ± 0.031µs 18.732µs 18.861µs 19.192µs 20.158µs 8.18% 5.035 39.362 0.83% 0.011µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 49607032.427op/s 53516851.387op/s ± 429736.406op/s 53664000.612op/s ± 89481.901op/s 53732361.385op/s 53822247.334op/s 53861452.606op/s 53867233.703op/s 0.38% -4.660 34.291 0.80% 30386.953op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.741µs 10.881µs ± 0.052µs 10.877µs ± 0.034µs 10.913µs 10.974µs 11.031µs 11.059µs 1.67% 0.485 0.505 0.48% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 90422642.386op/s 91904123.604op/s ± 437282.287op/s 91935652.123op/s ± 289191.478op/s 92196080.503op/s 92511322.324op/s 92776162.563op/s 93098734.072op/s 1.27% -0.452 0.460 0.47% 30920.527op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [204.861µs; 204.968µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4878822.721op/s; 4881374.990op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.665µs; 18.709µs] or [-0.116%; +0.116%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53457294.055op/s; 53576408.720op/s] or [-0.111%; +0.111%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.874µs; 10.888µs] or [-0.066%; +0.066%] None None None
normalization/normalize_name/normalize_name/good throughput [91843520.485op/s; 91964726.723op/s] or [-0.066%; +0.066%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.596µs 85.915µs ± 0.181µs 85.903µs ± 0.062µs 85.961µs 86.109µs 86.354µs 87.823µs 2.23% 6.247 61.159 0.21% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.890µs; 85.940µs] or [-0.029%; +0.029%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.806µs 534.711µs ± 1.186µs 534.526µs ± 0.249µs 534.835µs 535.177µs 542.536µs 545.249µs 2.01% 7.126 54.503 0.22% 0.084µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1834024.059op/s 1870179.074op/s ± 4082.243op/s 1870817.828op/s ± 871.280op/s 1871546.567op/s 1872512.890op/s 1872951.518op/s 1873340.785op/s 0.13% -7.088 54.051 0.22% 288.658op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.296µs 380.906µs ± 0.279µs 380.894µs ± 0.190µs 381.079µs 381.378µs 381.622µs 382.036µs 0.30% 0.553 0.612 0.07% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2617557.643op/s 2625321.577op/s ± 1920.904op/s 2625403.242op/s ± 1312.262op/s 2626803.515op/s 2628040.970op/s 2629083.956op/s 2629532.185op/s 0.16% -0.548 0.598 0.07% 135.828op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.032µs 190.621µs ± 0.295µs 190.634µs ± 0.206µs 190.820µs 191.069µs 191.265µs 191.742µs 0.58% 0.264 0.181 0.15% 0.021µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5215332.382op/s 5246011.278op/s ± 8115.371op/s 5245652.917op/s ± 5676.528op/s 5252263.174op/s 5259121.927op/s 5261273.976op/s 5262277.298op/s 0.32% -0.255 0.160 0.15% 573.843op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.247µs 37.410µs ± 0.053µs 37.416µs ± 0.033µs 37.444µs 37.483µs 37.511µs 37.553µs 0.37% -0.379 0.204 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26628964.230op/s 26730598.536op/s ± 37689.418op/s 26726527.808op/s ± 23494.418op/s 26754473.801op/s 26802051.924op/s 26822252.022op/s 26847774.383op/s 0.45% 0.387 0.210 0.14% 2665.044op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.802µs 45.893µs ± 0.052µs 45.882µs ± 0.033µs 45.925µs 46.001µs 46.032µs 46.042µs 0.35% 0.750 0.211 0.11% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21719289.287op/s 21789879.547op/s ± 24796.940op/s 21794854.720op/s ± 15501.807op/s 21806249.174op/s 21824204.505op/s 21831788.871op/s 21833160.690op/s 0.18% -0.744 0.201 0.11% 1753.408op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.546µs; 534.875µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869613.315op/s; 1870744.834op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.867µs; 380.945µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2625055.358op/s; 2625587.796op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.581µs; 190.662µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5244886.565op/s; 5247135.990op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.403µs; 37.418µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26725375.145op/s; 26735821.927op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.886µs; 45.900µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21786442.930op/s; 21793316.165op/s] or [-0.016%; +0.016%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.202µs 3.263µs ± 1.475µs 3.008µs ± 0.031µs 3.045µs 3.724µs 14.298µs 15.503µs 415.37% 7.252 54.254 45.10% 0.104µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.058µs; 3.467µs] or [-6.266%; +6.266%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 86723e2 1764797109 dsn/r-and-d-profiling-cxx
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.675ms 10.705ms ± 0.018ms 10.704ms ± 0.010ms 10.713ms 10.732ms 10.764ms 10.802ms 0.91% 1.766 6.759 0.17% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.703ms; 10.708ms] or [-0.023%; +0.023%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 4, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.25 MB 86.25 MB +0% (+624 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.31 MB 58.24 MB --.12% (-77.01 KB) 💪
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.43 MB --.04% (-3.81 KB) 💪
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.54 MB 9.53 MB --.05% (-5.29 KB) 💪
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.03 MB 99.90 MB --.12% (-132.62 KB) 💪
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.69 MB 19.69 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 139.40 MB 139.41 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 740.81 MB 740.87 MB +0% (+59.66 KB) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.35 MB --.22% (-14.50 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.73 MB 19.69 MB --.19% (-40.00 KB) 💪
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.75 MB 38.68 MB --.19% (-77.06 KB) 💪
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.80 MB 16.80 MB +0% (+512 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.01 MB 142.03 MB +.01% (+24.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 729.52 MB 729.33 MB --.02% (-199.17 KB) 💪
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.88 MB 4.88 MB --.09% (-5.00 KB) 💪
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.97 MB 20.94 MB --.11% (-24.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.51 MB 36.46 MB --.13% (-50.45 KB) 💪
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.59 MB 74.59 MB -0% (-4.30 KB) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.86 MB 8.86 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.67 MB 59.58 MB --.14% (-88.96 KB) 💪
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.49 MB 9.47 MB --.12% (-12.26 KB) 💪
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.25 MB 94.15 MB --.11% (-108.58 KB) 💪
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.30 MB 10.28 MB --.10% (-11.47 KB) 💪

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@danielsn @codecov-commenter