Skip to content

Conversation

@gyuheon0h
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

Copy link
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 0% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 71.17%. Comparing base (aeae62b) to head (fad7c27).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1381   +/-   ##
=======================================
  Coverage   71.17%   71.17%           
=======================================
  Files         395      395           
  Lines       63389    63387    -2     
=======================================
  Hits        45114    45114           
+ Misses      18275    18273    -2     
Components Coverage Δ
libdd-crashtracker 59.99% <0.00%> (+0.01%) ⬆️
libdd-crashtracker-ffi 15.43% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.00% <ø> (ø)
libdd-data-pipeline-ffi 77.63% <ø> (ø)
libdd-common 81.15% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 79.75% <ø> (ø)
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.37% <ø> (ø)
datdog-sidecar-ffi 13.32% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.06% <ø> (ø)
datadog-tracer-flare 61.06% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 3, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-03 20:58:32

Comparing candidate commit fad7c27 in PR branch gyuheon0h/errors-intake-upload-regression with baseline commit aeae62b in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 2 unstable metrics.

scenario:ip_address/quantize_peer_ip_address_benchmark

  • 🟥 execution_time [+396.955ns; +418.548ns] or [+7.863%; +8.290%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.611ms 10.639ms ± 0.014ms 10.637ms ± 0.009ms 10.647ms 10.661ms 10.684ms 10.713ms 0.72% 1.215 3.642 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.637ms; 10.640ms] or [-0.019%; +0.019%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.134µs 161.093µs ± 0.315µs 161.069µs ± 0.138µs 161.222µs 161.494µs 161.740µs 163.764µs 1.67% 2.817 24.818 0.20% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.050µs; 161.137µs] or [-0.027%; +0.027%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.209µs 3.211µs ± 1.405µs 3.002µs ± 0.026µs 3.022µs 3.706µs 13.820µs 14.638µs 387.55% 7.301 54.671 43.64% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.016µs; 3.406µs] or [-6.064%; +6.064%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.856µs 147.122µs ± 1.671µs 146.858µs ± 0.537µs 147.421µs 148.970µs 153.023µs 162.795µs 10.85% 5.568 43.867 1.13% 0.118µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.890µs; 147.353µs] or [-0.157%; +0.157%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.103µs 205.619µs ± 0.501µs 205.510µs ± 0.154µs 205.703µs 206.137µs 208.232µs 208.580µs 1.49% 3.658 16.037 0.24% 0.035µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4794332.839op/s 4863392.178op/s ± 11748.709op/s 4865948.703op/s ± 3644.257op/s 4869359.526op/s 4873478.505op/s 4875075.306op/s 4875607.441op/s 0.20% -3.624 15.790 0.24% 830.759op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.147µs 18.275µs ± 0.094µs 18.259µs ± 0.043µs 18.299µs 18.469µs 18.574µs 18.789µs 2.90% 1.841 5.357 0.51% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53222177.995op/s 54720513.402op/s ± 279242.192op/s 54766327.279op/s ± 128950.672op/s 54901340.235op/s 55037291.581op/s 55095024.426op/s 55106445.741op/s 0.62% -1.781 5.007 0.51% 19745.405op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.555µs 10.740µs ± 0.088µs 10.728µs ± 0.059µs 10.793µs 10.895µs 10.955µs 10.965µs 2.21% 0.368 -0.293 0.82% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 91199590.303op/s 93114812.752op/s ± 763903.483op/s 93215055.453op/s ± 513950.616op/s 93697593.540op/s 94197110.518op/s 94731309.120op/s 94745971.474op/s 1.64% -0.330 -0.322 0.82% 54016.133op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.550µs; 205.688µs] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4861763.920op/s; 4865020.436op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.262µs; 18.288µs] or [-0.071%; +0.071%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54681813.119op/s; 54759213.684op/s] or [-0.071%; +0.071%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.728µs; 10.752µs] or [-0.114%; +0.114%] None None None
normalization/normalize_name/normalize_name/good throughput [93008943.076op/s; 93220682.428op/s] or [-0.114%; +0.114%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.326µs 2.411µs ± 0.023µs 2.412µs ± 0.005µs 2.417µs 2.448µs 2.465µs 2.471µs 2.43% -1.122 3.749 0.96% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.408µs; 2.414µs] or [-0.133%; +0.133%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.344µs 5.456µs ± 0.071µs 5.446µs ± 0.069µs 5.528µs 5.561µs 5.566µs 5.569µs 2.26% 0.159 -1.519 1.30% 0.005µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.447µs; 5.466µs] or [-0.180%; +0.180%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.921µs 3.923µs 3.924µs 0.22% -1.008 6.704 0.09% 0.000µs 1 200
credit_card/is_card_number/ throughput 254854199.459op/s 255407582.292op/s ± 219642.890op/s 255419479.017op/s ± 128090.375op/s 255536426.722op/s 255694758.865op/s 255755346.781op/s 256728806.761op/s 0.51% 1.028 6.816 0.09% 15531.098op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.876µs 79.450µs ± 0.686µs 79.483µs ± 0.459µs 79.884µs 80.637µs 81.164µs 81.328µs 2.32% 0.152 -0.170 0.86% 0.048µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12295847.458op/s 12587466.521op/s ± 108485.813op/s 12581372.021op/s ± 72576.202op/s 12666210.119op/s 12759657.727op/s 12818154.994op/s 12840846.774op/s 2.06% -0.106 -0.208 0.86% 7671.105op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.430µs 71.658µs ± 0.317µs 71.557µs ± 0.042µs 71.606µs 72.349µs 72.960µs 73.443µs 2.64% 3.184 11.090 0.44% 0.022µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13615937.961op/s 13955520.191op/s ± 60834.288op/s 13974816.682op/s ± 8229.646op/s 13982436.313op/s 13993112.520op/s 13997058.868op/s 13999721.406op/s 0.18% -3.146 10.777 0.43% 4301.634op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.897µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.919µs 3.921µs 3.923µs 0.22% -1.028 9.153 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254877970.313op/s 255430889.210op/s ± 177910.591op/s 255428416.187op/s ± 93921.362op/s 255529181.434op/s 255673942.654op/s 255717909.263op/s 256622363.569op/s 0.47% 1.049 9.293 0.07% 12580.179op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.226µs 68.430µs ± 0.319µs 68.325µs ± 0.035µs 68.380µs 69.358µs 69.648µs 70.059µs 2.54% 3.093 9.279 0.46% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 14273703.013op/s 14613809.872op/s ± 67134.268op/s 14635982.943op/s ± 7449.478op/s 14641796.297op/s 14650303.972op/s 14655319.668op/s 14657152.745op/s 0.14% -3.070 9.103 0.46% 4747.110op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.467µs 45.715µs ± 0.096µs 45.717µs ± 0.062µs 45.775µs 45.878µs 45.913µs 45.944µs 0.50% -0.005 -0.395 0.21% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21765701.270op/s 21874616.917op/s ± 46018.756op/s 21873489.336op/s ± 29624.370op/s 21904936.279op/s 21951999.789op/s 21968803.350op/s 21994154.777op/s 0.55% 0.015 -0.394 0.21% 3254.017op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.523µs 6.622µs ± 0.019µs 6.624µs ± 0.012µs 6.635µs 6.643µs 6.646µs 6.651µs 0.40% -1.443 3.841 0.28% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150363198.726op/s 151021998.450op/s ± 430294.250op/s 150966665.943op/s ± 263778.941op/s 151232496.087op/s 151703890.954op/s 152455572.749op/s 153315399.893op/s 1.56% 1.475 4.030 0.28% 30426.398op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.919µs 3.921µs 3.921µs 0.16% -2.771 18.135 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255020911.415op/s 255432212.052op/s ± 198667.196op/s 255434764.676op/s ± 104729.366op/s 255532391.336op/s 255637244.245op/s 255770881.820op/s 256815825.647op/s 0.54% 2.800 18.366 0.08% 14047.892op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.065µs 65.713µs ± 0.067µs 65.714µs ± 0.032µs 65.746µs 65.789µs 65.827µs 65.846µs 0.20% -4.433 41.351 0.10% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15186918.207op/s 15217745.710op/s ± 15629.766op/s 15217365.899op/s ± 7400.916op/s 15224742.575op/s 15236015.288op/s 15244519.189op/s 15369139.611op/s 1.00% 4.506 42.255 0.10% 1105.191op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.353µs 53.439µs ± 0.037µs 53.435µs ± 0.028µs 53.467µs 53.496µs 53.509µs 53.546µs 0.21% 0.019 -0.516 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18675525.753op/s 18713030.944op/s ± 12891.401op/s 18714277.381op/s ± 9782.957op/s 18722703.319op/s 18734315.621op/s 18740368.019op/s 18743247.321op/s 0.15% -0.016 -0.517 0.07% 911.560op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.900µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.920µs 3.922µs 3.923µs 0.22% -0.368 3.985 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254875593.466op/s 255428391.557op/s ± 181862.617op/s 255435927.081op/s ± 105165.051op/s 255539537.368op/s 255683297.339op/s 255776443.614op/s 256418314.051op/s 0.38% 0.380 4.035 0.07% 12859.629op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.154µs 50.224µs ± 0.036µs 50.222µs ± 0.022µs 50.243µs 50.296µs 50.333µs 50.349µs 0.25% 0.726 0.945 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19861239.451op/s 19910792.956op/s ± 14412.033op/s 19911590.547op/s ± 8598.437op/s 19920435.294op/s 19931260.373op/s 19937393.852op/s 19938642.814op/s 0.14% -0.721 0.934 0.07% 1019.085op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.398µs 45.734µs ± 0.096µs 45.739µs ± 0.063µs 45.802µs 45.889µs 45.921µs 45.992µs 0.55% -0.437 0.580 0.21% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21743138.476op/s 21865482.058op/s ± 45932.024op/s 21863266.448op/s ± 30256.354op/s 21893520.065op/s 21948726.949op/s 21996061.436op/s 22027521.729op/s 0.75% 0.452 0.603 0.21% 3247.885op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.534µs 6.618µs ± 0.021µs 6.621µs ± 0.012µs 6.632µs 6.641µs 6.644µs 6.647µs 0.40% -1.349 2.331 0.31% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150433817.124op/s 151111112.376op/s ± 471539.054op/s 151033780.312op/s ± 267635.678op/s 151334042.593op/s 151993263.314op/s 152574406.873op/s 153056058.071op/s 1.34% 1.372 2.432 0.31% 33342.846op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255377141.900op/s; 255438022.684op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.355µs; 79.545µs] or [-0.120%; +0.120%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12572431.431op/s; 12602501.611op/s] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.614µs; 71.702µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13947089.144op/s; 13963951.238op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255406232.513op/s; 255455545.907op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.386µs; 68.474µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/378282246310005 throughput [14604505.708op/s; 14623114.036op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.702µs; 45.729µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21868239.160op/s; 21880994.674op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.619µs; 6.624µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/x371413321323331 throughput [150962363.806op/s; 151081633.095op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255404678.689op/s; 255459745.414op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.704µs; 65.722µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15215579.575op/s; 15219911.845op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.434µs; 53.444µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18711244.320op/s; 18714817.568op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255403187.147op/s; 255453595.966op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.219µs; 50.229µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19908795.587op/s; 19912790.325op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.721µs; 45.748µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21859116.321op/s; 21871847.795op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.615µs; 6.621µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151045761.598op/s; 151176463.154op/s] or [-0.043%; +0.043%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.830ms 14.888ms ± 0.033ms 14.883ms ± 0.017ms 14.902ms 14.943ms 14.998ms 15.076ms 1.30% 1.726 5.974 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.883ms; 14.892ms] or [-0.030%; +0.030%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.472µs 86.642µs ± 0.221µs 86.619µs ± 0.037µs 86.657µs 86.767µs 86.981µs 89.536µs 3.37% 11.401 145.808 0.25% 0.016µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.611µs; 86.672µs] or [-0.035%; +0.035%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.627ns 192.599ns ± 2.098ns 192.619ns ± 1.492ns 193.536ns 196.565ns 198.730ns 199.160ns 3.40% 0.746 0.266 1.09% 0.148ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.308ns; 192.889ns] or [-0.151%; +0.151%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 62.992ms 63.627ms ± 2.307ms 63.300ms ± 0.111ms 63.416ms 63.872ms 76.497ms 85.251ms 34.68% 8.174 67.802 3.62% 0.163ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [63.308ms; 63.947ms] or [-0.503%; +0.503%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 10.013ms 10.342ms ± 0.092ms 10.341ms ± 0.038ms 10.380ms 10.491ms 10.560ms 10.610ms 2.59% -0.180 1.356 0.89% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [10.329ms; 10.354ms] or [-0.124%; +0.124%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.495ns 254.536ns ± 13.877ns 248.233ns ± 3.206ns 254.508ns 284.782ns 293.918ns 296.055ns 19.26% 1.571 1.240 5.44% 0.981ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.613ns; 256.459ns] or [-0.756%; +0.756%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.894µs 25.841µs ± 9.892µs 18.159µs ± 0.154µs 34.309µs 43.011µs 51.783µs 73.398µs 304.19% 1.253 2.489 38.19% 0.699µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.470µs; 27.212µs] or [-5.305%; +5.305%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.911µs 534.743µs ± 0.695µs 534.669µs ± 0.243µs 534.939µs 535.439µs 535.957µs 542.728µs 1.51% 7.723 85.383 0.13% 0.049µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1842544.194op/s 1870060.008op/s ± 2406.530op/s 1870314.484op/s ± 851.683op/s 1871145.080op/s 1872234.098op/s 1872709.802op/s 1872971.751op/s 0.14% -7.615 83.718 0.13% 170.167op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.914µs 382.004µs ± 0.314µs 382.034µs ± 0.227µs 382.227µs 382.463µs 382.620µs 382.740µs 0.18% -0.286 -0.156 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2612736.751op/s 2617777.491op/s ± 2151.691op/s 2617568.070op/s ± 1553.097op/s 2619271.742op/s 2621208.454op/s 2622585.224op/s 2625266.593op/s 0.29% 0.290 -0.149 0.08% 152.148op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.350µs 195.933µs ± 0.209µs 195.952µs ± 0.136µs 196.078µs 196.238µs 196.371µs 196.567µs 0.31% -0.305 0.308 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5087316.423op/s 5103795.235op/s ± 5436.859op/s 5103298.826op/s ± 3539.593op/s 5107076.237op/s 5113711.586op/s 5118675.046op/s 5119015.770op/s 0.31% 0.312 0.311 0.11% 384.444op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.197µs 37.397µs ± 0.086µs 37.387µs ± 0.053µs 37.442µs 37.552µs 37.631µs 37.636µs 0.67% 0.366 0.069 0.23% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26570034.130op/s 26740099.778op/s ± 61140.567op/s 26746932.444op/s ± 37585.461op/s 26782039.124op/s 26832795.144op/s 26864932.162op/s 26883636.368op/s 0.51% -0.353 0.059 0.23% 4323.291op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.882µs 45.071µs ± 0.158µs 45.056µs ± 0.117µs 45.173µs 45.270µs 45.332µs 46.349µs 2.87% 2.657 19.194 0.35% 0.011µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21575345.421op/s 22187410.228op/s ± 77272.400op/s 22194780.211op/s ± 57586.675op/s 22249601.661op/s 22275447.617op/s 22276633.974op/s 22280702.189op/s 0.39% -2.513 17.692 0.35% 5463.984op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.647µs; 534.839µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869726.486op/s; 1870393.530op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.960µs; 382.047µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617479.288op/s; 2618075.695op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.904µs; 195.962µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5103041.738op/s; 5104548.731op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.385µs; 37.409µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26731626.283op/s; 26748573.272op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.049µs; 45.093µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22176701.017op/s; 22198119.440op/s] or [-0.048%; +0.048%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fad7c27 1764794609 gyuheon0h/errors-intake-upload-regression
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.405µs 34.046µs ± 1.152µs 33.504µs ± 0.039µs 33.636µs 36.518µs 36.535µs 37.593µs 12.20% 1.716 1.025 3.38% 0.081µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.886µs; 34.205µs] or [-0.469%; +0.469%] None None None

Baseline

Omitted due to size.

@gyuheon0h gyuheon0h changed the title Remove enabled flag check Remove errors intake upload enabled flag check Dec 3, 2025
@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 3, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.25 MB 86.25 MB +0% (+1.00 KB) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.31 MB 58.31 MB -0% (-360 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.43 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.54 MB 9.54 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.03 MB 100.04 MB +0% (+1.93 KB) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.69 MB 19.69 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 139.40 MB 139.41 MB +0% (+8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 740.81 MB 740.81 MB -0% (-144 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.37 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.73 MB 19.73 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.75 MB 38.75 MB -0% (-120 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.80 MB 16.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.01 MB 142.01 MB +0% (+8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 729.52 MB 729.52 MB -0% (-182 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.88 MB 4.88 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.97 MB 20.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.51 MB 36.51 MB +0% (+144 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.59 MB 74.59 MB +0% (+432 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.86 MB 8.86 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.67 MB 59.67 MB +0% (+472 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.49 MB 9.49 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.25 MB 94.25 MB +0% (+248 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.30 MB 10.30 MB 0% (0 B) 👌

@gyuheon0h gyuheon0h closed this Dec 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants