Skip to content

[CHAOSPLT-932] Add support for internal fuzzing infra #1372

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

[CHAOSPLT-932] Add support for internal fuzzing infra #1372

wants to merge 4 commits into from

Conversation

@edznux-dd
Copy link

@edznux-dd edznux-dd commented Nov 26, 2025 •
edited
Loading

What does this PR do?

This PR adds a fuzzer using cargo-fuzz that then runs in our internal fuzzing infrastructure.

Motivation

This aims to enable fuzz testing via cargo fuzz in this repository. Adding a initial fuzzer is simply a bootstraping part.
The end goal is to find bugs before customers do.

There's already some existing property test / fuzz test with bolero in other crate (i.e: libdd-profiling{,-protobuf}) but these run only in Github's CI for short amount of time (30sec). The fuzzing infra will let these run last for hours.

Additional Notes

  • I'm no Rust expert.
    • I don't know enough of bolero to understand if we can also use bolero generated binaries. But this can be done as a followup.
  • These fuzz test will run asynchronously in the fuzzing infra. They won't block CI. They will run on main, every day on a schedule and report issues via Slack / Error tracking.

How to test the change?

Click the fuzz pipeline in gitlab of this branch.

@codecov-commenter
Copy link

codecov-commenter commented Nov 26, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 0.73529% with 135 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.98%. Comparing base (7540423) to head (a470af9).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1372      +/-   ##
==========================================
- Coverage   71.16%   70.98%   -0.18%     
==========================================
  Files         392      396       +4     
  Lines       62755    63425     +670     
==========================================
+ Hits        44661    45024     +363     
- Misses      18094    18401     +307
Components Coverage Δ
libdd-crashtracker 59.91% <ø> (+0.03%) ⬆️
libdd-crashtracker-ffi 15.31% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.19% <ø> (+0.18%) ⬆️
libdd-data-pipeline-ffi 78.68% <ø> (+1.04%) ⬆️
libdd-common 80.93% <ø> (+0.02%) ⬆️
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 59.98% <ø> (-0.04%) ⬇️
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 79.75% <ø> (+0.02%) ⬆️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.11% <ø> (-0.88%) ⬇️
datdog-sidecar-ffi 11.99% <ø> (-4.42%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.05% <0.73%> (-16.20%) ⬇️
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 89.88% <ø> (-0.18%) ⬇️
datadog-tracer-flare 63.49% <ø> (+1.42%) ⬆️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Nov 26, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-11-26 17:41:23

Comparing candidate commit a470af9 in PR branch edouard/add-fuzzing-infra with baseline commit c4d5ab8 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.609µs 25.500µs ± 9.260µs 17.987µs ± 0.171µs 33.573µs 41.786µs 43.265µs 58.434µs 224.87% 0.793 -0.196 36.22% 0.655µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.217µs; 26.784µs] or [-5.033%; +5.033%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.269µs 34.795µs ± 0.808µs 34.418µs ± 0.070µs 34.544µs 36.481µs 36.511µs 38.401µs 11.57% 1.834 2.087 2.32% 0.057µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.683µs; 34.907µs] or [-0.322%; +0.322%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.902µs 534.711µs ± 0.572µs 534.635µs ± 0.281µs 534.947µs 535.337µs 535.944µs 540.504µs 1.10% 5.355 50.795 0.11% 0.040µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1850124.263op/s 1870172.425op/s ± 1990.108op/s 1870436.307op/s ± 981.646op/s 1871291.421op/s 1872274.193op/s 1872636.696op/s 1873001.260op/s 0.14% -5.278 49.756 0.11% 140.722op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.003µs 381.852µs ± 0.919µs 381.777µs ± 0.214µs 381.993µs 382.343µs 382.699µs 390.870µs 2.38% 8.081 73.268 0.24% 0.065µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2558398.220op/s 2618829.605op/s ± 6180.987op/s 2619330.431op/s ± 1467.926op/s 2620755.661op/s 2623136.769op/s 2624427.658op/s 2624648.853op/s 0.20% -8.009 72.368 0.24% 437.062op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.242µs 196.125µs ± 0.471µs 196.110µs ± 0.156µs 196.259µs 196.426µs 196.641µs 200.488µs 2.23% 6.195 52.914 0.24% 0.033µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 4987838.861op/s 5098811.342op/s ± 12079.712op/s 5099178.008op/s ± 4052.005op/s 5103392.893op/s 5110885.278op/s 5119270.656op/s 5121857.757op/s 0.44% -6.077 51.626 0.24% 854.165op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.963µs 37.108µs ± 0.072µs 37.106µs ± 0.051µs 37.157µs 37.231µs 37.282µs 37.330µs 0.61% 0.354 -0.017 0.19% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26787780.660op/s 26948161.606op/s ± 52505.545op/s 26950148.831op/s ± 37245.232op/s 26987324.196op/s 27031197.895op/s 27046119.065op/s 27054098.130op/s 0.39% -0.343 -0.033 0.19% 3712.703op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.900µs 45.082µs ± 0.161µs 45.069µs ± 0.154µs 45.206µs 45.349µs 45.410µs 45.470µs 0.89% 0.441 -1.074 0.36% 0.011µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21992350.572op/s 22181941.850op/s ± 78942.436op/s 22188096.389op/s ± 75927.225op/s 22264363.715op/s 22269169.756op/s 22271353.488op/s 22271896.801op/s 0.38% -0.434 -1.086 0.35% 5582.073op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.631µs; 534.790µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869896.615op/s; 1870448.234op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.725µs; 381.979µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617972.979op/s; 2619686.230op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [196.060µs; 196.191µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5097137.210op/s; 5100485.474op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.098µs; 37.118µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26940884.843op/s; 26955438.370op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.060µs; 45.105µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22171001.187op/s; 22192882.512op/s] or [-0.049%; +0.049%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.308µs 2.381µs ± 0.017µs 2.384µs ± 0.005µs 2.390µs 2.397µs 2.402µs 2.403µs 0.80% -2.531 6.703 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.379µs; 2.384µs] or [-0.099%; +0.099%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.957µs 160.907µs ± 0.659µs 160.849µs ± 0.167µs 161.020µs 161.371µs 161.730µs 169.357µs 5.29% 10.613 133.577 0.41% 0.047µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.816µs; 160.998µs] or [-0.057%; +0.057%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.195µs 3.250µs ± 1.444µs 3.022µs ± 0.030µs 3.059µs 3.724µs 14.169µs 14.947µs 394.59% 7.286 54.512 44.31% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.050µs; 3.450µs] or [-6.156%; +6.156%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.006µs 5.081µs ± 0.037µs 5.080µs ± 0.032µs 5.109µs 5.142µs 5.145µs 5.150µs 1.38% 0.149 -1.105 0.73% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.076µs; 5.086µs] or [-0.101%; +0.101%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.089ns 254.559ns ± 14.038ns 247.911ns ± 3.003ns 253.732ns 286.656ns 291.352ns 292.287ns 17.90% 1.457 0.643 5.50% 0.993ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.614ns; 256.505ns] or [-0.764%; +0.764%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.835ms 14.903ms ± 0.036ms 14.897ms ± 0.016ms 14.916ms 14.960ms 15.033ms 15.100ms 1.36% 2.111 7.338 0.24% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.898ms; 14.908ms] or [-0.033%; +0.033%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.468ms 61.978ms ± 2.474ms 61.663ms ± 0.049ms 61.710ms 61.988ms 80.941ms 83.691ms 35.72% 7.998 62.422 3.98% 0.175ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.635ms; 62.321ms] or [-0.553%; +0.553%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.959µs 206.408µs ± 0.190µs 206.383µs ± 0.133µs 206.559µs 206.715µs 206.839µs 206.921µs 0.26% 0.257 -0.521 0.09% 0.013µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4832769.205op/s 4844777.576op/s ± 4459.882op/s 4845364.133op/s ± 3120.398op/s 4848115.741op/s 4851187.910op/s 4853214.438op/s 4855324.454op/s 0.21% -0.253 -0.523 0.09% 315.361op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.144µs 18.221µs ± 0.039µs 18.215µs ± 0.018µs 18.236µs 18.263µs 18.418µs 18.481µs 1.46% 3.204 17.573 0.21% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54108764.983op/s 54882037.505op/s ± 116660.097op/s 54898338.887op/s ± 53375.117op/s 54944490.483op/s 55004815.348op/s 55058543.998op/s 55113719.518op/s 0.39% -3.145 17.114 0.21% 8249.115op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.562µs 10.763µs ± 0.094µs 10.754µs ± 0.069µs 10.837µs 10.909µs 10.945µs 10.964µs 1.96% 0.072 -0.798 0.87% 0.007µs 1 200
normalization/normalize_name/normalize_name/good throughput 91204032.471op/s 92919296.180op/s ± 814180.674op/s 92989843.522op/s ± 594443.097op/s 93491276.577op/s 94252693.991op/s 94567487.230op/s 94675479.918op/s 1.81% -0.040 -0.792 0.87% 57571.268op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.382µs; 206.434µs] or [-0.013%; +0.013%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4844159.479op/s; 4845395.673op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.216µs; 18.226µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54865869.538op/s; 54898205.473op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.750µs; 10.776µs] or [-0.121%; +0.121%] None None None
normalization/normalize_name/normalize_name/good throughput [92806458.569op/s; 93032133.791op/s] or [-0.121%; +0.121%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.134ms 6.425ms ± 0.058ms 6.434ms ± 0.018ms 6.449ms 6.477ms 6.509ms 6.584ms 2.33% -2.877 11.010 0.91% 0.004ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.417ms; 6.433ms] or [-0.126%; +0.126%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.044ns 192.917ns ± 2.330ns 192.665ns ± 1.515ns 194.042ns 197.455ns 200.779ns 202.211ns 4.96% 1.362 2.356 1.20% 0.165ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.595ns; 193.240ns] or [-0.167%; +0.167%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 145.446µs 147.558µs ± 2.046µs 147.291µs ± 0.603µs 147.906µs 149.162µs 154.170µs 169.667µs 15.19% 7.258 70.162 1.38% 0.145µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [147.274µs; 147.841µs] or [-0.192%; +0.192%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.612ms 10.644ms ± 0.015ms 10.643ms ± 0.010ms 10.652ms 10.670ms 10.684ms 10.708ms 0.61% 0.824 1.516 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.642ms; 10.646ms] or [-0.020%; +0.020%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.915µs ± 0.004µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.954µs 0.99% 4.131 36.351 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 252936288.368op/s 255402745.600op/s ± 291548.042op/s 255438643.638op/s ± 107635.793op/s 255536209.481op/s 255649345.252op/s 255735679.615op/s 256795533.466op/s 0.53% -4.058 35.832 0.11% 20615.560op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.899µs 79.188µs ± 0.784µs 79.117µs ± 0.589µs 79.754µs 80.515µs 80.827µs 81.303µs 2.76% 0.323 -0.730 0.99% 0.055µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12299689.389op/s 12629348.569op/s ± 124587.381op/s 12639554.703op/s ± 94137.227op/s 12725892.166op/s 12820461.585op/s 12835947.562op/s 12837141.753op/s 1.56% -0.288 -0.760 0.98% 8809.658op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.431µs 72.085µs ± 0.333µs 71.963µs ± 0.072µs 72.184µs 72.670µs 73.329µs 74.076µs 2.94% 2.420 8.697 0.46% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13499593.944op/s 13872743.201op/s ± 63337.230op/s 13896100.755op/s ± 13839.859op/s 13905523.622op/s 13934581.246op/s 13962566.551op/s 13999511.326op/s 0.74% -2.355 8.237 0.46% 4478.618op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.916µs 3.919µs 3.922µs 3.924µs 0.26% -0.880 11.555 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254844946.549op/s 255471224.237op/s ± 177396.011op/s 255501060.333op/s ± 83242.941op/s 255564069.913op/s 255656359.430op/s 255733474.797op/s 256708377.675op/s 0.47% 0.907 11.727 0.07% 12543.792op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.235µs 68.468µs ± 0.404µs 68.324µs ± 0.042µs 68.389µs 69.304µs 70.236µs 70.467µs 3.14% 3.145 9.892 0.59% 0.029µs 1 200
credit_card/is_card_number/378282246310005 throughput 14190974.019op/s 14605904.153op/s ± 84607.060op/s 14636211.730op/s ± 9076.404op/s 14643467.065op/s 14650232.576op/s 14654293.888op/s 14655277.954op/s 0.13% -3.110 9.642 0.58% 5982.623op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.432µs 45.657µs ± 0.086µs 45.652µs ± 0.061µs 45.722µs 45.796µs 45.848µs 45.858µs 0.45% 0.078 -0.448 0.19% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21806309.814op/s 21902298.256op/s ± 41236.810op/s 21904904.267op/s ± 29508.899op/s 21931048.236op/s 21966431.122op/s 21995838.634op/s 22010816.115op/s 0.48% -0.070 -0.446 0.19% 2915.883op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.553µs 6.622µs ± 0.019µs 6.622µs ± 0.012µs 6.637µs 6.644µs 6.650µs 6.702µs 1.21% -0.390 2.496 0.29% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 149214389.201op/s 151009555.377op/s ± 438506.327op/s 151019607.079op/s ± 269159.974op/s 151191457.683op/s 151814505.655op/s 152322910.007op/s 152600706.626op/s 1.05% 0.428 2.475 0.29% 31007.080op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.916µs ± 0.003µs 3.917µs ± 0.002µs 3.918µs 3.921µs 3.923µs 3.925µs 0.20% -2.053 14.631 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254785203.304op/s 255338579.946op/s ± 201034.488op/s 255305843.210op/s ± 109422.450op/s 255455491.321op/s 255629833.079op/s 255714158.916op/s 256854541.584op/s 0.61% 2.083 14.890 0.08% 14215.285op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.603µs 65.735µs ± 0.054µs 65.731µs ± 0.037µs 65.771µs 65.820µs 65.883µs 65.959µs 0.35% 0.558 0.951 0.08% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15160951.335op/s 15212708.610op/s ± 12485.829op/s 15213585.314op/s ± 8585.667op/s 15221543.219op/s 15230857.770op/s 15236629.221op/s 15243238.752op/s 0.19% -0.551 0.934 0.08% 882.881op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.364µs 53.417µs ± 0.031µs 53.408µs ± 0.017µs 53.435µs 53.479µs 53.507µs 53.518µs 0.21% 1.063 0.824 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18685318.856op/s 18720760.911op/s ± 10701.451op/s 18723624.466op/s ± 6113.731op/s 18728345.817op/s 18733349.272op/s 18735724.138op/s 18739337.018op/s 0.08% -1.060 0.816 0.06% 756.707op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.919µs 3.922µs 3.926µs 0.29% -1.261 12.827 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254691380.337op/s 255419483.704op/s ± 193449.917op/s 255436102.681op/s ± 116156.892op/s 255540343.436op/s 255641459.224op/s 255694804.465op/s 256814866.435op/s 0.54% 1.291 13.040 0.08% 13678.975op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.151µs 50.237µs ± 0.069µs 50.221µs ± 0.027µs 50.254µs 50.335µs 50.419µs 50.800µs 1.15% 4.397 29.248 0.14% 0.005µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19685081.995op/s 19905619.651op/s ± 27153.099op/s 19911967.202op/s ± 10741.653op/s 19920111.389op/s 19928751.823op/s 19936184.436op/s 19939732.160op/s 0.14% -4.348 28.725 0.14% 1920.014op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.365µs 45.651µs ± 0.084µs 45.653µs ± 0.057µs 45.712µs 45.784µs 45.830µs 45.851µs 0.43% -0.270 0.173 0.18% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21809660.549op/s 21905308.756op/s ± 40157.923op/s 21904481.129op/s ± 27606.163op/s 21929663.346op/s 21974742.454op/s 22001462.233op/s 22043564.697op/s 0.63% 0.281 0.187 0.18% 2839.594op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.545µs 6.614µs ± 0.019µs 6.617µs ± 0.016µs 6.632µs 6.639µs 6.641µs 6.652µs 0.54% -0.740 0.308 0.29% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150321422.571op/s 151189479.924op/s ± 445128.803op/s 151127918.437op/s ± 359484.240op/s 151509056.667op/s 151988257.227op/s 152417112.026op/s 152779501.414op/s 1.09% 0.755 0.348 0.29% 31475.359op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ throughput [255362339.845op/s; 255443151.355op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.080µs; 79.297µs] or [-0.137%; +0.137%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12612081.957op/s; 12646615.182op/s] or [-0.137%; +0.137%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.039µs; 72.131µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13863965.270op/s; 13881521.132op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255446638.856op/s; 255495809.618op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.412µs; 68.524µs] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/378282246310005 throughput [14594178.428op/s; 14617629.878op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.646µs; 45.669µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21896583.231op/s; 21908013.282op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.619µs; 6.625µs] or [-0.040%; +0.040%] None None None
credit_card/is_card_number/x371413321323331 throughput [150948782.617op/s; 151070328.136op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.916µs; 3.917µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255310718.499op/s; 255366441.392op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.727µs; 65.742µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15210978.194op/s; 15214439.025op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.412µs; 53.421µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18719277.792op/s; 18722244.029op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255392673.406op/s; 255446294.002op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.228µs; 50.247µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19901856.493op/s; 19909382.809op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.640µs; 45.663µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21899743.254op/s; 21910874.258op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.612µs; 6.617µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151127789.353op/s; 151251170.495op/s] or [-0.041%; +0.041%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a470af9 1764178002 edouard/add-fuzzing-infra
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 87.270µs 87.503µs ± 0.191µs 87.486µs ± 0.063µs 87.539µs 87.635µs 88.026µs 89.376µs 2.16% 6.577 56.372 0.22% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [87.476µs; 87.529µs] or [-0.030%; +0.030%] None None None

Baseline

Omitted due to size.

@edznux-dd edznux-dd marked this pull request as ready for review November 26, 2025 17:30
@edznux-dd edznux-dd requested review from a team as code owners November 26, 2025 17:30
@dd-octo-sts
Copy link

dd-octo-sts bot commented Nov 27, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 85.96 MB 85.96 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.38 MB 7.38 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 57.99 MB 57.99 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.43 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 99.69 MB 99.69 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.53 MB 9.53 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.57 MB 19.57 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 138.53 MB 138.55 MB +.01% (+16.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 735.63 MB 735.64 MB +0% (+1.42 KB) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.34 MB 6.34 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.67 MB 19.67 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.64 MB 38.64 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.70 MB 16.70 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 141.07 MB 141.08 MB +.01% (+16.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 724.37 MB 724.37 MB +0% (+1.42 KB) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.87 MB 4.87 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.89 MB 20.90 MB +.03% (+8.00 KB) 🔍
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.39 MB 36.39 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.31 MB 74.31 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.85 MB 8.85 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.35 MB 59.35 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.47 MB 9.47 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 93.92 MB 93.92 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.28 MB 10.28 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@edznux-dd @codecov-commenter