Skip to content

Initial dsm extractors configuration #9899

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 24 commits into
base: master
Choose a base branch
from
Draft

Initial dsm extractors configuration #9899

wants to merge 24 commits into from

Conversation

@kr-igor
Copy link
Contributor

@kr-igor kr-igor commented Nov 3, 2025 •
edited
Loading

What Does This Do

Initial transaction tracking implementation targeting http and kafka traffic.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@datadog-datadog-prod-us1

This comment has been minimized.

Sign in to view
@pr-commenter
Copy link

pr-commenter bot commented Nov 3, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612 413efac
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763579262 1763579262
ci_job_id 1245772741 1245772741
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-pd9lg8iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-pd9lg8iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.109 s) : 0, 1109062
Total [baseline] (10.801 s) : 0, 10800812
Agent [candidate] (1.115 s) : 0, 1115168
Total [candidate] (10.865 s) : 0, 10865474
section appsec
Agent [baseline] (1.292 s) : 0, 1292347
Total [baseline] (11.156 s) : 0, 11156334
Agent [candidate] (1.282 s) : 0, 1282078
Total [candidate] (11.17 s) : 0, 11169632
section iast
Agent [baseline] (1.243 s) : 0, 1242703
Total [baseline] (11.335 s) : 0, 11334819
Agent [candidate] (1.248 s) : 0, 1247593
Total [candidate] (11.21 s) : 0, 11209612
section profiling
Agent [baseline] (1.235 s) : 0, 1234865
Total [baseline] (11.11 s) : 0, 11110479
Agent [candidate] (1.245 s) : 0, 1244555
Total [candidate] (11.12 s) : 0, 11120395
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.109 s -
Agent appsec 1.292 s 183.285 ms (16.5%)
Agent iast 1.243 s 133.641 ms (12.0%)
Agent profiling 1.235 s 125.803 ms (11.3%)
Total tracing 10.801 s -
Total appsec 11.156 s 355.522 ms (3.3%)
Total iast 11.335 s 534.007 ms (4.9%)
Total profiling 11.11 s 309.667 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.115 s -
Agent appsec 1.282 s 166.91 ms (15.0%)
Agent iast 1.248 s 132.425 ms (11.9%)
Agent profiling 1.245 s 129.387 ms (11.6%)
Total tracing 10.865 s -
Total appsec 11.17 s 304.157 ms (2.8%)
Total iast 11.21 s 344.138 ms (3.2%)
Total profiling 11.12 s 254.921 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (708.079 ms) : 0, 708079
BytebuddyAgent [candidate] (710.764 ms) : 0, 710764
GlobalTracer [baseline] (249.992 ms) : 0, 249992
GlobalTracer [candidate] (253.522 ms) : 0, 253522
AppSec [baseline] (32.698 ms) : 0, 32698
AppSec [candidate] (32.999 ms) : 0, 32999
Debugger [baseline] (69.8 ms) : 0, 69800
Debugger [candidate] (68.98 ms) : 0, 68980
Remote Config [baseline] (636.67 µs) : 0, 637
Remote Config [candidate] (639.869 µs) : 0, 640
Telemetry [baseline] (8.11 ms) : 0, 8110
Telemetry [candidate] (8.24 ms) : 0, 8240
Flare Poller [baseline] (3.664 ms) : 0, 3664
Flare Poller [candidate] (3.874 ms) : 0, 3874
section appsec
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (737.101 ms) : 0, 737101
BytebuddyAgent [candidate] (728.674 ms) : 0, 728674
GlobalTracer [baseline] (243.979 ms) : 0, 243979
GlobalTracer [candidate] (243.771 ms) : 0, 243771
IAST [baseline] (25.118 ms) : 0, 25118
IAST [candidate] (24.723 ms) : 0, 24723
AppSec [baseline] (175.147 ms) : 0, 175147
AppSec [candidate] (174.172 ms) : 0, 174172
Debugger [baseline] (61.701 ms) : 0, 61701
Debugger [candidate] (61.5 ms) : 0, 61500
Remote Config [baseline] (667.033 µs) : 0, 667
Remote Config [candidate] (725.987 µs) : 0, 726
Telemetry [baseline] (8.32 ms) : 0, 8320
Telemetry [candidate] (8.303 ms) : 0, 8303
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (3.987 ms) : 0, 3987
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (829.61 ms) : 0, 829610
BytebuddyAgent [candidate] (830.199 ms) : 0, 830199
GlobalTracer [baseline] (237.948 ms) : 0, 237948
GlobalTracer [candidate] (241.556 ms) : 0, 241556
IAST [baseline] (26.516 ms) : 0, 26516
IAST [candidate] (26.787 ms) : 0, 26787
AppSec [baseline] (35.114 ms) : 0, 35114
AppSec [candidate] (35.31 ms) : 0, 35310
Debugger [baseline] (65.569 ms) : 0, 65569
Debugger [candidate] (65.703 ms) : 0, 65703
Remote Config [baseline] (541.399 µs) : 0, 541
Remote Config [candidate] (572.503 µs) : 0, 573
Telemetry [baseline] (7.663 ms) : 0, 7663
Telemetry [candidate] (7.627 ms) : 0, 7627
Flare Poller [baseline] (3.566 ms) : 0, 3566
Flare Poller [candidate] (3.614 ms) : 0, 3614
section profiling
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (730.409 ms) : 0, 730409
BytebuddyAgent [candidate] (734.645 ms) : 0, 734645
GlobalTracer [baseline] (222.151 ms) : 0, 222151
GlobalTracer [candidate] (226.549 ms) : 0, 226549
AppSec [baseline] (32.253 ms) : 0, 32253
AppSec [candidate] (32.751 ms) : 0, 32751
Debugger [baseline] (68.689 ms) : 0, 68689
Debugger [candidate] (68.663 ms) : 0, 68663
Remote Config [baseline] (654.26 µs) : 0, 654
Remote Config [candidate] (667.615 µs) : 0, 668
Telemetry [baseline] (8.103 ms) : 0, 8103
Telemetry [candidate] (8.02 ms) : 0, 8020
Flare Poller [baseline] (3.787 ms) : 0, 3787
Flare Poller [candidate] (3.943 ms) : 0, 3943
ProfilingAgent [baseline] (97.681 ms) : 0, 97681
ProfilingAgent [candidate] (97.765 ms) : 0, 97765
Profiling [baseline] (98.283 ms) : 0, 98283
Profiling [candidate] (98.346 ms) : 0, 98346
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1102870
Total [baseline] (8.87 s) : 0, 8869842
Agent [candidate] (1.106 s) : 0, 1105609
Total [candidate] (8.895 s) : 0, 8895117
section iast
Agent [baseline] (1.26 s) : 0, 1260282
Total [baseline] (9.582 s) : 0, 9581538
Agent [candidate] (1.242 s) : 0, 1241700
Total [candidate] (9.55 s) : 0, 9549603
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.103 s -
Agent iast 1.26 s 157.412 ms (14.3%)
Total tracing 8.87 s -
Total iast 9.582 s 711.695 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent iast 1.242 s 136.091 ms (12.3%)
Total tracing 8.895 s -
Total iast 9.55 s 654.486 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (705.293 ms) : 0, 705293
BytebuddyAgent [candidate] (705.236 ms) : 0, 705236
GlobalTracer [baseline] (248.342 ms) : 0, 248342
GlobalTracer [candidate] (252.004 ms) : 0, 252004
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.763 ms) : 0, 32763
Debugger [baseline] (68.364 ms) : 0, 68364
Debugger [candidate] (66.856 ms) : 0, 66856
Remote Config [baseline] (627.169 µs) : 0, 627
Remote Config [candidate] (635.708 µs) : 0, 636
Telemetry [baseline] (8.149 ms) : 0, 8149
Telemetry [candidate] (8.221 ms) : 0, 8221
Flare Poller [baseline] (3.712 ms) : 0, 3712
Flare Poller [candidate] (3.781 ms) : 0, 3781
section iast
crashtracking [baseline] (1.493 ms) : 0, 1493
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (844.248 ms) : 0, 844248
BytebuddyAgent [candidate] (827.092 ms) : 0, 827092
GlobalTracer [baseline] (239.986 ms) : 0, 239986
GlobalTracer [candidate] (240.738 ms) : 0, 240738
IAST [baseline] (27.06 ms) : 0, 27060
IAST [candidate] (28.411 ms) : 0, 28411
AppSec [baseline] (35.413 ms) : 0, 35413
AppSec [candidate] (33.229 ms) : 0, 33229
Debugger [baseline] (65.252 ms) : 0, 65252
Debugger [candidate] (64.433 ms) : 0, 64433
Remote Config [baseline] (548.595 µs) : 0, 549
Remote Config [candidate] (536.789 µs) : 0, 537
Telemetry [baseline] (7.676 ms) : 0, 7676
Telemetry [candidate] (7.652 ms) : 0, 7652
Flare Poller [baseline] (3.529 ms) : 0, 3529
Flare Poller [candidate] (3.581 ms) : 0, 3581
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612 413efac
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763579752 1763579752
ci_job_id 1245772743 1245772743
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wrkeimx1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wrkeimx1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+218.542µs; +322.282µs] or [+7.626%; +11.246%]		 worse
[+264.845µs; +655.656µs] or [+3.321%; +8.222%]		 unstable
[-199.062op/s; +63.874op/s] or [-15.956%; +5.120%]		 3.136ms 8.435ms 1179.938op/s 2.866ms 7.974ms 1247.531op/s
scenario:load:insecure-bank:iast:high_load worse
[+60.870µs; +159.266µs] or [+2.581%; +6.754%]		 unstable
[-328.873µs; +399.438µs] or [-4.582%; +5.565%]		 unstable
[-195.275op/s; +94.588op/s] or [-13.138%; +6.364%]		 2.468ms 7.213ms 1435.969op/s 2.358ms 7.178ms 1486.312op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.197 ms) : 1185, 1208
.   : milestone, 1197,
iast (3.075 ms) : 3035, 3115
.   : milestone, 3075,
iast_FULL (5.758 ms) : 5701, 5815
.   : milestone, 5758,
iast_GLOBAL (3.678 ms) : 3547, 3808
.   : milestone, 3678,
profiling (2.203 ms) : 2183, 2223
.   : milestone, 2203,
tracing (1.889 ms) : 1871, 1908
.   : milestone, 1889,
section candidate
no_agent (1.19 ms) : 1178, 1202
.   : milestone, 1190,
iast (3.185 ms) : 3143, 3228
.   : milestone, 3185,
iast_FULL (5.791 ms) : 5734, 5849
.   : milestone, 5791,
iast_GLOBAL (3.897 ms) : 3836, 3957
.   : milestone, 3897,
profiling (2.076 ms) : 2057, 2094
.   : milestone, 2076,
tracing (1.824 ms) : 1810, 1839
.   : milestone, 1824,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.208 ms] -
iast 3.075 ms [3.035 ms, 3.115 ms] 1.879 ms (157.0%)
iast_FULL 5.758 ms [5.701 ms, 5.815 ms] 4.562 ms (381.3%)
iast_GLOBAL 3.678 ms [3.547 ms, 3.808 ms] 2.481 ms (207.4%)
profiling 2.203 ms [2.183 ms, 2.223 ms] 1.006 ms (84.1%)
tracing 1.889 ms [1.871 ms, 1.908 ms] 692.961 µs (57.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.202 ms] -
iast 3.185 ms [3.143 ms, 3.228 ms] 1.995 ms (167.7%)
iast_FULL 5.791 ms [5.734 ms, 5.849 ms] 4.601 ms (386.7%)
iast_GLOBAL 3.897 ms [3.836 ms, 3.957 ms] 2.707 ms (227.4%)
profiling 2.076 ms [2.057 ms, 2.094 ms] 885.621 µs (74.4%)
tracing 1.824 ms [1.81 ms, 1.839 ms] 634.267 µs (53.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.88 ms) : 17698, 18062
.   : milestone, 17880,
appsec (18.619 ms) : 18429, 18809
.   : milestone, 18619,
code_origins (17.772 ms) : 17601, 17944
.   : milestone, 17772,
iast (17.68 ms) : 17503, 17857
.   : milestone, 17680,
profiling (19.576 ms) : 19377, 19774
.   : milestone, 19576,
tracing (17.308 ms) : 17137, 17479
.   : milestone, 17308,
section candidate
no_agent (17.04 ms) : 16870, 17209
.   : milestone, 17040,
appsec (19.258 ms) : 19063, 19453
.   : milestone, 19258,
code_origins (17.835 ms) : 17655, 18015
.   : milestone, 17835,
iast (17.79 ms) : 17609, 17971
.   : milestone, 17790,
profiling (19.87 ms) : 19672, 20069
.   : milestone, 19870,
tracing (17.566 ms) : 17391, 17741
.   : milestone, 17566,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.88 ms [17.698 ms, 18.062 ms] -
appsec 18.619 ms [18.429 ms, 18.809 ms] 738.878 µs (4.1%)
code_origins 17.772 ms [17.601 ms, 17.944 ms] -107.814 µs (-0.6%)
iast 17.68 ms [17.503 ms, 17.857 ms] -199.928 µs (-1.1%)
profiling 19.576 ms [19.377 ms, 19.774 ms] 1.696 ms (9.5%)
tracing 17.308 ms [17.137 ms, 17.479 ms] -571.923 µs (-3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.04 ms [16.87 ms, 17.209 ms] -
appsec 19.258 ms [19.063 ms, 19.453 ms] 2.218 ms (13.0%)
code_origins 17.835 ms [17.655 ms, 18.015 ms] 795.343 µs (4.7%)
iast 17.79 ms [17.609 ms, 17.971 ms] 750.474 µs (4.4%)
profiling 19.87 ms [19.672 ms, 20.069 ms] 2.831 ms (16.6%)
tracing 17.566 ms [17.391 ms, 17.741 ms] 526.245 µs (3.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612 413efac
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763579349 1763579349
ci_job_id 1245772746 1245772746
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-76lbzd9v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-76lbzd9v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.489 ms) : 1477, 1500
.   : milestone, 1489,
appsec (3.701 ms) : 3483, 3919
.   : milestone, 3701,
iast (2.228 ms) : 2164, 2292
.   : milestone, 2228,
iast_GLOBAL (2.268 ms) : 2204, 2332
.   : milestone, 2268,
profiling (2.093 ms) : 2040, 2146
.   : milestone, 2093,
tracing (2.047 ms) : 1997, 2097
.   : milestone, 2047,
section candidate
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.729 ms) : 3509, 3949
.   : milestone, 3729,
iast (2.22 ms) : 2156, 2284
.   : milestone, 2220,
iast_GLOBAL (2.267 ms) : 2202, 2331
.   : milestone, 2267,
profiling (2.485 ms) : 2276, 2695
.   : milestone, 2485,
tracing (2.053 ms) : 2003, 2103
.   : milestone, 2053,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.5 ms] -
appsec 3.701 ms [3.483 ms, 3.919 ms] 2.213 ms (148.6%)
iast 2.228 ms [2.164 ms, 2.292 ms] 739.257 µs (49.7%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.332 ms] 779.542 µs (52.4%)
profiling 2.093 ms [2.04 ms, 2.146 ms] 604.246 µs (40.6%)
tracing 2.047 ms [1.997 ms, 2.097 ms] 558.575 µs (37.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.729 ms [3.509 ms, 3.949 ms] 2.246 ms (151.5%)
iast 2.22 ms [2.156 ms, 2.284 ms] 737.536 µs (49.7%)
iast_GLOBAL 2.267 ms [2.202 ms, 2.331 ms] 784.214 µs (52.9%)
profiling 2.485 ms [2.276 ms, 2.695 ms] 1.003 ms (67.6%)
tracing 2.053 ms [2.003 ms, 2.103 ms] 570.364 µs (38.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
appsec (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
iast (18.71 s) : 18710000, 18710000
.   : milestone, 18710000,
iast_GLOBAL (18.082 s) : 18082000, 18082000
.   : milestone, 18082000,
profiling (15.234 s) : 15234000, 15234000
.   : milestone, 15234000,
tracing (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
section candidate
no_agent (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
appsec (14.799 s) : 14799000, 14799000
.   : milestone, 14799000,
iast (18.611 s) : 18611000, 18611000
.   : milestone, 18611000,
iast_GLOBAL (17.786 s) : 17786000, 17786000
.   : milestone, 17786000,
profiling (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
tracing (14.826 s) : 14826000, 14826000
.   : milestone, 14826000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.97 s [14.97 s, 14.97 s] -
appsec 15.004 s [15.004 s, 15.004 s] 34.0 ms (0.2%)
iast 18.71 s [18.71 s, 18.71 s] 3.74 s (25.0%)
iast_GLOBAL 18.082 s [18.082 s, 18.082 s] 3.112 s (20.8%)
profiling 15.234 s [15.234 s, 15.234 s] 264.0 ms (1.8%)
tracing 14.922 s [14.922 s, 14.922 s] -48.0 ms (-0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.926 s [14.926 s, 14.926 s] -
appsec 14.799 s [14.799 s, 14.799 s] -127.0 ms (-0.9%)
iast 18.611 s [18.611 s, 18.611 s] 3.685 s (24.7%)
iast_GLOBAL 17.786 s [17.786 s, 17.786 s] 2.86 s (19.2%)
profiling 15.142 s [15.142 s, 15.142 s] 216.0 ms (1.4%)
tracing 14.826 s [14.826 s, 14.826 s] -100.0 ms (-0.7%)

@pr-commenter
Copy link

pr-commenter bot commented Nov 10, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612 413efac
See matching parameters
Baseline Candidate
ci_job_date 1763578466 1763578466
ci_job_id 1245772751 1245772751
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Nov 12, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612 413efac
See matching parameters
Baseline Candidate
ci_job_date 1763578498 1763578498
ci_job_id 1245772752 1245772752
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+901.344op/s; +4415.732op/s] or [+0.539%; +2.639%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@kr-igor