Remove warning log when JUnit 4 test method cannot be retrieved #8445

nikita-tkachenko-datadog · 2025-02-25T12:08:05Z

What Does This Do

Additional Notes

With some JUnit4-based frameworks (such as Scala MUnit) it is expected that the tracer cannot determine test case method (with Scala MUnit the necessary information is not available at runtime).
Therefore we should not be reporting this as a warning, and clutter the users' logs.
It will still be reported with debug logging level and will be available in telemetry logs.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-02-25T12:48:57Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/munit-error-log
git_commit_date	1740480034	1740485262
git_commit_sha	`28c315b`	`814405b`
release_version	1.47.0-SNAPSHOT~28c315b990	1.47.0-SNAPSHOT~814405b576

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740487691	1740487691
ci_job_id	821689898	821689898
ci_pipeline_id	56865474	56865474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-chbxpuyt-project-304-concurrent-0-websdhwu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-chbxpuyt-project-304-concurrent-0-websdhwu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1044237
Total [baseline] (10.395 s) : 0, 10394589
Agent [candidate] (1.037 s) : 0, 1036563
Total [candidate] (10.35 s) : 0, 10350152
section appsec
Agent [baseline] (1.186 s) : 0, 1186055
Total [baseline] (10.757 s) : 0, 10756711
Agent [candidate] (1.18 s) : 0, 1179871
Total [candidate] (10.715 s) : 0, 10715167
section iast
Agent [baseline] (1.181 s) : 0, 1180864
Total [baseline] (11.051 s) : 0, 11051102
Agent [candidate] (1.168 s) : 0, 1168443
Total [candidate] (10.984 s) : 0, 10984298
section profiling
Agent [baseline] (1.262 s) : 0, 1261905
Total [baseline] (10.847 s) : 0, 10846877
Agent [candidate] (1.257 s) : 0, 1256760
Total [candidate] (10.811 s) : 0, 10810925

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.186 s	141.818 ms (13.6%)
Agent	iast	1.181 s	136.627 ms (13.1%)
Agent	profiling	1.262 s	217.667 ms (20.8%)
Total	tracing	10.395 s	-
Total	appsec	10.757 s	362.122 ms (3.5%)
Total	iast	11.051 s	656.513 ms (6.3%)
Total	profiling	10.847 s	452.289 ms (4.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.037 s	-
Agent	appsec	1.18 s	143.308 ms (13.8%)
Agent	iast	1.168 s	131.88 ms (12.7%)
Agent	profiling	1.257 s	220.197 ms (21.2%)
Total	tracing	10.35 s	-
Total	appsec	10.715 s	365.015 ms (3.5%)
Total	iast	10.984 s	634.146 ms (6.1%)
Total	profiling	10.811 s	460.772 ms (4.5%)

gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.709 ms) : 0, 720709
BytebuddyAgent [candidate] (714.697 ms) : 0, 714697
GlobalTracer [baseline] (239.902 ms) : 0, 239902
GlobalTracer [candidate] (238.093 ms) : 0, 238093
AppSec [baseline] (55.727 ms) : 0, 55727
AppSec [candidate] (55.329 ms) : 0, 55329
Remote Config [baseline] (688.436 µs) : 0, 688
Remote Config [candidate] (693.017 µs) : 0, 693
Telemetry [baseline] (12.217 ms) : 0, 12217
Telemetry [candidate] (12.826 ms) : 0, 12826
section appsec
BytebuddyAgent [baseline] (738.065 ms) : 0, 738065
BytebuddyAgent [candidate] (732.672 ms) : 0, 732672
GlobalTracer [baseline] (236.762 ms) : 0, 236762
GlobalTracer [candidate] (235.802 ms) : 0, 235802
AppSec [baseline] (176.452 ms) : 0, 176452
AppSec [candidate] (176.902 ms) : 0, 176902
Remote Config [baseline] (652.667 µs) : 0, 653
Remote Config [candidate] (656.674 µs) : 0, 657
Telemetry [baseline] (8.258 ms) : 0, 8258
Telemetry [candidate] (8.245 ms) : 0, 8245
IAST [baseline] (21.814 ms) : 0, 21814
IAST [candidate] (21.492 ms) : 0, 21492
section iast
BytebuddyAgent [baseline] (846.068 ms) : 0, 846068
BytebuddyAgent [candidate] (834.451 ms) : 0, 834451
GlobalTracer [baseline] (230.373 ms) : 0, 230373
GlobalTracer [candidate] (229.573 ms) : 0, 229573
AppSec [baseline] (57.051 ms) : 0, 57051
AppSec [candidate] (57.255 ms) : 0, 57255
Remote Config [baseline] (609.944 µs) : 0, 610
Remote Config [candidate] (620.874 µs) : 0, 621
Telemetry [baseline] (8.695 ms) : 0, 8695
Telemetry [candidate] (8.737 ms) : 0, 8737
IAST [baseline] (22.924 ms) : 0, 22924
IAST [candidate] (22.878 ms) : 0, 22878
section profiling
ProfilingAgent [baseline] (95.947 ms) : 0, 95947
ProfilingAgent [candidate] (95.953 ms) : 0, 95953
BytebuddyAgent [baseline] (711.61 ms) : 0, 711610
BytebuddyAgent [candidate] (707.236 ms) : 0, 707236
GlobalTracer [baseline] (349.015 ms) : 0, 349015
GlobalTracer [candidate] (349.026 ms) : 0, 349026
AppSec [baseline] (55.152 ms) : 0, 55152
AppSec [candidate] (54.638 ms) : 0, 54638
Remote Config [baseline] (663.425 µs) : 0, 663
Remote Config [candidate] (663.846 µs) : 0, 664
Telemetry [baseline] (8.961 ms) : 0, 8961
Telemetry [candidate] (8.913 ms) : 0, 8913
Profiling [baseline] (95.97 ms) : 0, 95970
Profiling [candidate] (95.977 ms) : 0, 95977

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1040679
Total [baseline] (8.658 s) : 0, 8658419
Agent [candidate] (1.038 s) : 0, 1037648
Total [candidate] (8.64 s) : 0, 8639806
section iast
Agent [baseline] (1.167 s) : 0, 1167264
Total [baseline] (9.217 s) : 0, 9216735
Agent [candidate] (1.169 s) : 0, 1169211
Total [candidate] (9.265 s) : 0, 9265063
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170699
Total [baseline] (9.181 s) : 0, 9180899
Agent [candidate] (1.172 s) : 0, 1171594
Total [candidate] (9.191 s) : 0, 9191004
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174170
Total [baseline] (9.218 s) : 0, 9217533
Agent [candidate] (1.171 s) : 0, 1171432
Total [candidate] (9.225 s) : 0, 9224678

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.041 s	-
Agent	iast	1.167 s	126.584 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.171 s	130.02 ms (12.5%)
Agent	iast_TELEMETRY_OFF	1.174 s	133.49 ms (12.8%)
Total	tracing	8.658 s	-
Total	iast	9.217 s	558.316 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.181 s	522.481 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.218 s	559.114 ms (6.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.038 s	-
Agent	iast	1.169 s	131.564 ms (12.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.172 s	133.946 ms (12.9%)
Agent	iast_TELEMETRY_OFF	1.171 s	133.784 ms (12.9%)
Total	tracing	8.64 s	-
Total	iast	9.265 s	625.257 ms (7.2%)
Total	iast_HARDCODED_SECRET_DISABLED	9.191 s	551.198 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.225 s	584.872 ms (6.8%)

gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.78 ms) : 0, 718780
BytebuddyAgent [candidate] (716.868 ms) : 0, 716868
GlobalTracer [baseline] (239.507 ms) : 0, 239507
GlobalTracer [candidate] (239.149 ms) : 0, 239149
AppSec [baseline] (55.462 ms) : 0, 55462
AppSec [candidate] (55.409 ms) : 0, 55409
Remote Config [baseline] (702.663 µs) : 0, 703
Remote Config [candidate] (691.304 µs) : 0, 691
Telemetry [baseline] (11.367 ms) : 0, 11367
Telemetry [candidate] (10.613 ms) : 0, 10613
section iast
BytebuddyAgent [baseline] (833.72 ms) : 0, 833720
BytebuddyAgent [candidate] (834.687 ms) : 0, 834687
GlobalTracer [baseline] (229.103 ms) : 0, 229103
GlobalTracer [candidate] (229.554 ms) : 0, 229554
IAST [baseline] (22.909 ms) : 0, 22909
IAST [candidate] (22.937 ms) : 0, 22937
AppSec [baseline] (57.252 ms) : 0, 57252
AppSec [candidate] (57.686 ms) : 0, 57686
Remote Config [baseline] (615.065 µs) : 0, 615
Remote Config [candidate] (617.649 µs) : 0, 618
Telemetry [baseline] (8.774 ms) : 0, 8774
Telemetry [candidate] (8.877 ms) : 0, 8877
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.908 ms) : 0, 836908
BytebuddyAgent [candidate] (836.975 ms) : 0, 836975
GlobalTracer [baseline] (229.844 ms) : 0, 229844
GlobalTracer [candidate] (230.333 ms) : 0, 230333
IAST [baseline] (22.849 ms) : 0, 22849
IAST [candidate] (22.906 ms) : 0, 22906
AppSec [baseline] (56.638 ms) : 0, 56638
AppSec [candidate] (57.153 ms) : 0, 57153
Remote Config [baseline] (608.96 µs) : 0, 609
Remote Config [candidate] (614.316 µs) : 0, 614
Telemetry [baseline] (8.783 ms) : 0, 8783
Telemetry [candidate] (8.645 ms) : 0, 8645
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (839.33 ms) : 0, 839330
BytebuddyAgent [candidate] (838.899 ms) : 0, 838899
GlobalTracer [baseline] (230.848 ms) : 0, 230848
GlobalTracer [candidate] (229.308 ms) : 0, 229308
IAST [baseline] (25.701 ms) : 0, 25701
IAST [candidate] (25.413 ms) : 0, 25413
AppSec [baseline] (53.976 ms) : 0, 53976
AppSec [candidate] (53.621 ms) : 0, 53621
Remote Config [baseline] (629.087 µs) : 0, 629
Remote Config [candidate] (610.815 µs) : 0, 611
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.579 ms) : 0, 8579

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-02-25T12:18:35	2025-02-25T12:26:21
git_branch	master	nikita-tkachenko/munit-error-log
git_commit_date	1740480034	1740485262
git_commit_sha	`28c315b`	`814405b`
release_version	1.47.0-SNAPSHOT~28c315b990	1.47.0-SNAPSHOT~814405b576
start_time	2025-02-25T12:18:21	2025-02-25T12:26:07

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740486782	1740486782
ci_job_id	821689899	821689899
ci_pipeline_id	56865474	56865474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pfcwcnbt-project-304-concurrent-0-cb7lfv6t 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pfcwcnbt-project-304-concurrent-0-cb7lfv6t 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:profiling	worse [+34.034µs; +86.382µs] or [+2.256%; +5.727%]	unstable [-652.957op/s; +425.037op/s] or [-21.221%; +13.814%]	1.569ms	2962.963op/s	1.508ms	3076.923op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1374
.   : milestone, 1355,
appsec (1.748 ms) : 1723, 1772
.   : milestone, 1748,
appsec_no_iast (1.777 ms) : 1753, 1801
.   : milestone, 1777,
code_origins (1.704 ms) : 1672, 1737
.   : milestone, 1704,
iast (1.503 ms) : 1479, 1527
.   : milestone, 1503,
profiling (1.508 ms) : 1484, 1532
.   : milestone, 1508,
tracing (1.489 ms) : 1464, 1514
.   : milestone, 1489,
section candidate
no_agent (1.372 ms) : 1351, 1392
.   : milestone, 1372,
appsec (1.781 ms) : 1757, 1805
.   : milestone, 1781,
appsec_no_iast (1.746 ms) : 1721, 1771
.   : milestone, 1746,
code_origins (1.692 ms) : 1659, 1726
.   : milestone, 1692,
iast (1.519 ms) : 1494, 1543
.   : milestone, 1519,
profiling (1.569 ms) : 1544, 1593
.   : milestone, 1569,
tracing (1.496 ms) : 1472, 1520
.   : milestone, 1496,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.355 ms [1.335 ms, 1.374 ms]	-
appsec	1.748 ms [1.723 ms, 1.772 ms]	393.15 µs (29.0%)
appsec_no_iast	1.777 ms [1.753 ms, 1.801 ms]	422.516 µs (31.2%)
code_origins	1.704 ms [1.672 ms, 1.737 ms]	349.726 µs (25.8%)
iast	1.503 ms [1.479 ms, 1.527 ms]	148.643 µs (11.0%)
profiling	1.508 ms [1.484 ms, 1.532 ms]	153.699 µs (11.3%)
tracing	1.489 ms [1.464 ms, 1.514 ms]	134.083 µs (9.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.372 ms [1.351 ms, 1.392 ms]	-
appsec	1.781 ms [1.757 ms, 1.805 ms]	408.802 µs (29.8%)
appsec_no_iast	1.746 ms [1.721 ms, 1.771 ms]	374.28 µs (27.3%)
code_origins	1.692 ms [1.659 ms, 1.726 ms]	320.554 µs (23.4%)
iast	1.519 ms [1.494 ms, 1.543 ms]	146.728 µs (10.7%)
profiling	1.569 ms [1.544 ms, 1.593 ms]	196.753 µs (14.3%)
tracing	1.496 ms [1.472 ms, 1.52 ms]	124.443 µs (9.1%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.96 µs) : 360, 402
.   : milestone, 381,
iast (509.653 µs) : 487, 532
.   : milestone, 510,
iast_FULL (730.735 µs) : 709, 753
.   : milestone, 731,
iast_GLOBAL (557.251 µs) : 536, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (513.278 µs) : 492, 535
.   : milestone, 513,
iast_INACTIVE (469.636 µs) : 448, 491
.   : milestone, 470,
iast_TELEMETRY_OFF (498.379 µs) : 476, 520
.   : milestone, 498,
tracing (455.683 µs) : 434, 477
.   : milestone, 456,
section candidate
no_agent (392.495 µs) : 373, 412
.   : milestone, 392,
iast (513.536 µs) : 492, 536
.   : milestone, 514,
iast_FULL (724.449 µs) : 703, 746
.   : milestone, 724,
iast_GLOBAL (549.069 µs) : 528, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (513.172 µs) : 490, 536
.   : milestone, 513,
iast_INACTIVE (462.681 µs) : 442, 484
.   : milestone, 463,
iast_TELEMETRY_OFF (499.58 µs) : 476, 523
.   : milestone, 500,
tracing (456.782 µs) : 436, 478
.   : milestone, 457,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.96 µs [359.844 µs, 402.076 µs]	-
iast	509.653 µs [487.197 µs, 532.108 µs]	128.693 µs (33.8%)
iast_FULL	730.735 µs [708.946 µs, 752.523 µs]	349.774 µs (91.8%)
iast_GLOBAL	557.251 µs [535.637 µs, 578.865 µs]	176.291 µs (46.3%)
iast_HARDCODED_SECRET_DISABLED	513.278 µs [491.535 µs, 535.021 µs]	132.318 µs (34.7%)
iast_INACTIVE	469.636 µs [448.136 µs, 491.136 µs]	88.676 µs (23.3%)
iast_TELEMETRY_OFF	498.379 µs [476.275 µs, 520.482 µs]	117.419 µs (30.8%)
tracing	455.683 µs [434.316 µs, 477.05 µs]	74.723 µs (19.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	392.495 µs [372.642 µs, 412.349 µs]	-
iast	513.536 µs [491.533 µs, 535.539 µs]	121.041 µs (30.8%)
iast_FULL	724.449 µs [702.512 µs, 746.385 µs]	331.953 µs (84.6%)
iast_GLOBAL	549.069 µs [527.532 µs, 570.606 µs]	156.574 µs (39.9%)
iast_HARDCODED_SECRET_DISABLED	513.172 µs [490.094 µs, 536.249 µs]	120.676 µs (30.7%)
iast_INACTIVE	462.681 µs [441.797 µs, 483.564 µs]	70.185 µs (17.9%)
iast_TELEMETRY_OFF	499.58 µs [475.975 µs, 523.185 µs]	107.084 µs (27.3%)
tracing	456.782 µs [435.767 µs, 477.797 µs]	64.287 µs (16.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/munit-error-log
git_commit_date	1740480034	1740485262
git_commit_sha	`28c315b`	`814405b`
release_version	1.47.0-SNAPSHOT~28c315b990	1.47.0-SNAPSHOT~814405b576

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1740487129	1740487129
ci_job_id	821689900	821689900
ci_pipeline_id	56865474	56865474
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-guxxpazr-project-304-concurrent-0-00lfwkxu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-guxxpazr-project-304-concurrent-0-00lfwkxu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.365 ms) : 2321, 2408
.   : milestone, 2365,
iast (2.116 ms) : 2061, 2171
.   : milestone, 2116,
iast_GLOBAL (2.153 ms) : 2097, 2209
.   : milestone, 2153,
profiling (1.958 ms) : 1914, 2001
.   : milestone, 1958,
tracing (1.946 ms) : 1904, 1989
.   : milestone, 1946,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.369 ms) : 2326, 2413
.   : milestone, 2369,
iast (2.119 ms) : 2063, 2174
.   : milestone, 2119,
iast_GLOBAL (2.157 ms) : 2101, 2212
.   : milestone, 2157,
profiling (1.98 ms) : 1936, 2024
.   : milestone, 1980,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	2.365 ms [2.321 ms, 2.408 ms]	887.865 µs (60.1%)
iast	2.116 ms [2.061 ms, 2.171 ms]	639.302 µs (43.3%)
iast_GLOBAL	2.153 ms [2.097 ms, 2.209 ms]	676.01 µs (45.8%)
profiling	1.958 ms [1.914 ms, 2.001 ms]	480.704 µs (32.5%)
tracing	1.946 ms [1.904 ms, 1.989 ms]	469.641 µs (31.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	2.369 ms [2.326 ms, 2.413 ms]	895.569 µs (60.8%)
iast	2.119 ms [2.063 ms, 2.174 ms]	645.108 µs (43.8%)
iast_GLOBAL	2.157 ms [2.101 ms, 2.212 ms]	682.835 µs (46.3%)
profiling	1.98 ms [1.936 ms, 2.024 ms]	506.17 µs (34.3%)
tracing	1.95 ms [1.908 ms, 1.992 ms]	476.348 µs (32.3%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~814405b576, baseline=1.47.0-SNAPSHOT~28c315b990
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
appsec (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
iast (18.843 s) : 18843000, 18843000
.   : milestone, 18843000,
iast_GLOBAL (17.666 s) : 17666000, 17666000
.   : milestone, 17666000,
profiling (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
tracing (15.085 s) : 15085000, 15085000
.   : milestone, 15085000,
section candidate
no_agent (14.73 s) : 14730000, 14730000
.   : milestone, 14730000,
appsec (15.128 s) : 15128000, 15128000
.   : milestone, 15128000,
iast (18.973 s) : 18973000, 18973000
.   : milestone, 18973000,
iast_GLOBAL (17.975 s) : 17975000, 17975000
.   : milestone, 17975000,
profiling (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
tracing (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.969 s [14.969 s, 14.969 s]	-
appsec	15.048 s [15.048 s, 15.048 s]	79.0 ms (0.5%)
iast	18.843 s [18.843 s, 18.843 s]	3.874 s (25.9%)
iast_GLOBAL	17.666 s [17.666 s, 17.666 s]	2.697 s (18.0%)
profiling	15.23 s [15.23 s, 15.23 s]	261.0 ms (1.7%)
tracing	15.085 s [15.085 s, 15.085 s]	116.0 ms (0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.73 s [14.73 s, 14.73 s]	-
appsec	15.128 s [15.128 s, 15.128 s]	398.0 ms (2.7%)
iast	18.973 s [18.973 s, 18.973 s]	4.243 s (28.8%)
iast_GLOBAL	17.975 s [17.975 s, 17.975 s]	3.245 s (22.0%)
profiling	15.089 s [15.089 s, 15.089 s]	359.0 ms (2.4%)
tracing	14.985 s [14.985 s, 14.985 s]	255.0 ms (1.7%)

Remove warning log when JUnit 4 test method cannot be retrieved

814405b

nikita-tkachenko-datadog added type: enhancement comp: ci visibility Continuous Integration Visibility labels Feb 25, 2025

nikita-tkachenko-datadog marked this pull request as ready for review February 25, 2025 13:57

nikita-tkachenko-datadog requested a review from a team as a code owner February 25, 2025 13:57

nikita-tkachenko-datadog requested review from tonyredondo and daniel-mohedano February 25, 2025 13:57

daniel-mohedano approved these changes Feb 25, 2025

View reviewed changes

nikita-tkachenko-datadog merged commit adfc4fe into master Feb 25, 2025
221 checks passed

nikita-tkachenko-datadog deleted the nikita-tkachenko/munit-error-log branch February 25, 2025 14:00

github-actions bot added this to the 1.47.0 milestone Feb 25, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Remove warning log when JUnit 4 test method cannot be retrieved #8445

Remove warning log when JUnit 4 test method cannot be retrieved #8445

nikita-tkachenko-datadog commented Feb 25, 2025 •

edited

Loading

pr-commenter bot commented Feb 25, 2025

Remove warning log when JUnit 4 test method cannot be retrieved #8445

Remove warning log when JUnit 4 test method cannot be retrieved #8445

Conversation

nikita-tkachenko-datadog commented Feb 25, 2025 • edited Loading

What Does This Do

Additional Notes

Contributor Checklist

pr-commenter bot commented Feb 25, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

nikita-tkachenko-datadog commented Feb 25, 2025 •

edited

Loading