Skip to content

Exclude flaky errors from error log checks #8123

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
smola merged 2 commits into from
Jan 7, 2025
Merged

Exclude flaky errors from error log checks #8123

smola merged 2 commits into from
Jan 7, 2025

Conversation

@smola
Copy link
Member

@smola smola commented Dec 20, 2024 •
edited
Loading

What Does This Do

Follow up to #8111.

Various errors can appear more frequently than I anticipated. They need to be excluded.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes run-tests: all Run all tests labels Dec 20, 2024
@smola smola force-pushed the smola/add-error-log-exclusions branch from bc6f306 to dac2889 Compare December 20, 2024 16:32
@pr-commenter
Copy link

pr-commenter bot commented Dec 20, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/add-error-log-exclusions
git_commit_date 1736160002 1736238136
git_commit_sha 0c2f7ff 7f02a02
release_version 1.45.0-SNAPSHOT~0c2f7ff792 1.45.0-SNAPSHOT~7f02a02aa4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736240640 1736240640
ci_job_id 756367652 756367652
ci_pipeline_id 52297560 52297560
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061708
Total [baseline] (8.63 s) : 0, 8629684
Agent [candidate] (1.063 s) : 0, 1063286
Total [candidate] (8.61 s) : 0, 8610148
section iast
Agent [baseline] (1.187 s) : 0, 1187082
Total [baseline] (9.175 s) : 0, 9174584
Agent [candidate] (1.189 s) : 0, 1188676
Total [candidate] (9.221 s) : 0, 9221391
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.186 s) : 0, 1186458
Total [baseline] (9.168 s) : 0, 9168226
Agent [candidate] (1.19 s) : 0, 1190320
Total [candidate] (9.197 s) : 0, 9197188
section iast_TELEMETRY_OFF
Agent [baseline] (1.176 s) : 0, 1175560
Total [baseline] (9.163 s) : 0, 9162933
Agent [candidate] (1.187 s) : 0, 1187291
Total [candidate] (9.188 s) : 0, 9188229
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.187 s 125.374 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.186 s 124.751 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.176 s 113.853 ms (10.7%)
Total tracing 8.63 s -
Total iast 9.175 s 544.9 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.168 s 538.542 ms (6.2%)
Total iast_TELEMETRY_OFF 9.163 s 533.249 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.189 s 125.39 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.19 s 127.034 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.187 s 124.005 ms (11.7%)
Total tracing 8.61 s -
Total iast 9.221 s 611.243 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 587.04 ms (6.8%)
Total iast_TELEMETRY_OFF 9.188 s 578.081 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.806 ms) : 0, 717806
BytebuddyAgent [candidate] (718.361 ms) : 0, 718361
GlobalTracer [baseline] (257.837 ms) : 0, 257837
GlobalTracer [candidate] (258.859 ms) : 0, 258859
AppSec [baseline] (56.852 ms) : 0, 56852
AppSec [candidate] (55.903 ms) : 0, 55903
Remote Config [baseline] (727.23 µs) : 0, 727
Remote Config [candidate] (733.916 µs) : 0, 734
Telemetry [baseline] (13.374 ms) : 0, 13374
Telemetry [candidate] (14.337 ms) : 0, 14337
section iast
BytebuddyAgent [baseline] (835.35 ms) : 0, 835350
BytebuddyAgent [candidate] (836.406 ms) : 0, 836406
GlobalTracer [baseline] (247.656 ms) : 0, 247656
GlobalTracer [candidate] (248.147 ms) : 0, 248147
AppSec [baseline] (58.547 ms) : 0, 58547
AppSec [candidate] (58.361 ms) : 0, 58361
IAST [baseline] (21.24 ms) : 0, 21240
IAST [candidate] (21.424 ms) : 0, 21424
Remote Config [baseline] (672.683 µs) : 0, 673
Remote Config [candidate] (660.344 µs) : 0, 660
Telemetry [baseline] (8.584 ms) : 0, 8584
Telemetry [candidate] (8.616 ms) : 0, 8616
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.081 ms) : 0, 835081
BytebuddyAgent [candidate] (837.425 ms) : 0, 837425
GlobalTracer [baseline] (247.387 ms) : 0, 247387
GlobalTracer [candidate] (248.517 ms) : 0, 248517
AppSec [baseline] (58.27 ms) : 0, 58270
AppSec [candidate] (58.495 ms) : 0, 58495
IAST [baseline] (21.358 ms) : 0, 21358
IAST [candidate] (21.399 ms) : 0, 21399
Remote Config [baseline] (656.131 µs) : 0, 656
Remote Config [candidate] (671.95 µs) : 0, 672
Telemetry [baseline] (8.616 ms) : 0, 8616
Telemetry [candidate] (8.687 ms) : 0, 8687
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (827.179 ms) : 0, 827179
BytebuddyAgent [candidate] (835.46 ms) : 0, 835460
GlobalTracer [baseline] (245.982 ms) : 0, 245982
GlobalTracer [candidate] (248.695 ms) : 0, 248695
AppSec [baseline] (57.763 ms) : 0, 57763
AppSec [candidate] (57.993 ms) : 0, 57993
IAST [baseline] (20.642 ms) : 0, 20642
IAST [candidate] (20.819 ms) : 0, 20819
Remote Config [baseline] (640.307 µs) : 0, 640
Remote Config [candidate] (667.455 µs) : 0, 667
Telemetry [baseline] (8.34 ms) : 0, 8340
Telemetry [candidate] (8.494 ms) : 0, 8494
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1056235
Total [baseline] (10.485 s) : 0, 10485224
Agent [candidate] (1.052 s) : 0, 1051749
Total [candidate] (10.396 s) : 0, 10396218
section appsec
Agent [baseline] (1.191 s) : 0, 1190561
Total [baseline] (10.743 s) : 0, 10742960
Agent [candidate] (1.191 s) : 0, 1190746
Total [candidate] (10.658 s) : 0, 10657838
section iast
Agent [baseline] (1.185 s) : 0, 1184674
Total [baseline] (10.951 s) : 0, 10950510
Agent [candidate] (1.183 s) : 0, 1183081
Total [candidate] (10.958 s) : 0, 10958357
section profiling
Agent [baseline] (1.295 s) : 0, 1294939
Total [baseline] (10.84 s) : 0, 10839979
Agent [candidate] (1.284 s) : 0, 1284299
Total [candidate] (10.943 s) : 0, 10943079
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.191 s 134.326 ms (12.7%)
Agent iast 1.185 s 128.439 ms (12.2%)
Agent profiling 1.295 s 238.704 ms (22.6%)
Total tracing 10.485 s -
Total appsec 10.743 s 257.736 ms (2.5%)
Total iast 10.951 s 465.286 ms (4.4%)
Total profiling 10.84 s 354.756 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.191 s 138.997 ms (13.2%)
Agent iast 1.183 s 131.333 ms (12.5%)
Agent profiling 1.284 s 232.55 ms (22.1%)
Total tracing 10.396 s -
Total appsec 10.658 s 261.62 ms (2.5%)
Total iast 10.958 s 562.139 ms (5.4%)
Total profiling 10.943 s 546.86 ms (5.3%) 
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.803 ms) : 0, 713803
BytebuddyAgent [candidate] (713.03 ms) : 0, 713030
GlobalTracer [baseline] (256.05 ms) : 0, 256050
GlobalTracer [candidate] (255.61 ms) : 0, 255610
AppSec [baseline] (56.274 ms) : 0, 56274
AppSec [candidate] (55.34 ms) : 0, 55340
Remote Config [baseline] (725.347 µs) : 0, 725
Remote Config [candidate] (725.04 µs) : 0, 725
Telemetry [baseline] (14.318 ms) : 0, 14318
Telemetry [candidate] (11.932 ms) : 0, 11932
section appsec
BytebuddyAgent [baseline] (732.085 ms) : 0, 732085
BytebuddyAgent [candidate] (732.66 ms) : 0, 732660
GlobalTracer [baseline] (254.066 ms) : 0, 254066
GlobalTracer [candidate] (253.786 ms) : 0, 253786
AppSec [baseline] (170.886 ms) : 0, 170886
AppSec [candidate] (169.911 ms) : 0, 169911
Remote Config [baseline] (670.187 µs) : 0, 670
Remote Config [candidate] (653.51 µs) : 0, 654
Telemetry [baseline] (8.005 ms) : 0, 8005
Telemetry [candidate] (8.277 ms) : 0, 8277
IAST [baseline] (19.653 ms) : 0, 19653
IAST [candidate] (20.722 ms) : 0, 20722
section iast
BytebuddyAgent [baseline] (835.118 ms) : 0, 835118
BytebuddyAgent [candidate] (832.907 ms) : 0, 832907
GlobalTracer [baseline] (246.239 ms) : 0, 246239
GlobalTracer [candidate] (246.976 ms) : 0, 246976
AppSec [baseline] (57.927 ms) : 0, 57927
AppSec [candidate] (58.038 ms) : 0, 58038
Remote Config [baseline] (662.332 µs) : 0, 662
Remote Config [candidate] (670.094 µs) : 0, 670
Telemetry [baseline] (8.538 ms) : 0, 8538
Telemetry [candidate] (8.499 ms) : 0, 8499
IAST [baseline] (21.128 ms) : 0, 21128
IAST [candidate] (20.934 ms) : 0, 20934
section profiling
BytebuddyAgent [baseline] (716.177 ms) : 0, 716177
BytebuddyAgent [candidate] (707.54 ms) : 0, 707540
GlobalTracer [baseline] (376.115 ms) : 0, 376115
GlobalTracer [candidate] (374.879 ms) : 0, 374879
AppSec [baseline] (54.452 ms) : 0, 54452
AppSec [candidate] (54.501 ms) : 0, 54501
Remote Config [baseline] (669.386 µs) : 0, 669
Remote Config [candidate] (662.971 µs) : 0, 663
Telemetry [baseline] (7.923 ms) : 0, 7923
Telemetry [candidate] (7.959 ms) : 0, 7959
ProfilingAgent [baseline] (96.946 ms) : 0, 96946
ProfilingAgent [candidate] (96.607 ms) : 0, 96607
Profiling [baseline] (96.97 ms) : 0, 96970
Profiling [candidate] (96.631 ms) : 0, 96631
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-07T08:34:21 2025-01-07T08:41:21
git_branch master smola/add-error-log-exclusions
git_commit_date 1736160002 1736238136
git_commit_sha 0c2f7ff 7f02a02
release_version 1.45.0-SNAPSHOT~0c2f7ff792 1.45.0-SNAPSHOT~7f02a02aa4
start_time 2025-01-07T08:34:08 2025-01-07T08:41:07
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736239635 1736239635
ci_job_id 756367653 756367653
ci_pipeline_id 52297560 52297560
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.024 µs) : 353, 393
.   : milestone, 373,
iast (492.133 µs) : 471, 514
.   : milestone, 492,
iast_FULL (654.481 µs) : 633, 676
.   : milestone, 654,
iast_GLOBAL (526.891 µs) : 505, 549
.   : milestone, 527,
iast_HARDCODED_SECRET_DISABLED (490.549 µs) : 469, 512
.   : milestone, 491,
iast_INACTIVE (459.995 µs) : 438, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (486.725 µs) : 465, 509
.   : milestone, 487,
tracing (453.3 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (376.165 µs) : 356, 396
.   : milestone, 376,
iast (498.978 µs) : 477, 521
.   : milestone, 499,
iast_FULL (659.342 µs) : 638, 681
.   : milestone, 659,
iast_GLOBAL (525.907 µs) : 504, 548
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (498.481 µs) : 477, 520
.   : milestone, 498,
iast_INACTIVE (459.116 µs) : 438, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (482.926 µs) : 461, 505
.   : milestone, 483,
tracing (459.248 µs) : 438, 480
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.024 µs [353.061 µs, 392.988 µs] -
iast 492.133 µs [470.617 µs, 513.65 µs] 119.109 µs (31.9%)
iast_FULL 654.481 µs [632.717 µs, 676.244 µs] 281.456 µs (75.5%)
iast_GLOBAL 526.891 µs [504.554 µs, 549.228 µs] 153.866 µs (41.2%)
iast_HARDCODED_SECRET_DISABLED 490.549 µs [468.744 µs, 512.354 µs] 117.525 µs (31.5%)
iast_INACTIVE 459.995 µs [438.3 µs, 481.691 µs] 86.971 µs (23.3%)
iast_TELEMETRY_OFF 486.725 µs [464.621 µs, 508.829 µs] 113.701 µs (30.5%)
tracing 453.3 µs [432.263 µs, 474.337 µs] 80.276 µs (21.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.165 µs [355.987 µs, 396.343 µs] -
iast 498.978 µs [476.913 µs, 521.043 µs] 122.813 µs (32.6%)
iast_FULL 659.342 µs [637.606 µs, 681.079 µs] 283.177 µs (75.3%)
iast_GLOBAL 525.907 µs [503.598 µs, 548.216 µs] 149.742 µs (39.8%)
iast_HARDCODED_SECRET_DISABLED 498.481 µs [476.563 µs, 520.399 µs] 122.316 µs (32.5%)
iast_INACTIVE 459.116 µs [437.743 µs, 480.488 µs] 82.951 µs (22.1%)
iast_TELEMETRY_OFF 482.926 µs [460.82 µs, 505.032 µs] 106.761 µs (28.4%)
tracing 459.248 µs [438.035 µs, 480.461 µs] 83.083 µs (22.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.35 ms) : 1331, 1370
.   : milestone, 1350,
appsec (1.747 ms) : 1724, 1771
.   : milestone, 1747,
appsec_no_iast (1.748 ms) : 1723, 1773
.   : milestone, 1748,
iast (1.504 ms) : 1480, 1527
.   : milestone, 1504,
profiling (1.516 ms) : 1493, 1540
.   : milestone, 1516,
tracing (1.499 ms) : 1474, 1524
.   : milestone, 1499,
section candidate
no_agent (1.348 ms) : 1328, 1367
.   : milestone, 1348,
appsec (1.747 ms) : 1723, 1772
.   : milestone, 1747,
appsec_no_iast (1.766 ms) : 1742, 1790
.   : milestone, 1766,
iast (1.491 ms) : 1468, 1515
.   : milestone, 1491,
profiling (1.514 ms) : 1489, 1540
.   : milestone, 1514,
tracing (1.497 ms) : 1472, 1521
.   : milestone, 1497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.37 ms] -
appsec 1.747 ms [1.724 ms, 1.771 ms] 396.983 µs (29.4%)
appsec_no_iast 1.748 ms [1.723 ms, 1.773 ms] 397.791 µs (29.5%)
iast 1.504 ms [1.48 ms, 1.527 ms] 153.18 µs (11.3%)
profiling 1.516 ms [1.493 ms, 1.54 ms] 165.932 µs (12.3%)
tracing 1.499 ms [1.474 ms, 1.524 ms] 148.412 µs (11.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.328 ms, 1.367 ms] -
appsec 1.747 ms [1.723 ms, 1.772 ms] 399.646 µs (29.7%)
appsec_no_iast 1.766 ms [1.742 ms, 1.79 ms] 418.498 µs (31.1%)
iast 1.491 ms [1.468 ms, 1.515 ms] 143.629 µs (10.7%)
profiling 1.514 ms [1.489 ms, 1.54 ms] 166.57 µs (12.4%)
tracing 1.497 ms [1.472 ms, 1.521 ms] 149.022 µs (11.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/add-error-log-exclusions
git_commit_date 1736160002 1736238136
git_commit_sha 0c2f7ff 7f02a02
release_version 1.45.0-SNAPSHOT~0c2f7ff792 1.45.0-SNAPSHOT~7f02a02aa4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1736240217 1736240217
ci_job_id 756367654 756367654
ci_pipeline_id 52297560 52297560
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.112 s) : 15112000, 15112000
.   : milestone, 15112000,
appsec (14.743 s) : 14743000, 14743000
.   : milestone, 14743000,
iast (18.631 s) : 18631000, 18631000
.   : milestone, 18631000,
iast_GLOBAL (17.875 s) : 17875000, 17875000
.   : milestone, 17875000,
profiling (15.161 s) : 15161000, 15161000
.   : milestone, 15161000,
tracing (15.306 s) : 15306000, 15306000
.   : milestone, 15306000,
section candidate
no_agent (14.932 s) : 14932000, 14932000
.   : milestone, 14932000,
appsec (14.929 s) : 14929000, 14929000
.   : milestone, 14929000,
iast (19.1 s) : 19100000, 19100000
.   : milestone, 19100000,
iast_GLOBAL (17.659 s) : 17659000, 17659000
.   : milestone, 17659000,
profiling (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
tracing (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.112 s [15.112 s, 15.112 s] -
appsec 14.743 s [14.743 s, 14.743 s] -369.0 ms (-2.4%)
iast 18.631 s [18.631 s, 18.631 s] 3.519 s (23.3%)
iast_GLOBAL 17.875 s [17.875 s, 17.875 s] 2.763 s (18.3%)
profiling 15.161 s [15.161 s, 15.161 s] 49.0 ms (0.3%)
tracing 15.306 s [15.306 s, 15.306 s] 194.0 ms (1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.932 s [14.932 s, 14.932 s] -
appsec 14.929 s [14.929 s, 14.929 s] -3.0 ms (-0.0%)
iast 19.1 s [19.1 s, 19.1 s] 4.168 s (27.9%)
iast_GLOBAL 17.659 s [17.659 s, 17.659 s] 2.727 s (18.3%)
profiling 15.081 s [15.081 s, 15.081 s] 149.0 ms (1.0%)
tracing 15.053 s [15.053 s, 15.053 s] 121.0 ms (0.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~7f02a02aa4, baseline=1.45.0-SNAPSHOT~0c2f7ff792
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.369 ms) : 2326, 2411
.   : milestone, 2369,
iast (2.13 ms) : 2076, 2184
.   : milestone, 2130,
iast_GLOBAL (2.167 ms) : 2112, 2221
.   : milestone, 2167,
profiling (1.988 ms) : 1944, 2033
.   : milestone, 1988,
tracing (1.947 ms) : 1906, 1989
.   : milestone, 1947,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.374 ms) : 2332, 2417
.   : milestone, 2374,
iast (2.115 ms) : 2061, 2169
.   : milestone, 2115,
iast_GLOBAL (2.16 ms) : 2106, 2214
.   : milestone, 2160,
profiling (1.98 ms) : 1937, 2024
.   : milestone, 1980,
tracing (1.964 ms) : 1922, 2006
.   : milestone, 1964,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.369 ms [2.326 ms, 2.411 ms] 889.491 µs (60.1%)
iast 2.13 ms [2.076 ms, 2.184 ms] 651.043 µs (44.0%)
iast_GLOBAL 2.167 ms [2.112 ms, 2.221 ms] 687.314 µs (46.5%)
profiling 1.988 ms [1.944 ms, 2.033 ms] 509.133 µs (34.4%)
tracing 1.947 ms [1.906 ms, 1.989 ms] 468.182 µs (31.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.374 ms [2.332 ms, 2.417 ms] 897.535 µs (60.8%)
iast 2.115 ms [2.061 ms, 2.169 ms] 638.694 µs (43.3%)
iast_GLOBAL 2.16 ms [2.106 ms, 2.214 ms] 683.721 µs (46.3%)
profiling 1.98 ms [1.937 ms, 2.024 ms] 503.817 µs (34.1%)
tracing 1.964 ms [1.922 ms, 2.006 ms] 487.917 µs (33.0%)

@smola smola mentioned this pull request Dec 20, 2024
Closed
@smola smola marked this pull request as ready for review January 7, 2025 08:23
@smola smola requested a review from a team as a code owner January 7, 2025 08:23
@smola smola requested a review from dougqh January 7, 2025 08:23
@smola smola enabled auto-merge (squash) January 7, 2025 09:26
@smola smola merged commit 3f8fbe6 into master Jan 7, 2025
208 checks passed
@smola smola deleted the smola/add-error-log-exclusions branch January 7, 2025 14:55
@github-actions github-actions bot added this to the 1.45.0 milestone Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Mariovido Mariovido Mariovido approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing run-tests: all Run all tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.45.0

Development

Successfully merging this pull request may close these issues.

3 participants

@smola @Mariovido