Skip to content

GODRIVER-3632: Reroute to use perfcomp from DET #2163

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

zhouselena
Copy link
Contributor

GODRIVER-3632

Summary

  • Edit shell script to use perfcomp from drivers-evergreen-tools
  • Remove perfcomp directory from Go Driver

Background & Motivation

Pilot perf comparison PR comment tool for drivers.

Copy link
Contributor

mongodb-drivers-pr-bot bot commented Aug 8, 2025

🧪 Performance Results

Commit SHA: 92a6021

The following benchmark tests for version 68960bdc5c119f0007abd473 had statistically significant changes (i.e., |z-score| > 1.96):

Benchmark Measurement % Change Patch Value Stable Region H-Score Z-Score
BenchmarkBSONFlatDocumentDecoding ops_per_second_min -47.9044 1005.8520 Avg: 1930.7825
Med: 2025.3411
Stdev: 364.3252
0.8470 -2.5387
BenchmarkBSONDeepDocumentEncoding ops_per_second_min -35.1537 2187.7577 Avg: 3373.7611
Med: 3414.8705
Stdev: 486.4438
0.7931 -2.4381
BenchmarkBSONFullDocumentDecoding ops_per_second_min -29.2399 1316.4078 Avg: 1860.3813
Med: 1863.5370
Stdev: 74.9252
0.9244 -7.2602
BenchmarkBSONDeepDocumentDecoding ops_per_second_min 16.4452 2305.1566 Avg: 1979.6071
Med: 1983.4108
Stdev: 119.2596
0.7964 2.7298
BenchmarkSingleFindOneByID total_bytes_allocated -15.3863 87133072.0000 Avg: 102977438.7066
Med: 103578344.0000
Stdev: 4016485.9565
0.8569 -3.9448
BenchmarkSingleFindOneByID total_mem_allocs -15.2580 1410703.0000 Avg: 1664703.3425
Med: 1673204.0000
Stdev: 66170.2364
0.8527 -3.8386
BenchmarkBSONDeepDocumentDecoding ops_per_second_min 14.4374 2265.4110 Avg: 1979.6071
Med: 1983.4108
Stdev: 119.2596
0.7681 2.3965
BenchmarkBSONFullDocumentDecoding ops_per_second_min -13.9605 1600.6633 Avg: 1860.3813
Med: 1863.5370
Stdev: 74.9252
0.8416 -3.4664
BenchmarkBSONDeepDocumentDecoding ops_per_second_min -12.8735 1724.7624 Avg: 1979.6071
Med: 1983.4108
Stdev: 119.2596
0.7428 -2.1369
BenchmarkSingleRunCommand ns_per_op 11.9632 152808.0000 Avg: 136480.5057
Med: 136298.0000
Stdev: 3948.1773
0.8717 4.1355
BenchmarkSmallDocInsertOne total_bytes_allocated -11.5210 32207288.0000 Avg: 36401069.4253
Med: 36383192.0000
Stdev: 717566.5233
0.9033 -5.8444
BenchmarkSingleRunCommand total_bytes_allocated -11.2505 88253744.0000 Avg: 99441395.9506
Med: 99833608.0000
Stdev: 3986511.1524
0.8065 -2.8064
BenchmarkSmallDocInsertOne total_mem_allocs -11.1806 429845.0000 Avg: 483953.7241
Med: 483726.0000
Stdev: 9467.2344
0.9009 -5.7154
BenchmarkSingleRunCommand total_mem_allocs -10.8260 956701.0000 Avg: 1072847.5926
Med: 1078437.0000
Stdev: 42927.1725
0.7994 -2.7057
BenchmarkLargeDocInsertOne ns_per_op 10.3705 201326.0000 Avg: 182409.2320
Med: 181675.0000
Stdev: 4459.9620
0.8755 4.2415
BenchmarkMultiInsertLargeDocument total_time_seconds 10.2992 1.1965 Avg: 1.0847
Med: 1.0832
Stdev: 0.0488
0.7498 2.2884
BenchmarkMultiInsertSmallDocument total_mem_allocs -10.0824 2039568.0000 Avg: 2268264.4696
Med: 2239386.0000
Stdev: 111576.1591
0.7581 -2.0497
BenchmarkSingleFindOneByID total_time_seconds -9.5856 1.0390 Avg: 1.1491
Med: 1.1556
Stdev: 0.0487
0.7562 -2.2609
BenchmarkSmallDocInsertOne ns_per_op 9.5216 200565.0000 Avg: 183128.3149
Med: 182663.0000
Stdev: 4329.8532
0.8613 4.0271
BenchmarkSingleRunCommand total_bytes_allocated -9.0571 90434936.0000 Avg: 99441395.9506
Med: 99833608.0000
Stdev: 3986511.1524
0.7624 -2.2592
BenchmarkSingleRunCommand ops_per_second_med -8.7033 6981.8507 Avg: 7647.4332
Med: 7669.2410
Stdev: 253.6265
0.7881 -2.6243
BenchmarkSingleRunCommand total_mem_allocs -8.6484 980063.0000 Avg: 1072847.5926
Med: 1078437.0000
Stdev: 42927.1725
0.7524 -2.1614
BenchmarkSmallDocInsertOne ops_per_second_med -8.2432 5246.0943 Avg: 5717.3904
Med: 5732.5973
Stdev: 134.0694
0.8415 -3.5153
BenchmarkLargeDocInsertOne total_mem_allocs -7.9852 444465.0000 Avg: 483036.4815
Med: 482958.0000
Stdev: 11596.8363
0.8350 -3.3260
BenchmarkLargeDocInsertOne ops_per_second_med -7.7818 5272.0927 Avg: 5716.9793
Med: 5716.8665
Stdev: 137.6514
0.8310 -3.2320
BenchmarkLargeDocInsertOne total_bytes_allocated -7.6040 33457328.0000 Avg: 36210801.5912
Med: 36255224.0000
Stdev: 885821.6014
0.8216 -3.1084
BenchmarkSingleRunCommand total_time_seconds -7.2706 1.0361 Avg: 1.1173
Med: 1.1182
Stdev: 0.0350
0.7618 -2.3189
BenchmarkMultiInsertLargeDocument ns_per_op 6.7185 32336568.0000 Avg: 30300803.4000
Med: 30202516.0000
Stdev: 659354.1935
0.8426 3.0875
BenchmarkLargeDocInsertOne ops_per_second_max -6.2043 5879.3095 Avg: 6268.2048
Med: 6259.1148
Stdev: 109.4764
0.8436 -3.5523
BenchmarkSingleFindOneByID ops_per_second_max -6.1773 4344.5393 Avg: 4630.5855
Med: 4626.5025
Stdev: 96.4999
0.8134 -2.9642
BenchmarkSingleFindOneByID ns_per_op 6.1128 264371.0000 Avg: 249141.4199
Med: 248070.0000
Stdev: 6832.1042
0.7583 2.2291
BenchmarkBSONDeepDocumentEncoding ops_per_second_med -5.9076 61816.1587 Avg: 65697.3171
Med: 65967.4121
Stdev: 1697.1702
0.7785 -2.2868
BenchmarkSingleFindOneByID ops_per_second_med -5.9036 3878.6600 Avg: 4122.0076
Med: 4140.2553
Stdev: 103.8537
0.7711 -2.3432
BenchmarkSmallDocInsertOne ops_per_second_max -5.7150 5917.4749 Avg: 6276.1591
Med: 6262.9957
Stdev: 116.6109
0.8161 -3.0759
BenchmarkBSONDeepDocumentEncoding ns_per_op 5.6701 17214.0000 Avg: 16290.3210
Med: 16240.0000
Stdev: 423.7738
0.7700 2.1797
BenchmarkMultiInsertSmallDocument ns_per_op 5.6106 6956.0000 Avg: 6586.4571
Med: 6579.5000
Stdev: 150.6038
0.7791 2.4537
BenchmarkSingleRunCommand ops_per_second_max -5.3577 8125.1270 Avg: 8585.0941
Med: 8588.4833
Stdev: 145.3528
0.8275 -3.1645
BenchmarkMultiInsertLargeDocument ns_per_op 4.8110 31758580.0000 Avg: 30300803.4000
Med: 30202516.0000
Stdev: 659354.1935
0.7884 2.2109
BenchmarkMultiInsertSmallDocument allocated_bytes_per_op 4.5293 2898.0000 Avg: 2772.4296
Med: 2791.0000
Stdev: 60.2170
0.7491 2.0853
BenchmarkLargeDocInsertOne total_time_seconds -4.4389 1.1298 Avg: 1.1823
Med: 1.1821
Stdev: 0.0239
0.7480 -2.1926
BenchmarkSmallDocInsertOne ops_per_second_max -4.1294 6016.9920 Avg: 6276.1591
Med: 6262.9957
Stdev: 116.6109
0.7455 -2.2225
BenchmarkBSONFullDocumentDecoding total_mem_allocs -3.1897 8527570.0000 Avg: 8808539.5000
Med: 8844004.5000
Stdev: 133637.8078
0.7653 -2.1025
BenchmarkBSONFlatDocumentDecoding ns_per_op 3.1570 59752.0000 Avg: 57923.3750
Med: 57507.5000
Stdev: 766.0592
0.7802 2.3871
BenchmarkBSONDeepDocumentDecoding total_mem_allocs 2.4066 11891875.0000 Avg: 11612411.0000
Med: 11603811.0000
Stdev: 138400.8352
0.7256 2.0192
BenchmarkBSONDeepDocumentDecoding total_bytes_allocated 2.3985 258413552.0000 Avg: 252360658.5000
Med: 252175336.0000
Stdev: 2999948.8736
0.7254 2.0177
BenchmarkBSONDeepDocumentEncoding total_time_seconds 1.5835 1.2130 Avg: 1.1941
Med: 1.1947
Stdev: 0.0063
0.8211 3.0214
BenchmarkMultiFindMany allocated_bytes_per_op 0.4214 1634.0000 Avg: 1627.1429
Med: 1627.0000
Stdev: 1.2150
0.9107 5.6438
BenchmarkMultiFindMany allocated_bytes_per_op 0.2985 1632.0000 Avg: 1627.1429
Med: 1627.0000
Stdev: 1.2150
0.8739 3.9977
BenchmarkLargeDocInsertOne allocated_bytes_per_op -0.2962 5601.0000 Avg: 5617.6389
Med: 5619.0000
Stdev: 5.4214
0.8506 -3.0691
BenchmarkMultiFindMany allocated_bytes_per_op 0.2371 1631.0000 Avg: 1627.1429
Med: 1627.0000
Stdev: 1.2150
0.8413 3.1746
BenchmarkLargeDocInsertOne allocated_bytes_per_op -0.2250 5605.0000 Avg: 5617.6389
Med: 5619.0000
Stdev: 5.4214
0.8089 -2.3313
BenchmarkMultiFindMany allocated_bytes_per_op 0.1756 1630.0000 Avg: 1627.1429
Med: 1627.0000
Stdev: 1.2150
0.7857 2.3516
BenchmarkBSONFullDocumentEncoding allocated_bytes_per_op 0.1258 5209.0000 Avg: 5202.4568
Med: 5202.0000
Stdev: 2.0919
0.8254 3.1278
BenchmarkBSONDeepDocumentDecoding allocated_bytes_per_op 0.0079 15105.0000 Avg: 15103.8125
Med: 15104.0000
Stdev: 0.5439
0.7928 2.1833
BenchmarkBSONFlatDocumentDecoding allocated_bytes_per_op 0.0076 18047.0000 Avg: 18045.6250
Med: 18046.0000
Stdev: 0.6191
0.7784 2.2208
BenchmarkBSONFullDocumentDecoding allocated_bytes_per_op 0.0057 25325.0000 Avg: 25323.5625
Med: 25323.5000
Stdev: 0.6292
0.7853 2.2848

For a comprehensive view of all microbenchmark results for this PR's commit, please check out the Evergreen perf task for this patch.

Copy link
Contributor

API Change Report

No changes found!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant