Loadtest BadgerGC #763

stealthybox · 2025-05-23T07:27:04Z

related #757
issue #748

GH Action failing with SIGBUS
Try running this yourself:

go test -run '^TestBadgerGCLoad$' github.com/fluxcd/image-reflector-controller/internal/database -v -count 1

This test modifies badger to run with less memory and frequent flushes to record-limited vlog files.
The loop starts with around 480,000 image repos and each subsequent loop changes a smaller number of those repos, thus triggering compaction -> discard stats -> GC.

This test on my 14 core apple silicon device causes the GC to also hit its edge-case of 1000 max vlog discards.
If you reduce the GC stop deadline, you can also trigger the error case where Badger rejects the GC request and stops the GC run early.

Example log:

=== RUN   TestBadgerGCLoad
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:03.661593" "level"=0 "msg"="INFO: All 0 tables opened in 0s\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:03.670145" "level"=0 "msg"="INFO: Discard stats nextEmptySlot: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:03.670244" "level"=0 "msg"="INFO: Set nextTxnTs to 0"
    badger_gc.go:61: loaded-badger-gc: "ts"="2025-05-23 17:41:03.670414" "level"=0 "msg"="Starting Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:05.409496" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7329837 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:05.442940" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 106307 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:05.455821" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: alpine 5: 120000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:41:23.671816" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:23.671855" "level"=0 "msg"="DEBUG: No file with discard stats"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-05-23 17:41:23.671864" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=0
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:29.328635" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7209369 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:29.362708" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 113680 keys. Skipped 0 keys. Iteration took: 13ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:29.373951" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 99789 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:29.385336" "level"=0 "msg"="DEBUG: [Compactor: 0] Compaction for level: 0 DONE"
    badger_gc_test.go:92: node 5: 120000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:39.098729" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7248920 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:39.144216" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110713 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:39.155614" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 92562 keys. Skipped 0 keys. Iteration took: 10ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:39.171966" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: postgres 5: 120000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:41:43.672032" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:43.672072" "level"=0 "msg"="DEBUG: No file with discard stats"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-05-23 17:41:43.672083" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=0
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:47.110393" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7251023 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:47.143782" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111230 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:47.156281" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111101 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:47.165834" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 84615 keys. Skipped 0 keys. Iteration took: 10ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:47.180054" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: debian 5: 120000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:53.386373" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7237583 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:53.448068" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 113460 keys. Skipped 44718 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:53.460660" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111425 keys. Skipped 651 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:53.467091" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 59403 keys. Skipped 0 keys. Iteration took: 6ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:41:53.482403" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: alpine 4: 105000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:42:03.672703" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:03.786398" "level"=0 "msg"="DEBUG: Discard: 560520 less than threshold: 1212225 for file: 000046.vlog"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-05-23 17:42:03.786427" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=45
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:06.998557" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7222238 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.046858" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111023 keys. Skipped 22180 keys. Iteration took: 15ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.047006" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 79 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.047869" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 113428 keys. Skipped 53714 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.063319" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111305 keys. Skipped 5918 keys. Iteration took: 15ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.071802" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 59554 keys. Skipped 24284 keys. Iteration took: 8ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:07.085121" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: node 4: 105000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:22.416508" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7230268 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:22.457330" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 84616 keys. Skipped 31309 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:22.461079" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 110910 keys. Skipped 36611 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:22.469977" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 59745 keys. Skipped 37310 keys. Iteration took: 9ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:22.487733" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:42:23.786599" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:92: postgres 4: 105000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.420656" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7250269 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.458799" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 84617 keys. Skipped 53307 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.463168" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 111425 keys. Skipped 43656 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.475000" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 110954 keys. Skipped 1513 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.483112" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 59580 keys. Skipped 5001 keys. Iteration took: 8ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:29.498463" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:92: debian 4: 105000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.737885" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7235444 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.797958" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 113220 keys. Skipped 44425 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.816199" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111491 keys. Skipped 46745 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.828802" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110967 keys. Skipped 13764 keys. Iteration took: 13ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.828859" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 129 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:35.844804" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: alpine 3: 90000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.780580" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7174259 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.811542" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 59710 keys. Skipped 2430 keys. Iteration took: 11ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.822223" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 113220 keys. Skipped 44899 keys. Iteration took: 20ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.827226" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.833354" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.834223" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 111512 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.839047" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.841356" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.843621" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.845974" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.847966" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.852141" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 110945 keys. Skipped 58555 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.853025" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.869167" "level"=0 "msg"="DEBUG: [Compactor: 0] Compaction for level: 0 DONE"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.875926" "level"=0 "msg"="DEBUG: 5 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.875946" "level"=0 "msg"="INFO: Processed 5 entries in 1 loops"
    badger_gc_test.go:131: "ts"="2025-05-23 17:42:52.875966" "level"=0 "msg"="INFO: Total entries: 133. Moved: 77"
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-05-23 17:42:55.645123" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc_test.go:92: node 3: 90000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:02.890757" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7160597 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:02.946451" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111194 keys. Skipped 17344 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:02.964938" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111905 keys. Skipped 79576 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:02.968705" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 32173 keys. Skipped 5717 keys. Iteration took: 4ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:02.984902" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: postgres 3: 90000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.777087" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7147849 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.804854" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 32174 keys. Skipped 16457 keys. Iteration took: 5ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.818262" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 110918 keys. Skipped 84136 keys. Iteration took: 19ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.831677" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 111183 keys. Skipped 2701 keys. Iteration took: 13ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.844715" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 111826 keys. Skipped 0 keys. Iteration took: 13ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.844837" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 683 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:11.863020" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:92: debian 3: 90000 repos
    badger_gc_test.go:92: alpine 2: 75000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:43:15.646269" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.075636" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7134433 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.110313" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 111827 keys. Skipped 2467 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.116351" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 113447 keys. Skipped 74347 keys. Iteration took: 21ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.129167" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 110890 keys. Skipped 654 keys. Iteration took: 13ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.144216" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 110593 keys. Skipped 26982 keys. Iteration took: 15ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.144316" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 390 keys. Skipped 38 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.144691" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.147047" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.154028" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.160572" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.184115" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.184127" "level"=0 "msg"="INFO: Processed 9 entries in 1 loops"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:22.184155" "level"=0 "msg"="INFO: Total entries: 133. Moved: 36"
    badger_gc_test.go:92: node 2: 75000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.863388" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7147162 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.887587" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 32858 keys. Skipped 3283 keys. Iteration took: 5ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.898690" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110939 keys. Skipped 48678 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.916758" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111855 keys. Skipped 51603 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.916813" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 15 keys. Skipped 1 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.935689" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.964173" "level"=0 "msg"="INFO: Processed 2 entries in 1 loops"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:35.964206" "level"=0 "msg"="INFO: Total entries: 139. Moved: 2"
    badger_gc_test.go:92: postgres 2: 75000 repos
    badger_gc_test.go:92: debian 2: 75000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.336826" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7149112 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.397212" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111856 keys. Skipped 15560 keys. Iteration took: 15ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.398144" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 113206 keys. Skipped 8098 keys. Iteration took: 15ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.402420" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 32873 keys. Skipped 4590 keys. Iteration took: 5ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.418139" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111117 keys. Skipped 73501 keys. Iteration took: 19ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.429952" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110928 keys. Skipped 1569 keys. Iteration took: 12ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.429993" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 24 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:44.450405" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: alpine 1: 60000 repos
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-05-23 17:43:47.917918" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.484345" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7125967 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.515258" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 111840 keys. Skipped 2473 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.515337" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 41 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.518697" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 113206 keys. Skipped 51225 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.532318" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 111107 keys. Skipped 611 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.549322" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 110593 keys. Skipped 50694 keys. Iteration took: 17ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.549405" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 344 keys. Skipped 34 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:43:59.567957" "level"=0 "msg"="DEBUG: [Compactor: 0] Compaction for level: 0 DONE"
    badger_gc_test.go:92: node 1: 60000 repos
    badger_gc_test.go:92: postgres 1: 60000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.905678" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7156533 size of flushChan: 0\n"
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-05-23 17:44:07.918111" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.949776" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111182 keys. Skipped 34163 keys. Iteration took: 17ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.950684" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111769 keys. Skipped 56705 keys. Iteration took: 18ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.955872" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 32986 keys. Skipped 3296 keys. Iteration took: 5ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.964218" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110607 keys. Skipped 8360 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.964295" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 254 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:07.978682" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:92: debian 1: 60000 repos
    badger_gc_test.go:92: alpine 0: 45000 repos
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.006127" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7134154 size of flushChan: 0\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.046425" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111780 keys. Skipped 2499 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.046523" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 244 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.049926" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 113338 keys. Skipped 44338 keys. Iteration took: 17ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.065483" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 111177 keys. Skipped 24941 keys. Iteration took: 16ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.072033" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.074091" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.076695" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.078682" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.079715" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 110479 keys. Skipped 32935 keys. Iteration took: 14ms"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.085144" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.093865" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.097722" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.100700" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.117832" "level"=0 "msg"="DEBUG: 1 entries written"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.117853" "level"=0 "msg"="INFO: Processed 1 entries in 1 loops"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:22.117865" "level"=0 "msg"="INFO: Total entries: 133. Moved: 64"
    badger_gc_test.go:92: node 0: 45000 repos
    badger_gc_test.go:92: postgres 0: 45000 repos
    badger_gc_test.go:92: debian 0: 45000 repos
    badger_gc_test.go:98: waiting for GC stop
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-05-23 17:44:37.234419" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc.go:70: loaded-badger-gc: "ts"="2025-05-23 17:44:37.234450" "level"=0 "msg"="Stopped Badger GC"
    badger_gc_test.go:103: GC Stopped
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.234853" "level"=0 "msg"="DEBUG: Closing database"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.235042" "level"=0 "msg"="INFO: Lifetime L0 stalled for: 0s\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.235060" "level"=0 "msg"="DEBUG: Flushing memtable"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.235071" "level"=0 "msg"="DEBUG: pushed to flush chan\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.248600" "level"=0 "msg"="DEBUG: Stopping garbage collection of values."
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.425674" "level"=0 "msg"="INFO: \nLevel 0 [ ]: NumTables: 01. Size: 1.8 MiB of 0 B. Score: 1.00->1.18 StaleData: 0 B Target FileSize: 8.0 MiB\nLevel 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 4 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 5 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 6 [B]: NumTables: 06. Size: 8.5 MiB of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel Done\n"
    badger_gc_test.go:131: "ts"="2025-05-23 17:44:37.425917" "level"=0 "msg"="DEBUG: Waiting for closer"
--- PASS: TestBadgerGCLoad (214.86s)
PASS
ok  	github.com/fluxcd/image-reflector-controller/internal/database	215.172s

Implement BadgerGC with controller-runtime

stealthybox · 2025-05-24T06:42:30Z

A release candidate for this garbage-collection logic is cut:

ghcr.io/fluxcd/image-reflector-controller:rc-c4913021
docker.io/fluxcd/image-reflector-controller:rc-c4913021

Updated CRD's:
kustomize build https://github.com/fluxcd/image-reflector-controller//config/crd/

Signed-off-by: Matheus Pimenta <[email protected]>

Update dependencies

Signed-off-by: Matheus Pimenta <[email protected]>

[RFC-0010] Link workload identity docs to complete guide

Bumps the ci group with 18 updates: | Package | From | To | | --- | --- | --- | | [korthout/backport-action](https://github.com/korthout/backport-action) | `3.1.0` | `3.2.0` | | [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) | `3.2.0` | `3.6.0` | | [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) | `3.8.0` | `3.10.0` | | [actions/cache](https://github.com/actions/cache) | `4.2.0` | `4.2.3` | | [actions/setup-go](https://github.com/actions/setup-go) | `5.2.0` | `5.5.0` | | [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) | `4.0.2` | `4.2.1` | | [Azure/login](https://github.com/azure/login) | `2.2.0` | `2.3.0` | | [google-github-actions/auth](https://github.com/google-github-actions/auth) | `2.1.7` | `2.1.10` | | [google-github-actions/setup-gcloud](https://github.com/google-github-actions/setup-gcloud) | `2.1.2` | `2.1.4` | | [docker/login-action](https://github.com/docker/login-action) | `3.3.0` | `3.4.0` | | [docker/build-push-action](https://github.com/docker/build-push-action) | `6.10.0` | `6.17.0` | | [docker/metadata-action](https://github.com/docker/metadata-action) | `5.6.1` | `5.7.0` | | [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) | `3.7.0` | `3.8.2` | | [anchore/sbom-action](https://github.com/anchore/sbom-action) | `0.17.9` | `0.20.0` | | [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action) | `6.1.0` | `6.3.0` | | [slsa-framework/slsa-github-generator](https://github.com/slsa-framework/slsa-github-generator) | `2.0.0` | `2.1.0` | | [fossa-contrib/fossa-action](https://github.com/fossa-contrib/fossa-action) | `3.0.0` | `3.0.1` | | [github/codeql-action](https://github.com/github/codeql-action) | `3.28.0` | `3.28.18` | Updates `korthout/backport-action` from 3.1.0 to 3.2.0 - [Release notes](https://github.com/korthout/backport-action/releases) - [Commits](korthout/backport-action@be567af...436145e) Updates `docker/setup-qemu-action` from 3.2.0 to 3.6.0 - [Release notes](https://github.com/docker/setup-qemu-action/releases) - [Commits](docker/setup-qemu-action@49b3bc8...2910929) Updates `docker/setup-buildx-action` from 3.8.0 to 3.10.0 - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](docker/setup-buildx-action@6524bf6...b5ca514) Updates `actions/cache` from 4.2.0 to 4.2.3 - [Release notes](https://github.com/actions/cache/releases) - [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md) - [Commits](actions/cache@1bd1e32...5a3ec84) Updates `actions/setup-go` from 5.2.0 to 5.5.0 - [Release notes](https://github.com/actions/setup-go/releases) - [Commits](actions/setup-go@3041bf5...d35c59a) Updates `aws-actions/configure-aws-credentials` from 4.0.2 to 4.2.1 - [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases) - [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md) - [Commits](aws-actions/configure-aws-credentials@e3dd6a4...b475783) Updates `Azure/login` from 2.2.0 to 2.3.0 - [Release notes](https://github.com/azure/login/releases) - [Commits](Azure/login@a65d910...a457da9) Updates `google-github-actions/auth` from 2.1.7 to 2.1.10 - [Release notes](https://github.com/google-github-actions/auth/releases) - [Changelog](https://github.com/google-github-actions/auth/blob/main/CHANGELOG.md) - [Commits](google-github-actions/auth@6fc4af4...ba79af0) Updates `google-github-actions/setup-gcloud` from 2.1.2 to 2.1.4 - [Release notes](https://github.com/google-github-actions/setup-gcloud/releases) - [Changelog](https://github.com/google-github-actions/setup-gcloud/blob/main/CHANGELOG.md) - [Commits](google-github-actions/setup-gcloud@6189d56...77e7a55) Updates `docker/login-action` from 3.3.0 to 3.4.0 - [Release notes](https://github.com/docker/login-action/releases) - [Commits](docker/login-action@9780b0c...74a5d14) Updates `docker/build-push-action` from 6.10.0 to 6.17.0 - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](docker/build-push-action@48aba3b...1dc7386) Updates `docker/metadata-action` from 5.6.1 to 5.7.0 - [Release notes](https://github.com/docker/metadata-action/releases) - [Commits](docker/metadata-action@369eb59...902fa8e) Updates `sigstore/cosign-installer` from 3.7.0 to 3.8.2 - [Release notes](https://github.com/sigstore/cosign-installer/releases) - [Commits](sigstore/cosign-installer@dc72c7d...3454372) Updates `anchore/sbom-action` from 0.17.9 to 0.20.0 - [Release notes](https://github.com/anchore/sbom-action/releases) - [Changelog](https://github.com/anchore/sbom-action/blob/main/RELEASE.md) - [Commits](anchore/sbom-action@df80a98...e11c554) Updates `goreleaser/goreleaser-action` from 6.1.0 to 6.3.0 - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@9ed2f89...9c156ee) Updates `slsa-framework/slsa-github-generator` from 2.0.0 to 2.1.0 - [Release notes](https://github.com/slsa-framework/slsa-github-generator/releases) - [Changelog](https://github.com/slsa-framework/slsa-github-generator/blob/main/CHANGELOG.md) - [Commits](slsa-framework/slsa-github-generator@v2.0.0...v2.1.0) Updates `fossa-contrib/fossa-action` from 3.0.0 to 3.0.1 - [Release notes](https://github.com/fossa-contrib/fossa-action/releases) - [Changelog](https://github.com/fossa-contrib/fossa-action/blob/master/CHANGELOG.md) - [Commits](fossa-contrib/fossa-action@cdc5065...3d2ef18) Updates `github/codeql-action` from 3.28.0 to 3.28.18 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@48ab28a...ff0a06e) --- updated-dependencies: - dependency-name: korthout/backport-action dependency-version: 3.2.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/setup-qemu-action dependency-version: 3.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/setup-buildx-action dependency-version: 3.10.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: actions/cache dependency-version: 4.2.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: actions/setup-go dependency-version: 5.5.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: aws-actions/configure-aws-credentials dependency-version: 4.2.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: Azure/login dependency-version: 2.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: google-github-actions/auth dependency-version: 2.1.10 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: google-github-actions/setup-gcloud dependency-version: 2.1.4 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: docker/login-action dependency-version: 3.4.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/build-push-action dependency-version: 6.17.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/metadata-action dependency-version: 5.7.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: sigstore/cosign-installer dependency-version: 3.8.2 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: anchore/sbom-action dependency-version: 0.20.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: goreleaser/goreleaser-action dependency-version: 6.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: slsa-framework/slsa-github-generator dependency-version: 2.1.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: fossa-contrib/fossa-action dependency-version: 3.0.1 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: github/codeql-action dependency-version: 3.28.18 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci ... Signed-off-by: dependabot[bot] <[email protected]>

…a48eed Bump the ci group with 18 updates

Signed-off-by: Matheus Pimenta <[email protected]>

Release v0.35.0

Signed-off-by: Matheus Pimenta <[email protected]>

Fix changelog link

Signed-off-by: Stefan Prodan <[email protected]>

Update dependabot config

…not ready Signed-off-by: Matheus Pimenta <[email protected]>

Fix ImagePolicy reconciler getting triggered when ImageRepository is not ready

Signed-off-by: Matheus Pimenta <[email protected]>

Release v0.35.1

…tory docs: improve mTLS documentation structure and visibility

Updates pkg/runtime to v0.78.0 and configures TLSConfigFromSecretRef to use WithSystemCertPool() option. This maintains backward compatibility with the existing extend approach (system CAs + user CA) rather than the default replace approach (user CA only). This ensures image-reflector-controller continues to work with both system and user-provided CA certificates, fixing the regression where public registries with valid certificates would fail when users provide custom CA certificates for other purposes. Signed-off-by: cappyzawa <[email protected]>

…ca-compatibility Add WithSystemCertPool for CA compatibility

Removes the deprecated .status.latestImage and .status.observedPreviousImage fields from the v1beta2 ImagePolicy API in preparation for GA. These fields were deprecated in favor of the structured .status.latestRef and .status.observedPreviousRef fields which provide better separation of image name, tag, and digest information. Signed-off-by: cappyzawa <[email protected]>

Remove deprecated status field sections and update kubectl output example to match new printer columns format that displays Image, Tag, Ready, Status, and Age columns instead of the deprecated LatestImage column. Signed-off-by: cappyzawa <[email protected]>

…-latestimage Remove deprecated ImagePolicy status fields

Signed-off-by: Stefan Prodan <[email protected]>

Remove deprecated APIs in group `image.toolkit.fluxcd.io/v1beta1`

Updates pkg/runtime dependency to v0.80.0 which removes the need for the insecure parameter in TLSConfigFromSecretRef. This change removes the forced ServerName pinning behavior that was causing TLS verification issues, allowing for more flexible certificate validation. The TLS config creation now relies on the standard Go TLS verification process without forcing specific ServerName values, improving compatibility with various certificate configurations. Signed-off-by: cappyzawa <[email protected]>

…nning Remove TLS ServerName pinning in TLS config creation

Add --default-service-account flag for multi-tenant workload identity lockdown support. This flag sets the default service account name to be used when .spec.serviceAccountName is not specified in resources. Signed-off-by: cappyzawa <[email protected]>

[RFC-0010] Add default-service-account for lockdown

…olicy #799 Signed-off-by: Daniel Guns <[email protected]>

Introduce `.spec.suspend` and `.status.lastHandledReconcileAt` for ImagePolicy

Bumps the ci group with 14 updates in the / directory: | Package | From | To | | --- | --- | --- | | [actions/checkout](https://github.com/actions/checkout) | `4.2.2` | `5.0.0` | | [korthout/backport-action](https://github.com/korthout/backport-action) | `3.2.0` | `3.3.0` | | [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) | `3.10.0` | `3.11.1` | | [actions/cache](https://github.com/actions/cache) | `4.2.3` | `4.2.4` | | [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) | `4.2.1` | `4.3.1` | | [google-github-actions/auth](https://github.com/google-github-actions/auth) | `2.1.10` | `3.0.0` | | [google-github-actions/setup-gcloud](https://github.com/google-github-actions/setup-gcloud) | `2.1.4` | `3.0.1` | | [docker/login-action](https://github.com/docker/login-action) | `3.4.0` | `3.5.0` | | [docker/build-push-action](https://github.com/docker/build-push-action) | `6.17.0` | `6.18.0` | | [docker/metadata-action](https://github.com/docker/metadata-action) | `5.7.0` | `5.8.0` | | [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) | `3.8.2` | `3.9.2` | | [anchore/sbom-action](https://github.com/anchore/sbom-action) | `0.20.0` | `0.20.5` | | [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action) | `6.3.0` | `6.4.0` | | [github/codeql-action](https://github.com/github/codeql-action) | `3.28.18` | `3.29.11` | Updates `actions/checkout` from 4.2.2 to 5.0.0 - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@11bd719...08c6903) Updates `korthout/backport-action` from 3.2.0 to 3.3.0 - [Release notes](https://github.com/korthout/backport-action/releases) - [Commits](korthout/backport-action@436145e...ca4972a) Updates `docker/setup-buildx-action` from 3.10.0 to 3.11.1 - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](docker/setup-buildx-action@b5ca514...e468171) Updates `actions/cache` from 4.2.3 to 4.2.4 - [Release notes](https://github.com/actions/cache/releases) - [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md) - [Commits](actions/cache@5a3ec84...0400d5f) Updates `aws-actions/configure-aws-credentials` from 4.2.1 to 4.3.1 - [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases) - [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md) - [Commits](aws-actions/configure-aws-credentials@b475783...7474bc4) Updates `google-github-actions/auth` from 2.1.10 to 3.0.0 - [Release notes](https://github.com/google-github-actions/auth/releases) - [Changelog](https://github.com/google-github-actions/auth/blob/main/CHANGELOG.md) - [Commits](google-github-actions/auth@ba79af0...7c6bc77) Updates `google-github-actions/setup-gcloud` from 2.1.4 to 3.0.1 - [Release notes](https://github.com/google-github-actions/setup-gcloud/releases) - [Changelog](https://github.com/google-github-actions/setup-gcloud/blob/main/CHANGELOG.md) - [Commits](google-github-actions/setup-gcloud@77e7a55...aa5489c) Updates `docker/login-action` from 3.4.0 to 3.5.0 - [Release notes](https://github.com/docker/login-action/releases) - [Commits](docker/login-action@74a5d14...184bdaa) Updates `docker/build-push-action` from 6.17.0 to 6.18.0 - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](docker/build-push-action@1dc7386...2634353) Updates `docker/metadata-action` from 5.7.0 to 5.8.0 - [Release notes](https://github.com/docker/metadata-action/releases) - [Commits](docker/metadata-action@902fa8e...c1e5197) Updates `sigstore/cosign-installer` from 3.8.2 to 3.9.2 - [Release notes](https://github.com/sigstore/cosign-installer/releases) - [Commits](sigstore/cosign-installer@3454372...d58896d) Updates `anchore/sbom-action` from 0.20.0 to 0.20.5 - [Release notes](https://github.com/anchore/sbom-action/releases) - [Changelog](https://github.com/anchore/sbom-action/blob/main/RELEASE.md) - [Commits](anchore/sbom-action@e11c554...da167ea) Updates `goreleaser/goreleaser-action` from 6.3.0 to 6.4.0 - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@9c156ee...e435ccd) Updates `github/codeql-action` from 3.28.18 to 3.29.11 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@ff0a06e...3c3833e) --- updated-dependencies: - dependency-name: actions/checkout dependency-version: 5.0.0 dependency-type: direct:production update-type: version-update:semver-major dependency-group: ci - dependency-name: korthout/backport-action dependency-version: 3.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/setup-buildx-action dependency-version: 3.11.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: actions/cache dependency-version: 4.2.4 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: aws-actions/configure-aws-credentials dependency-version: 4.3.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: google-github-actions/auth dependency-version: 3.0.0 dependency-type: direct:production update-type: version-update:semver-major dependency-group: ci - dependency-name: google-github-actions/setup-gcloud dependency-version: 3.0.1 dependency-type: direct:production update-type: version-update:semver-major dependency-group: ci - dependency-name: docker/login-action dependency-version: 3.5.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/build-push-action dependency-version: 6.18.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: docker/metadata-action dependency-version: 5.8.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: sigstore/cosign-installer dependency-version: 3.9.2 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: anchore/sbom-action dependency-version: 0.20.5 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ci - dependency-name: goreleaser/goreleaser-action dependency-version: 6.4.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci - dependency-name: github/codeql-action dependency-version: 3.29.11 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ci ... Signed-off-by: dependabot[bot] <[email protected]>

…2293af Bump the ci group across 1 directory with 14 updates

Signed-off-by: Stefan Prodan <[email protected]>

Update to Kubernetes v1.34.0 and Go 1.25.0

Bumps the go-deps group with 1 update: [github.com/spf13/pflag](https://github.com/spf13/pflag). Updates `github.com/spf13/pflag` from 1.0.7 to 1.0.9 - [Release notes](https://github.com/spf13/pflag/releases) - [Commits](spf13/pflag@v1.0.7...v1.0.9) --- updated-dependencies: - dependency-name: github.com/spf13/pflag dependency-version: 1.0.9 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: go-deps ... Signed-off-by: dependabot[bot] <[email protected]>

…807e99f Bump github.com/spf13/pflag from 1.0.7 to 1.0.9 in the go-deps group

Signed-off-by: Adrian Fernandez De La Torre <[email protected]>

Update otel packages to v1.38.0

Signed-off-by: leigh capili <[email protected]>

stealthybox · 2025-09-10T06:15:42Z

Rebased on badger v4 + test passes locally

=== RUN   TestBadgerGCLoad
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:17.723669" "level"=0 "msg"="INFO: All 0 tables opened in 0s\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:17.733238" "level"=0 "msg"="INFO: Discard stats nextEmptySlot: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:17.733326" "level"=0 "msg"="INFO: Set nextTxnTs to 0"
    badger_gc.go:61: loaded-badger-gc: "ts"="2025-09-05 13:30:17.733636" "level"=0 "msg"="Starting Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:19.685479" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7332081 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:19.725668" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 106307 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:19.740837" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:93: alpine 5: 120000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:30:37.733749" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:37.733811" "level"=0 "msg"="DEBUG: No file with discard stats"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-09-05 13:30:37.733819" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=0
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:51.053776" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7211481 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:51.101245" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 114257 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:51.111745" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 99212 keys. Skipped 0 keys. Iteration took: 10ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:51.126827" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:30:57.734059" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:30:57.734111" "level"=0 "msg"="DEBUG: No file with discard stats"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-09-05 13:30:57.734120" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=0
    badger_gc_test.go:93: node 5: 120000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:03.119805" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7248816 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:03.149292" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 102036 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:03.160019" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 100662 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:03.176838" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: postgres 5: 120000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:13.015802" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7245391 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:13.048952" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 102968 keys. Skipped 0 keys. Iteration took: 10ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:13.060789" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 102747 keys. Skipped 0 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:13.072320" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 100654 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:13.086190" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:31:17.734335" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:17.734406" "level"=0 "msg"="DEBUG: No file with discard stats"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-09-05 13:31:17.734418" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=0
    badger_gc_test.go:93: debian 5: 120000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:21.000470" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7237487 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:21.054604" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 114184 keys. Skipped 44789 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:21.066233" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103550 keys. Skipped 580 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:21.071874" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 58869 keys. Skipped 0 keys. Iteration took: 6ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:21.084563" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: alpine 4: 105000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:31:37.734646" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.003660" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7220926 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.045547" "level"=0 "msg"="DEBUG: Discard: 577368 less than threshold: 1248661 for file: 000046.vlog"
    badger_gc.go:85: loaded-badger-gc: "ts"="2025-09-05 13:31:38.045579" "level"=1 "msg"="Ran Badger GC" "discarded_vlogs"=45
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.054104" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 102747 keys. Skipped 29864 keys. Iteration took: 15ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.055011" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 114282 keys. Skipped 54483 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.068113" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103452 keys. Skipped 5149 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.075852" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 58869 keys. Skipped 16600 keys. Iteration took: 8ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:38.093956" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: node 4: 105000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:57.694705" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7230784 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:57.727050" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 101729 keys. Skipped 22048 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:57.744184" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 106334 keys. Skipped 77765 keys. Iteration took: 17ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:57.750642" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 54207 keys. Skipped 5417 keys. Iteration took: 6ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:31:57.765366" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:31:58.045673" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:93: postgres 4: 105000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.797388" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7249913 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.849955" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 54207 keys. Skipped 48790 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.855393" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103693 keys. Skipped 42969 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.866584" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101723 keys. Skipped 2200 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.879684" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 106099 keys. Skipped 9518 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:06.896112" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: debian 4: 105000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.659981" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7234304 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.703983" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 113991 keys. Skipped 44502 keys. Iteration took: 15ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.719420" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103616 keys. Skipped 40275 keys. Iteration took: 15ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.732271" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101840 keys. Skipped 20157 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.732355" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 251 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:14.749283" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: alpine 3: 90000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.180855" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7173251 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.213425" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 106350 keys. Skipped 4054 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.219449" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 113925 keys. Skipped 44899 keys. Iteration took: 17ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.228376" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.230314" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 103713 keys. Skipped 0 keys. Iteration took: 11ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.230525" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.241845" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.247296" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 101743 keys. Skipped 56925 keys. Iteration took: 17ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.247338" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 66 keys. Skipped 6 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.247931" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.250316" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.252668" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.258510" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.265483" "level"=0 "msg"="DEBUG: [Compactor: 0] Compaction for level: 0 DONE"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.267110" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.283181" "level"=0 "msg"="DEBUG: 1 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.283197" "level"=0 "msg"="INFO: Processed 1 entries in 1 loops"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:35.283233" "level"=0 "msg"="INFO: Total entries: 128. Moved: 73"
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-09-05 13:32:35.744469" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc_test.go:93: node 3: 90000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.047266" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7160071 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.098055" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 54207 keys. Skipped 27753 keys. Iteration took: 9ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.101209" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101742 keys. Skipped 2452 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.117733" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 106295 keys. Skipped 72308 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.117802" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 122 keys. Skipped 122 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:48.139856" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: postgres 3: 90000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:32:55.744637" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.519881" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7149273 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.546398" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 54329 keys. Skipped 16455 keys. Iteration took: 7ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.556852" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103992 keys. Skipped 77915 keys. Iteration took: 18ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.573396" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101966 keys. Skipped 8924 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.586919" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 105792 keys. Skipped 0 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:32:59.604784" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: debian 3: 90000 repos
    badger_gc_test.go:93: alpine 2: 75000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.528276" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7134241 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.564713" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 105792 keys. Skipped 4010 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.568703" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 114289 keys. Skipped 74431 keys. Iteration took: 20ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.579070" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 104057 keys. Skipped 570 keys. Iteration took: 10ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.592430" "level"=0 "msg"="DEBUG: [2] LOG Compact. Added 101537 keys. Skipped 25477 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:11.611270" "level"=0 "msg"="DEBUG: [Compactor: 2] Compaction for level: 0 DONE"
    badger_gc_test.go:93: node 2: 75000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.230720" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7146697 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.264145" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 101788 keys. Skipped 37790 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.281593" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 106331 keys. Skipped 57347 keys. Iteration took: 17ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.289476" "level"=0 "msg"="DEBUG: [0] LOG Compact. Added 53539 keys. Skipped 8411 keys. Iteration took: 8ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.305151" "level"=0 "msg"="DEBUG: [Compactor: 0] Compaction for level: 0 DONE"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.337344" "level"=0 "msg"="DEBUG: 7 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.337359" "level"=0 "msg"="INFO: Processed 7 entries in 1 loops"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:29.337403" "level"=0 "msg"="INFO: Total entries: 134. Moved: 7"
    badger_gc_test.go:93: postgres 2: 75000 repos
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-09-05 13:33:33.910651" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc_test.go:93: debian 2: 75000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:39.996768" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7151146 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.051857" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 106434 keys. Skipped 0 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.054573" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 113841 keys. Skipped 8124 keys. Iteration took: 15ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.060271" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 53436 keys. Skipped 20129 keys. Iteration took: 8ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.072371" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103898 keys. Skipped 72836 keys. Iteration took: 18ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.083970" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101822 keys. Skipped 2232 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.084105" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 573 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:40.099441" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:93: alpine 1: 60000 repos
    badger_gc.go:80: loaded-badger-gc: "ts"="2025-09-05 13:33:53.911769" "level"=1 "msg"="Running Badger GC"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.743397" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7129460 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.778093" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 106391 keys. Skipped 4042 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.779074" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 616 keys. Skipped 0 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.783177" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 113939 keys. Skipped 51272 keys. Iteration took: 18ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.796864" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 103976 keys. Skipped 545 keys. Iteration took: 14ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.811283" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 101646 keys. Skipped 49178 keys. Iteration took: 14ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:33:58.828911" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:93: node 1: 60000 repos
    badger_gc_test.go:93: postgres 1: 60000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.559435" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7158711 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.597735" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 54052 keys. Skipped 14053 keys. Iteration took: 8ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.605483" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 103976 keys. Skipped 33536 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.611139" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.614141" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.617435" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.618060" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 101642 keys. Skipped 8987 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.620815" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.630819" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.634161" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 106198 keys. Skipped 45751 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.634246" "level"=0 "msg"="DEBUG: [3] LOG Compact. Added 197 keys. Skipped 197 keys. Iteration took: 0s"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.636010" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.644505" "level"=0 "msg"="DEBUG: 73 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.649414" "level"=0 "msg"="DEBUG: [Compactor: 3] Compaction for level: 0 DONE"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.661329" "level"=0 "msg"="DEBUG: 10 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.661338" "level"=0 "msg"="INFO: Processed 10 entries in 1 loops"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:08.661374" "level"=0 "msg"="INFO: Total entries: 976. Moved: 521"
    badger_gc_test.go:93: debian 1: 60000 repos
    badger_gc_test.go:93: alpine 0: 45000 repos
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.239907" "level"=0 "msg"="DEBUG: Flushing memtable, mt.size=7146052 size of flushChan: 0\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.279630" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 106198 keys. Skipped 4043 keys. Iteration took: 13ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.284396" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 114129 keys. Skipped 44416 keys. Iteration took: 18ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.287089" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 54249 keys. Skipped 521 keys. Iteration took: 7ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.300713" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 103950 keys. Skipped 24844 keys. Iteration took: 16ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.312886" "level"=0 "msg"="DEBUG: [1] LOG Compact. Added 101478 keys. Skipped 31093 keys. Iteration took: 12ms"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.318875" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.326329" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.332886" "level"=0 "msg"="DEBUG: [Compactor: 1] Compaction for level: 0 DONE"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.359182" "level"=0 "msg"="DEBUG: 9 entries written"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.359203" "level"=0 "msg"="INFO: Processed 9 entries in 1 loops"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:25.359242" "level"=0 "msg"="INFO: Total entries: 128. Moved: 27"
    badger_gc_test.go:93: node 0: 45000 repos
    badger_gc.go:93: loaded-badger-gc: "ts"="2025-09-05 13:34:29.506981" "msg"="Warning: Badger GC ran for maximum discards" "error"=null "discarded_vlogs"=1000
    badger_gc_test.go:93: postgres 0: 45000 repos
    badger_gc_test.go:93: debian 0: 45000 repos
    badger_gc_test.go:99: waiting for GC stop
    badger_gc.go:70: loaded-badger-gc: "ts"="2025-09-05 13:34:36.484356" "level"=0 "msg"="Stopped Badger GC"
    badger_gc_test.go:104: GC Stopped
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.484846" "level"=0 "msg"="DEBUG: Closing database"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.485065" "level"=0 "msg"="INFO: Lifetime L0 stalled for: 0s\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.485088" "level"=0 "msg"="DEBUG: Flushing memtable"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.485098" "level"=0 "msg"="DEBUG: pushed to flush chan\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.500632" "level"=0 "msg"="DEBUG: Stopping garbage collection of values."
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.699308" "level"=0 "msg"="INFO: \nLevel 0 [ ]: NumTables: 01. Size: 1.9 MiB of 0 B. Score: 1.00->1.12 StaleData: 0 B Target FileSize: 8.0 MiB\nLevel 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 4 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 5 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel 6 [B]: NumTables: 05. Size: 8.9 MiB of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 2.0 MiB\nLevel Done\n"
    badger_gc_test.go:132: "ts"="2025-09-05 13:34:36.699575" "level"=0 "msg"="DEBUG: Waiting for closer"
--- PASS: TestBadgerGCLoad (259.99s)
PASS
ok  	github.com/fluxcd/image-reflector-controller/internal/database	260.314s

stealthybox added the area/testing Testing related issues and pull requests label May 23, 2025

stealthybox changed the base branch from main to gc-channel May 23, 2025 07:36

stealthybox force-pushed the gc-loadtest branch 3 times, most recently from fb93d17 to 3ab825a Compare May 23, 2025 08:16

stealthybox force-pushed the gc-channel branch from d01d018 to cf123eb Compare May 23, 2025 08:17

stealthybox force-pushed the gc-loadtest branch from 3ab825a to b7c3963 Compare May 23, 2025 08:20

stealthybox mentioned this pull request May 23, 2025

Implement BadgerDB garbage collection #757

Merged

stealthybox force-pushed the gc-loadtest branch from b7c3963 to 0b522a0 Compare May 23, 2025 18:04

stealthybox force-pushed the gc-channel branch from cf123eb to 8ec426f Compare May 23, 2025 18:04

Merge pull request #757 from stealthybox/gc-channel

c491302

Implement BadgerGC with controller-runtime

stealthybox mentioned this pull request May 23, 2025

Image reflector controller uses a lot of ephemeral storage. #748

Open

stealthybox mentioned this pull request May 24, 2025

GC doesn't seem to run dgraph-io/badger#2003

Open

matheuscscp and others added 16 commits May 25, 2025 15:05

Update dependencies

8eea66d

Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #765 from fluxcd/upgrade-deps

6275ee0

Update dependencies

[RFC-0010] Link workload identity docs to complete guide

3e212d2

Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #766 from fluxcd/rfc-0010-docs

c5a592b

[RFC-0010] Link workload identity docs to complete guide

Merge pull request #767 from fluxcd/dependabot/github_actions/ci-a39a…

e9e2426

…a48eed Bump the ci group with 18 updates

Release v0.35.0

dc7b08c

Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #768 from fluxcd/release-v0.35.0

832b91d

Release v0.35.0

Fix changelog link

65588cf

Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #771 from fluxcd/fix-changelog-link

bb9a553

Fix changelog link

Update dependabot config

52a94e7

Signed-off-by: Stefan Prodan <[email protected]>

Merge pull request #772 from fluxcd/dependabot-up

b966bd7

Update dependabot config

Fix ImagePolicy reconciler getting triggered when ImageRepository is …

8dcbf4e

…not ready Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #774 from fluxcd/fix-773

6235745

Fix ImagePolicy reconciler getting triggered when ImageRepository is not ready

Release v0.35.1

ab998ee

Signed-off-by: Matheus Pimenta <[email protected]>

Merge pull request #775 from fluxcd/release-v0.35.1

9e8b90f

Release v0.35.1

matheuscscp and others added 27 commits July 29, 2025 17:52

Merge pull request #800 from cappyzawa/docs/add-mtls-auth-imagereposi…

f5e40c4

…tory docs: improve mTLS documentation structure and visibility

Merge pull request #801 from cappyzawa/feat/add-system-cert-pool-for-…

f8af344

…ca-compatibility Add WithSystemCertPool for CA compatibility

Merge pull request #803 from cappyzawa/feat/remove-imagepolicy-status…

1d48f27

…-latestimage Remove deprecated ImagePolicy status fields

Remove deprecated APIs in group image.toolkit.fluxcd.io/v1beta1

85f7a70

Signed-off-by: Stefan Prodan <[email protected]>

Merge pull request #805 from fluxcd/remove-v1beta1-api

535721d

Remove deprecated APIs in group `image.toolkit.fluxcd.io/v1beta1`

Merge pull request #806 from cappyzawa/remove-tlsconfig-servername-pi…

80b44ae

…nning Remove TLS ServerName pinning in TLS config creation

Merge pull request #807 from cappyzawa/feat/default-service-account-flag

1f35dcf

[RFC-0010] Add default-service-account for lockdown

Introduce .spec.suspend and .status.lastHandledReconcileAt for ImageP…

627074a

…olicy #799 Signed-off-by: Daniel Guns <[email protected]>

Merge pull request #799 from dgunzy/support-flux-reconcile-image-policy

a7fecba

Introduce `.spec.suspend` and `.status.lastHandledReconcileAt` for ImagePolicy

Merge pull request #810 from fluxcd/dependabot/github_actions/ci-ebb4…

fafd6d7

…2293af Bump the ci group across 1 directory with 14 updates

Update dependencies to Kubernetes v1.34.0

f2d8efe

Signed-off-by: Stefan Prodan <[email protected]>

Regenerate CRDs with controller-gen v0.19

ba6b662

Signed-off-by: Stefan Prodan <[email protected]>

Build with Go 1.25

f21c37a

Signed-off-by: Stefan Prodan <[email protected]>

Merge pull request #812 from fluxcd/k8s-1.34

fe23c39

Update to Kubernetes v1.34.0 and Go 1.25.0

Merge pull request #813 from fluxcd/dependabot/go_modules/go-deps-27a…

d15281c

…807e99f Bump github.com/spf13/pflag from 1.0.7 to 1.0.9 in the go-deps group

Update otel packages to v1.38.0

6eb125f

Signed-off-by: Adrian Fernandez De La Torre <[email protected]>

Merge pull request #815 from adri1197/update-otel

b5a31b9

Update otel packages to v1.38.0

Handle controller-runtime failing to add BadgerGC

07d1819

Signed-off-by: leigh capili <[email protected]>

Upgrade badger to v4.8.0

b162d0f

Signed-off-by: leigh capili <[email protected]>

Load Test BadgerGC

d044cbd

Signed-off-by: leigh capili <[email protected]>

stealthybox force-pushed the gc-loadtest branch from 0b522a0 to d044cbd Compare September 10, 2025 06:01

stealthybox mentioned this pull request Sep 10, 2025

Upgrade to Badger v4 #816

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Loadtest BadgerGC #763

Loadtest BadgerGC #763

Uh oh!

stealthybox commented May 23, 2025 •

edited

Loading

Uh oh!

stealthybox commented May 24, 2025

Uh oh!

stealthybox commented Sep 10, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Loadtest BadgerGC #763

Are you sure you want to change the base?

Loadtest BadgerGC #763

Uh oh!

Conversation

stealthybox commented May 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

stealthybox commented May 24, 2025

Uh oh!

stealthybox commented Sep 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

stealthybox commented May 23, 2025 •

edited

Loading

stealthybox commented Sep 10, 2025 •

edited

Loading