-
Notifications
You must be signed in to change notification settings - Fork 4k
exempt hot path from iterator tracking (test run) #154791
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
exempt hot path from iterator tracking (test run) #154791
Conversation
Changes: * [`4cf08505`](cockroachdb/pebble@4cf08505) exempt WIP * [`45d293d8`](cockroachdb/pebble@45d293d8) db: make iterator tracking configurable * [`0d8ff1c3`](cockroachdb/pebble@0d8ff1c3) db: track and report long-standing iterators * [`0d82adc5`](cockroachdb/pebble@0d82adc5) inflight: add data structure to detect long-running operations * [`14834f0a`](cockroachdb/pebble@14834f0a) github: run tests against custom cockroach Go * [`0ac45a74`](cockroachdb/pebble@0ac45a74) metrics: fix TestMetrics flake * [`98c989b1`](cockroachdb/pebble@98c989b1) metamorphic: fix bug in suffix generation when prefix == startPrefix * [`d37d2f4b`](cockroachdb/pebble@d37d2f4b) pebble: materialize virtual tables only if backing contains >= 30% garbage Release note: none. Epic: none.
It looks like your PR touches production code but doesn't add or edit any test code. Did you consider adding tests to your PR? 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf. |
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/cf800bd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/cf800bd8b0f5c156b5cd3989055a21198965b6d5/bin/pkg_sql_tests benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=61a9d7d --new=cf800bd ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/cf800bd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/cf800bd8b0f5c156b5cd3989055a21198965b6d5/bin/pkg_sql_tests benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=61a9d7d --new=cf800bd ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/cf800bd/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/cf800bd8b0f5c156b5cd3989055a21198965b6d5/bin/pkg_sql_tests benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/cf800bd/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=61a9d7d --new=cf800bd ./pkg/sql/tests Artifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/cf800bd8b0f5c156b5cd3989055a21198965b6d5/18232779897-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/61a9d7d77b22abaa9b4965b78d0d512f72237ace/18232779897-1/\* old/ built with commit: cf800bd8b0f5c156b5cd3989055a21198965b6d5 |
cf800bd
to
2095b18
Compare
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/2095b18/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/2095b1898285a9679d04ea401093a6cfee26a09f/bin/pkg_sql_tests benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=61a9d7d --new=2095b18 ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/2095b18/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/2095b1898285a9679d04ea401093a6cfee26a09f/bin/pkg_sql_tests benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=61a9d7d --new=2095b18 ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/2095b18/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/2095b1898285a9679d04ea401093a6cfee26a09f/bin/pkg_sql_tests benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/2095b18/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=61a9d7d --new=2095b18 ./pkg/sql/tests Artifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/2095b1898285a9679d04ea401093a6cfee26a09f/18235613262-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/61a9d7d77b22abaa9b4965b78d0d512f72237ace/18235613262-1/\* old/ built with commit: 2095b1898285a9679d04ea401093a6cfee26a09f |
2095b18
to
ab99b67
Compare
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/ab99b67/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ab99b6781e5422ab44a206258ea57aadfb8bfd8e/bin/pkg_sql_tests benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=61a9d7d --new=ab99b67 ./pkg/sql/tests ⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/ab99b67/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ab99b6781e5422ab44a206258ea57aadfb8bfd8e/bin/pkg_sql_tests benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=61a9d7d --new=ab99b67 ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/ab99b67/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/ab99b6781e5422ab44a206258ea57aadfb8bfd8e/bin/pkg_sql_tests benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/ab99b67/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=61a9d7d --new=ab99b67 ./pkg/sql/tests Artifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/ab99b6781e5422ab44a206258ea57aadfb8bfd8e/18260975628-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/61a9d7d77b22abaa9b4965b78d0d512f72237ace/18260975628-1/\* old/ built with commit: ab99b6781e5422ab44a206258ea57aadfb8bfd8e |
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/25fcf08/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/25fcf088f43b3ad9936de5a96b62b18b303781ad/bin/pkg_sql_tests benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=61a9d7d --new=25fcf08 ./pkg/sql/tests ⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/25fcf08/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/25fcf088f43b3ad9936de5a96b62b18b303781ad/bin/pkg_sql_tests benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=61a9d7d --new=25fcf08 ./pkg/sql/tests 🔴 Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/25fcf08/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/25fcf088f43b3ad9936de5a96b62b18b303781ad/bin/pkg_sql_tests benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/25fcf08/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=61a9d7d --new=25fcf08 ./pkg/sql/tests Artifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/25fcf088f43b3ad9936de5a96b62b18b303781ad/18267500571-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/61a9d7d77b22abaa9b4965b78d0d512f72237ace/18267500571-1/\* old/ built with commit: 25fcf088f43b3ad9936de5a96b62b18b303781ad |
24a0612
to
83451d9
Compare
83451d9
to
c76846d
Compare
⚪ Sysbench [SQL, 3node, oltp_read_write]
Reproducebenchdiff binaries: mkdir -p benchdiff/c76846d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/c76846d4518d19f6683ad8f4325df962f6faa301/bin/pkg_sql_tests benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/SQL/3node/oltp_read_write$ --old=61a9d7d --new=c76846d ./pkg/sql/tests ⚪ Sysbench [KV, 3node, oltp_read_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/c76846d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/c76846d4518d19f6683ad8f4325df962f6faa301/bin/pkg_sql_tests benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_read_only$ --old=61a9d7d --new=c76846d ./pkg/sql/tests ⚪ Sysbench [KV, 3node, oltp_write_only]
Reproducebenchdiff binaries: mkdir -p benchdiff/c76846d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/c76846d4518d19f6683ad8f4325df962f6faa301/bin/pkg_sql_tests benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/c76846d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
mkdir -p benchdiff/61a9d7d/bin/1058449141
gcloud storage cp gs://cockroach-microbench-ci/builds/61a9d7d77b22abaa9b4965b78d0d512f72237ace/bin/pkg_sql_tests benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests
chmod +x benchdiff/61a9d7d/bin/1058449141/cockroachdb_cockroach_pkg_sql_tests benchdiff command: benchdiff --run=^BenchmarkSysbench/KV/3node/oltp_write_only$ --old=61a9d7d --new=c76846d ./pkg/sql/tests Artifactsdownload: mkdir -p new
gcloud storage cp gs://cockroach-microbench-ci/artifacts/c76846d4518d19f6683ad8f4325df962f6faa301/18289068167-1/\* new/
mkdir -p old
gcloud storage cp gs://cockroach-microbench-ci/artifacts/61a9d7d77b22abaa9b4965b78d0d512f72237ace/18289068167-1/\* old/ built with commit: c76846d4518d19f6683ad8f4325df962f6faa301 |
go.mod: bump Pebble to 4cf08505504a
Changes:
4cf08505
exempt WIP45d293d8
db: make iterator tracking configurable0d8ff1c3
db: track and report long-standing iterators0d82adc5
inflight: add data structure to detect long-running operations14834f0a
github: run tests against custom cockroach Go0ac45a74
metrics: fix TestMetrics flake98c989b1
metamorphic: fix bug in suffix generation when prefix == startPrefixd37d2f4b
pebble: materialize virtual tables only if backing contains >= 30% garbageRelease note: none.
Epic: none.
exempt hot path from iterator tracking