Skip to content

bump for benchmark testing #9569

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 14 commits into
base: main
Choose a base branch
from
Open

bump for benchmark testing #9569

wants to merge 14 commits into from

Conversation

angelamayxie
Copy link
Contributor

@angelamayxie
Copy link
Contributor Author

#benchmark

2 similar comments
@angelamayxie
Copy link
Contributor Author

#benchmark

@jycor
Copy link
Contributor

jycor commented Jul 23, 2025

#benchmark

@github-actions GitHub Actions
Copy link

@jycor workflow run: https://github.com/dolthub/dolt/actions/runs/16482620524

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

comparing_percentages
100.000000 to 100.000000
version result total
0f41fed ok 5937457
version total_tests
0f41fed 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@jycor DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 63.32 70.55 11.42
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 7be917e 38.88 dolt 0f41fed 31.24 -19.65

@coffeegoddd
Copy link
Contributor

@jycor DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.72 0.68 -5.56
groupby_scan 19.65 19.65 0.0
index_join 2.48 2.48 0.0
index_join_scan 1.44 1.44 0.0
index_scan 30.81 30.81 0.0
oltp_point_select 0.28 0.29 3.57
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 33.12 33.12 0.0
types_table_scan 127.81 125.52 -1.79
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.55 0.0
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 6.91 0.0

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16505367804

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 62.19 70.55 13.44
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 39b1693 38.74 dolt 145e4e9 31.57 -18.51

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16506869955

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.68 0.0
groupby_scan 20.0 19.65 -1.75
index_join 2.48 2.48 0.0
index_join_scan 1.47 1.44 -2.04
index_scan 30.81 30.81 0.0
oltp_point_select 0.29 0.29 0.0
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 33.12 32.53 -1.78
types_table_scan 127.81 127.81 0.0
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.55 0.0
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 6.91 0.0

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 66.84 70.55 5.55
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 39b1693 38.41 dolt 6a05ff4 31.13 -18.95

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.67 0.68 1.49
groupby_scan 19.65 20.0 1.78
index_join 2.43 2.48 2.06
index_join_scan 1.44 1.44 0.0
index_scan 30.26 30.81 1.82
oltp_point_select 0.28 0.29 3.57
oltp_read_only 5.28 5.37 1.7
select_random_points 0.6 0.61 1.67
select_random_ranges 0.63 0.64 1.59
table_scan 32.53 32.53 0.0
types_table_scan 125.52 127.81 1.82
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.67 1.83
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.65 11.87 1.89
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.43 6.55 1.87
types_delete_insert 6.91 6.91 0.0

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16509332589

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 62.19 70.55 13.44
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt c65f086 39.04 dolt ccb5c30 31.43 -19.49

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.68 0.0
groupby_scan 20.0 20.0 0.0
index_join 2.48 2.48 0.0
index_join_scan 1.47 1.44 -2.04
index_scan 30.81 32.53 5.58
oltp_point_select 0.28 0.29 3.57
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 33.12 33.12 0.0
types_table_scan 130.13 125.52 -3.54
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.55 0.0
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 7.04 1.88

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16529475435

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 63.32 59.99 -5.26
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 5d7097a 38.46 dolt 5029f1a 39.42 2.5

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.68 0.0
groupby_scan 19.65 20.0 1.78
index_join 2.48 2.48 0.0
index_join_scan 1.44 1.44 0.0
index_scan 30.81 30.81 0.0
oltp_point_select 0.29 0.29 0.0
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 33.12 33.12 0.0
types_table_scan 127.81 125.52 -1.79
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.67 6.55 -1.8
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.36 3.3 -1.79
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 7.04 6.91 -1.85

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16531428859

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16531844420

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

comparing_percentages
100.000000 to 100.000000
version result total
dbd4726 ok 5937457
version total_tests
dbd4726 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 64.47 66.84 3.68
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 5d7097a 38.47 dolt dbd4726 38.59 0.31

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.68 0.0
groupby_scan 19.65 20.0 1.78
index_join 2.48 2.48 0.0
index_join_scan 1.44 1.47 2.08
index_scan 30.81 30.81 0.0
oltp_point_select 0.29 0.29 0.0
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 32.53 32.53 0.0
types_table_scan 127.81 127.81 0.0
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.67 6.55 -1.8
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 6.91 0.0

@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16604452652

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 64.47 65.65 1.83
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 365926d 39.58 dolt 0775ea5 38.68 -2.27

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.68 0.0
groupby_scan 19.65 19.65 0.0
index_join 2.48 2.48 0.0
index_join_scan 1.47 1.47 0.0
index_scan 30.81 30.81 0.0
oltp_point_select 0.29 0.29 0.0
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.61 0.0
select_random_ranges 0.64 0.64 0.0
table_scan 33.72 32.53 -3.53
types_table_scan 127.81 127.81 0.0
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.55 0.0
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 6.91 0.0

@angelamayxie
Copy link
Contributor Author

#benchmark

1 similar comment
@angelamayxie
Copy link
Contributor Author

#benchmark

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 4, 2025

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16729615045

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 4, 2025

@angelamayxie workflow run: https://github.com/dolthub/dolt/actions/runs/16729572311

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

comparing_percentages
100.000000 to 100.000000
version result total
1809630 ok 5937457
version total_tests
1809630 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 65.65 65.65 0.0
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 9360826 39.59 dolt 1809630 39.73 0.35

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 66.84 64.47 -3.55
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 9360826 38.46 dolt 1809630 38.25 -0.55

@coffeegoddd
Copy link
Contributor

@coffeegoddd DOLT

comparing_percentages
100.000000 to 100.000000
version result total
16c6151 ok 5937457
version total_tests
16c6151 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.7 0.68 -2.86
groupby_scan 20.0 19.65 -1.75
index_join 2.48 2.48 0.0
index_join_scan 1.44 1.47 2.08
index_scan 30.81 30.81 0.0
oltp_point_select 0.29 0.29 0.0
oltp_read_only 5.37 5.37 0.0
select_random_points 0.61 0.62 1.64
select_random_ranges 0.64 0.65 1.56
table_scan 33.12 33.12 0.0
types_table_scan 127.81 127.81 0.0
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.67 1.83
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.87 11.87 0.0
oltp_update_index 3.3 3.3 0.0
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 6.91 0.0

@coffeegoddd
Copy link
Contributor

@angelamayxie DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.7 0.68 -2.86
groupby_scan 20.0 20.0 0.0
index_join 2.48 2.48 0.0
index_join_scan 1.44 1.44 0.0
index_scan 30.26 30.81 1.82
oltp_point_select 0.28 0.29 3.57
oltp_read_only 5.28 5.37 1.7
select_random_points 0.6 0.62 3.33
select_random_ranges 0.63 0.65 3.17
table_scan 32.53 33.12 1.81
types_table_scan 125.52 127.81 1.82
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.55 6.67 1.83
oltp_insert 3.25 3.25 0.0
oltp_read_write 11.65 12.08 3.69
oltp_update_index 3.3 3.36 1.82
oltp_update_non_index 3.25 3.25 0.0
oltp_write_only 6.55 6.55 0.0
types_delete_insert 6.91 7.04 1.88

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
correctness_approved
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@angelamayxie @jycor @coffeegoddd