Skip to content

Parallelize bulk_insert_live_objects during snapshot restore#25904

Merged
andll merged 8 commits intomainfrom
parallel-snapshot-inserts
Mar 24, 2026
Merged

Parallelize bulk_insert_live_objects during snapshot restore#25904
andll merged 8 commits intomainfrom
parallel-snapshot-inserts

Conversation

@andll
Copy link
Contributor

@andll andll commented Mar 20, 2026

Summary

  • Refactors AuthorityStore::bulk_insert_live_objects to accept Arc<AuthorityPerpetualTables> and Vec<LiveObject> (collected at the call site)
  • Verifies SHA3 digest over the full object set upfront, then splits into 8 chunks and inserts each chunk concurrently via tokio::task::spawn_blocking
  • Updates StateSnapshotReaderV1::read / sync_live_objects to propagate the Arc and use an async try_for_each closure

Test plan

  • cargo check -p sui-core -p sui-snapshot -p sui-tool
  • SUI_SKIP_SIMTESTS=1 cargo nextest run -p sui-snapshot

🤖 Generated with Claude Code

@vercel
Copy link

vercel bot commented Mar 20, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
sui-docs Ready Ready Preview, Comment Mar 24, 2026 0:16am
2 Skipped Deployments
Project Deployment Actions Updated (UTC)
multisig-toolkit Ignored Ignored Preview Mar 24, 2026 0:16am
sui-kiosk Ignored Ignored Preview Mar 24, 2026 0:16am

Request Review

@andll andll temporarily deployed to sui-typescript-aws-kms-test-env March 20, 2026 00:39 — with GitHub Actions Inactive
@andll andll requested a review from johnjmartin March 20, 2026 00:42
@andll andll marked this pull request as ready for review March 20, 2026 00:42
@andll andll temporarily deployed to sui-typescript-aws-kms-test-env March 20, 2026 00:42 — with GitHub Actions Inactive
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
andll and others added 2 commits March 23, 2026 13:20
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@andll andll temporarily deployed to sui-typescript-aws-kms-test-env March 24, 2026 00:11 — with GitHub Actions Inactive
@andll andll temporarily deployed to sui-typescript-aws-kms-test-env March 24, 2026 00:14 — with GitHub Actions Inactive
@andll andll force-pushed the parallel-snapshot-inserts branch from c6b4ebf to 4f8cd07 Compare March 24, 2026 00:50
@andll andll temporarily deployed to sui-typescript-aws-kms-test-env March 24, 2026 00:50 — with GitHub Actions Inactive
@andll andll enabled auto-merge (squash) March 24, 2026 00:50
@andll andll merged commit fd1dd61 into main Mar 24, 2026
99 of 110 checks passed
@andll andll deleted the parallel-snapshot-inserts branch March 24, 2026 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants