Skip to content

Conversation

jimmygchen
Copy link
Member

@jimmygchen jimmygchen commented Sep 12, 2025

Issue Addressed

This bug was discovered when the CI kurtosis sync tests got stuck in SyncTransition for a long time:
https://github.com/sigp/lighthouse/actions/runs/17632496975/job/50102884940

I've added a failing test that replicate the exact scenario, and made a fix for it.

NOTE: I haven't done any manual testing yet.

@jimmygchen jimmygchen added bug Something isn't working work-in-progress PR is a work-in-progress syncing labels Sep 12, 2025
@jimmygchen jimmygchen marked this pull request as ready for review September 12, 2025 15:32
@jimmygchen jimmygchen requested a review from jxs as a code owner September 12, 2025 15:32
Copy link
Collaborator

@dapplion dapplion left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch and good test! Some minor comments

@jimmygchen
Copy link
Member Author

jimmygchen commented Sep 15, 2025

I had a look at the failing checkpoint sync tests (optionally triggered jobs), and I don't believe they are related to changes from this PR, i think what's happening is:

  • The sepolia checkpoint server used is currently 4 days behind, so it takes longer to sync
  • The devnet was under non finality tests, and it was just taking longer to sync.
  • Github-hosted runner struggles to sync supernode on peerdas devnet due to capacity, to be resovled in Use unique enclave names for CI Kurtosis tests on self hosted runners #7804 once we have dedicated kurtosis runners.

@jimmygchen jimmygchen added ready-for-review The code is ready for review and removed work-in-progress PR is a work-in-progress labels Sep 15, 2025
@jimmygchen
Copy link
Member Author

@dapplion thanks for the review! I've addressed most of your comments.

@jimmygchen jimmygchen added the v8.0.0-rc.0 Q3 2025 release for Fusaka on Holesky label Sep 15, 2025
Copy link
Member

@pawanjay176 pawanjay176 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI, running this on devnet 3 i'm getting a stuck chain with 40 peers.
Need to investigate further

@jimmygchen jimmygchen added waiting-on-author The reviewer has suggested changes and awaits thier implementation. and removed ready-for-review The code is ready for review labels Sep 16, 2025
@jimmygchen
Copy link
Member Author

Thanks for raising this Pawan. Sorry i haven't managed to get to this today, will look into this tomorrow.

@jimmygchen jimmygchen added v8.0.0 Q4 2025 Fusaka Mainnet Release and removed v8.0.0-rc.0 Q3 2025 release for Fusaka on Holesky labels Sep 17, 2025
@jimmygchen
Copy link
Member Author

FYI, running this on devnet 3 i'm getting a stuck chain with 40 peers. Need to investigate further

@pawanjay176 im going to remove the clean ups from this PR so we can merge this, because the flaky sync test is really quite annoying 😅

@mergify mergify bot added ready-for-review The code is ready for review and removed waiting-on-author The reviewer has suggested changes and awaits thier implementation. labels Sep 25, 2025
Copy link

mergify bot commented Sep 25, 2025

This pull request has merge conflicts. Could you please resolve them @jimmygchen? 🙏

@mergify mergify bot added waiting-on-author The reviewer has suggested changes and awaits thier implementation. and removed ready-for-review The code is ready for review labels Sep 25, 2025
@jimmygchen jimmygchen added v8.1.0 Post-Fulu release and removed v8.0.0 Q4 2025 Fusaka Mainnet Release labels Sep 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working syncing v8.1.0 Post-Fulu release waiting-on-author The reviewer has suggested changes and awaits thier implementation.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants