Antithesis found "update of consistent index not advancing"

[serathius]

Bug report criteria

• This bug report is not security related, security issues should be disclosed privately via security@etcd.io.
• This is not a support request or question, support requests or questions should be raised in the etcd discussion forums.
• You have read the etcd bug reporting guidelines.
• Existing open issues along with etcd frequently asked questions have been checked and this is not a duplicate.

What happened?

Verify from

etcd/server/storage/schema/cindex.go

Line 78 in ea94887

verify.Verify("update of consistent index not advancing", func() (bool, map[string]any) {

Found after #20283

Failed

message: "update of consistent index not advancing", 
file: client/pkg/verify/verify.go, 
line: 74, 
class: go.etcd.io/etcd/client/pkg/v3/verify, 
function: Verify
details: {currentIndex:100,previousIndex:105}

Report
https://linuxfoundation.antithesis.com/report/NsOdw63CtcODw6XCoMKow7jCmcKYL0_DiMOiLzLDmA/fe1Y1tx1SjxexB5vJV7MfDVikbDOf64JJwJqJR_lerA.html?auth=v2.public.eyJuYmYiOiIyMDI1LTA4LTAyVDEzOjA3OjI2LjE1NzE4OTE1MFoiLCJzY29wZSI6eyJSZXBvcnRTY29wZVYxIjp7ImFzc2V0IjoiZmUxWTF0eDFTanhleEI1dkpWN01mRFZpa2JET2Y2NEpKd0pxSlJfbGVyQS5odG1sIiwicmVwb3J0X2lkIjoiTnNPZHc2M0N0Y09EdzZYQ29NS293N2pDbWNLWUwwX0RpTU9pTHpMRG1BIn19fd-fDPGQsgCQuiO3pREc8FmEsN9Qf2A8_Ef1V6BtcktCiITcSJpmU6W5rM1KAJce8M3zFTijywzk2_aT3MovPwY

What did you expect to happen?

No failures for verifies

/cc @ahrtr @fuweid @siyuanfoundation

How can we reproduce it (as minimally and precisely as possible)?

Contact @marcus-hodgson-antithesis to access Antithesis environment

@marcus-hodgson-antithesis the Antithesis report doesn't include dump. Could you fetch it and upload here?

Anything else we need to know?

No response

Etcd version (please run commands below)

main branch

Etcd configuration (command line flags or environment variables)

paste your configuration here

Etcd debug information (please run commands below, feel free to obfuscate the IP address or FQDN in the output)

$ etcdctl member list -w table
# paste output here

$ etcdctl --endpoints=<member list> endpoint status -w table
# paste output here

Relevant log output