Skip to content

Conversation

@mralj
Copy link
Contributor

@mralj mralj commented Jan 24, 2026

n_tps benchmark failed (again) for the low_tps=2 scenario.
Other scenarios were successful.

Logs imply that we were unable to fund 3 wallets, and the timeout kicked in. As per logs, there isa +40min delay between sending txs and test timing up.

06:25:41 [06:25:41.842] INFO: pxe:service Added contract SponsoredFPC at 0x2bce99adc7f9ecce287253249ed7e662502e28f7778ae5fd021a4475b51051c9 with class 0x20c546ed52e5d4163665e7a0c62453361c202a96c65e8ce60585415e6a628169
06:25:41 [06:25:41.899] INFO: pxe:service Added contract SponsoredFPC at 0x2bce99adc7f9ecce287253249ed7e662502e28f7778ae5fd021a4475b51051c9 with class 0x20c546ed52e5d4163665e7a0c62453361c202a96c65e8ce60585415e6a628169
06:25:41 [06:25:41.955] INFO: pxe:service Added contract SponsoredFPC at 0x2bce99adc7f9ecce287253249ed7e662502e28f7778ae5fd021a4475b51051c9 with class 0x20c546ed52e5d4163665e7a0c62453361c202a96c65e8ce60585415e6a628169
06:25:42 [06:25:42.012] INFO: e2e:k8s-utils command: kubectl delete workflownodes -l app.kubernetes.io/instance=network-shaping -n nightly-bench --ignore-not-found=true --wait=true --timeout=5m 
06:25:42 [06:25:42.263] INFO: e2e:k8s-utils helm command: helm upgrade --install network-shaping /home/aztec-dev/aztec-packages/spartan/aztec-chaos-scenarios --namespace nightly-bench --values /home/aztec-dev/aztec-packages/spartan/aztec-chaos-scenarios/values/network-requirements.yaml  --wait --timeout=10m --set-string global.targetNamespace='nightly-bench'
06:25:47 [06:25:47.602] INFO: wallet-sdk:base_wallet Sent transaction 0x0236134097869cca7dd866f358076b262eb5ef155ce423dbdf0e32ad2e9931a6
06:25:48 [06:25:48.095] INFO: wallet-sdk:base_wallet Sent transaction 0x1bc3577b8b12e27150f008044e7418597fef2d6c62e88102ed5f8e4bd0e87da5
06:25:48 [06:25:48.137] INFO: wallet-sdk:base_wallet Sent transaction 0x24b7bb256f4b493c3b5469cc0473d3e95a87db06fe17bf918fc9e084da42eed5
07:05:47 [07:05:47.671] INFO: e2e:spartan-test:sustained-tps Collecting benchmark metrics and cleaning up...

Changes:

  1. Moved chaos mesh installation after the account deployments
  2. Batched account deployments
  3. Added more logs when deploying accounts

@mralj mralj requested a review from alexghr January 24, 2026 10:00
@mralj mralj enabled auto-merge January 24, 2026 11:52
@mralj mralj added this pull request to the merge queue Jan 24, 2026
@AztecBot
Copy link
Collaborator

AztecBot commented Jan 24, 2026

Flakey Tests

🤖 says: This CI run detected 1 tests that failed, but were tolerated due to a .test_patterns.yml entry.

\033FLAKED\033 (8;;http://ci.aztec-labs.com/0cb2e94342af02f3�0cb2e94342af02f38;;�):  yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.parallel.test.ts "does not allow submitting proof after epoch end" (28s) (code: 1) group:e2e-p2p-epoch-flakes (\033mralj\033: fix: n_tps fix for larger wallet count (#19917))

Merged via the queue into next with commit b34a896 Jan 24, 2026
16 checks passed
@mralj mralj deleted the mralj/fix/ntps_v2 branch January 24, 2026 19:45
github-merge-queue bot pushed a commit that referenced this pull request Jan 25, 2026
The CI failed again for the same reason as described in the
#19917
This PR just removes the failing scenario altogether until I figure out
what's happening, becaue I want to see _some numbers_ in benchmarks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants