Support new legacy tests, pyspecs up to Cancun + a little of Prague
Compatible test release: https://github.com/ethereum/tests/releases/tag/v17
New options:
--testfile <file or path> now supports test path as well to run all the tests from testpath recursively. requires -t arg.
Removed option:
Announcment
Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: https://tinyurl.com/y525ezs7
Testing stats
Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/
Changelog
Interesting
- support pyspecs test generation (eof/state/blockchain) up to Cancun
- rename Merge to Paris
- support more depth in auto test detection in folders
- vmtrace when filling the test
- insert beacon root precompile if it is not defined in pre after Cancun networks
- verify filled tests folders has fillers
- allow old test formats in EIPTests folder
- select EOF test vectors by subname
- support pyspecs eof .py files
- support test filling from .py files as of jan 2025 (although they are removed from ethereum/tests)
Client Configs
- support client config exceptions update
- update docker
Technical
- fix escape char logic in json parser
- support auto options when using
retesteth testfile.json - remove previousHash from state tests
- fix currentExcessBlobGas in state tests
- dataobject support double
- accountIncomplete export shouldnotexist record in json
- fill state test as blockchain was missing bigInt hint field
- fix bugs and compatibility issues
ubuntu 20.04.6:
http://retesteth.ethdevops.io/release/0.3.2-legacy/ubuntu-20.04.6/retesteth-0.3.2-legacy-ubuntu-20.04.6
Might need the dependecies install (but better to be run on Ubuntu20):
- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6
macOS-XCode14:
failed to build
Docker:
Clients updated as of 09.05.2025 (6 GB image)
https://ethereum-tests.readthedocs.io/en/latest/retesteth-tutorial.html#retesteth-in-a-docker-container
geth evm version: evm version 1.15.12-unstable-485ff4bb-20250508
lllc version: 0.5.14-develop.2023.7.11+commit.c58ab2c6.mod.Linux.g++
solidity version: 0.8.21+commit.d9974bed.Linux.g++
http://retesteth.ethdevops.io/release/0.3.2-legacy/dretesteth-0.3.2-legacy.tar
Documentation:
https://ethereum-tests.readthedocs.io/en/latest/