...
A suite of end to end client tests that are not invoked directly is provided here, https://github.com/ethereum/hive. These tests are run against all clients and results can be seen at https://hivetests.ethdevops.io/. Currently there are 16 consensus tests and 3 sync tests that are failing. The consensus tests are believed to be performance related and the sync tests involve aleth and nethermind clients.
Running Hive Tests
- consensus
sudo ./hive --sim consensus --loglevel 6 --docker-noshell --client besu_latest --sim.parallelism 1 --sim.rootcontext
- graphql
sudo ./hive --sim graphql --loglevel 6 --docker-noshell --client besu_latest --sim.parallelism 1 --sim.rootcontext
- devp2p
sudo ./hive --sim devp2p --loglevel 6 --docker-noshell --client besu_latest --sim.parallelism 1 --sim.rootcontext
- sync
sudo ./hive --sim ethereum/sync --loglevel 6 --docker-noshell --client besu_latest,openethereum_latest,go-ethereum_latest --sim.parallelism 1 --sim.rootcontext
Known Failures
Currently there are 16 consensus tests, 3 sync tests and 1 graphql tests that are failing. The consensus tests are believed to be performance related and the sync tests involve aleth and nethermind clients which are not properly configured within the test suite.
- failing consensus tests
- modexp_37120_37111_37111_25000_d0g0v0_Istanbul
- modexp_9_3711_37111_25000_d0g1v0_Istanbul
- CallEcrecover0_NoGas_d0g0v0_Istanbul
- sstore_0toXtoX_d1g0v0_Istanbul
- static_callcallcodecall_010_2_d1g0v0_Istanbul
- CALLBlake2f_MaxRounds_d0g0v0_Istanbul
- sstore_combinations_initial00_d26g0v0_Istanbul
- sstore_combinations_initial11_2_d280g0v0_Istanbul
- sstore_combinations_initial11_2_d36g0v0_Istanbul
- sstore_combinations_initial20_d373g0v0_Istanbul
- StoreClearsAndInternlCallStoreClearsSuccess_d0g0v0_Istanbul
- ecmul_1-3_0_21000_80_d0g3v0_Istanbul
- pointMulAdd_d5g2v0_Istanbul
- pointMulAdd2_d25g3v0_Istanbul
- ecmul_0-3_340282366920938463463374607431768211456_28000_80_d0g3v0_Istanbul
- SimpleTxCosts20000_Frontier
- failing sync tests
- fast-sync aleth_nightly -> besu_latest
- fast-sync besu_latest -> aleth_nightly
- fast-sync nethermind_latest -> besu_latest
- failing graphql tests
- eth_syncing