Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(l1): long running assertoor test on cd #978

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions test_data/cd_network_params.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
participants:
- el_type: geth
cl_type: lighthouse
validator_count: 32
- el_type: geth
cl_type: prysm
validator_count: 32
- el_type: ethereumrust
cl_type: lighthouse
validator_count: 32

additional_services:
- assertoor
- dora
- el_forkmon

assertoor_params:
run_stability_check: true
run_block_proposal_check: true
run_transaction_test: true
run_blob_transaction_test: true

43 changes: 31 additions & 12 deletions test_data/el-stability-check.yml
Original file line number Diff line number Diff line change
@@ -1,28 +1,47 @@
# This file is based upon `assertoor-tests` stability check file:
# https://github.com/ethpandaops/assertoor-test/blob/master/assertoor-tests/stability-check.yaml
# This file is mix and match based upon the basic `assertoor-tests` playbooks:
# - https://github.com/ethpandaops/assertoor-test/blob/master/assertoor-tests/stability-check.yaml
# - https://github.com/ethpandaops/assertoor-test/blob/master/assertoor-tests/block-proposal-check.yaml
#
# We removed the consensus checks to keep it minimal. The checks removed were:
# - check_consensus_finality
# - check_consensus_attestation_stats
# - check_consensus_reorgs
# - check_consensus_forks
# For reference on each individual check see: https://github.com/ethpandaops/assertoor/wiki#supported-tasks-in-assertoor

id: el-stability-check
name: "Check Execution Stability"
timeout: 2h
tasks:
- name: check_clients_are_healthy
title: "Check if at least one client is ready"
timeout: 5m
config:
minClientCount: 1
title: "Check if all clients are ready"
timeout: 1m

- name: run_tasks_concurrent
title: "Check if all EL & CL clients are synced"
timeout: 30m
timeout: 5m
config:
tasks:
- name: check_consensus_sync_status
title: "Check if CL clients are synced"
- name: check_execution_sync_status
title: "Check if EL clients are synced"

- name: run_task_matrix
title: "Check block proposals from all client pairs"
timeout: 2m
configVars:
matrixValues: "validatorPairNames"
config:
runConcurrent: true
matrixVar: "validatorPairName"
task:
name: check_consensus_block_proposals
title: "Wait for block proposal from ${validatorPairName}"
configVars:
validatorNamePattern: "validatorPairName"

- name: run_tasks_concurrent
title: "Check chain stability (reorgs and forks)"
timeout: 7m
config:
tasks:
- name: check_consensus_reorgs
title: "Check consensus reorgs"
- name: check_consensus_forks
title: "Check consensus forks"
13 changes: 8 additions & 5 deletions test_data/network_params.yaml
Original file line number Diff line number Diff line change
@@ -1,21 +1,24 @@
participants:
- el_type: geth
cl_type: lighthouse
count: 2
validator_count: 32
- el_type: geth
cl_type: prysm
validator_count: 32
- el_type: ethereumrust
cl_type: lighthouse
count: 1
validator_count: 32

additional_services:
- assertoor
- dora
- el_forkmon
- tx_spammer
- blob_spammer

assertoor_params:
run_stability_check: false
run_block_proposal_check: false
run_transaction_test: true
run_blob_transaction_test: true
tests:
- 'https://raw.githubusercontent.com/lambdaclass/lambda_ethereum_rust/refs/heads/assertoor-run-on-cd/test_data/el-stability-check.yml'

- 'https://raw.githubusercontent.com/lambdaclass/lambda_ethereum_rust/refs/heads/enhance-el-assertoor-ci-test/test_data/el-stability-check.yml'
Loading