[RPC] Mismatch blockNumber=13067380 on X Layer Testnet

[zjg555543]

System information

Erigon version: zkevm

OS & Version: Windows/Linux/OSX

Commit hash: base on zkevm 883ed2b01ef85b05d9b7920b51696b9fd9f2736b

Erigon Command (with flags/config): ./cdk-erigon --config="xlayerconfig-testnet.yaml"

Chain/Network: X Layer testnet

Expected behaviour

Sync blocks from block 0 successed.

Actual behaviour

Mismatch block hash at 13067380

INFO] [09-27|19:20:08.337] [6/16 Execution] Executed blocks         number=13049066 %=72.274 blk/s=99.4 tx/s=2579.9 Mgas/s=1297.1 gasState%=14.17 batch=112.5MB alloc=245.2MB sys=2.5GB
[INFO] [09-27|19:20:09.128] [p2p] GoodPeers                          
[INFO] [09-27|19:20:09.133] [txpool] stat                            pending=0 baseFee=0 queued=0 alloc=265.3MB sys=2.5GB
[INFO] [09-27|19:20:28.337] [6/16 Execution] Executed blocks         number=13050925 %=72.284 blk/s=93.0 tx/s=2479.9 Mgas/s=1213.0 gasState%=14.73 batch=118.6MB alloc=229.6MB sys=2.5GB
[INFO] [09-27|19:20:48.337] [6/16 Execution] Executed blocks         number=13052624 %=72.293 blk/s=85.0 tx/s=2651.5 Mgas/s=1108.8 gasState%=15.31 batch=124.1MB alloc=248.3MB sys=2.5GB
[INFO] [09-27|19:21:08.338] [6/16 Execution] Executed blocks         number=13054314 %=72.303 blk/s=84.5 tx/s=2632.2 Mgas/s=1103.0 gasState%=15.95 batch=128.8MB alloc=224.7MB sys=2.5GB
[INFO] [09-27|19:21:09.135] [txpool] stat                            pending=0 baseFee=0 queued=0 alloc=261.0MB sys=2.5GB
[INFO] [09-27|19:21:28.338] [6/16 Execution] Executed blocks         number=13055899 %=72.311 blk/s=79.3 tx/s=2550.3 Mgas/s=1034.7 gasState%=16.55 batch=134.1MB alloc=264.1MB sys=2.5GB
[INFO] [09-27|19:21:48.338] [6/16 Execution] Executed blocks         number=13057344 %=72.320 blk/s=72.3 tx/s=2705.0 Mgas/s=943.4 gasState%=17.19 batch=139.8MB alloc=175.0MB sys=2.5GB
[INFO] [09-27|19:22:08.338] [6/16 Execution] Executed blocks         number=13058725 %=72.327 blk/s=69.1 tx/s=2519.8 Mgas/s=901.7 gasState%=17.78 batch=145.1MB alloc=266.5MB sys=2.5GB
[INFO] [09-27|19:22:09.121] [p2p] GoodPeers 
[INFO] [09-27|19:22:09.135] [txpool] stat                            pending=0 baseFee=0 queued=0 alloc=290.2MB sys=2.5GB
[INFO] [09-27|19:22:28.338] [6/16 Execution] Executed blocks         number=13059838 %=72.333 blk/s=55.7 tx/s=2190.3 Mgas/s=726.8 gasState%=18.30 batch=149.6MB alloc=178.8MB sys=2.5GB
[INFO] [09-27|19:22:48.338] [6/16 Execution] Executed blocks         number=13061277 %=72.341 blk/s=72.0 tx/s=2728.7 Mgas/s=939.7 gasState%=18.96 batch=154.4MB alloc=181.3MB sys=2.5GB
[INFO] [09-27|19:23:08.339] [6/16 Execution] Executed blocks         number=13063600 %=72.354 blk/s=116.2 tx/s=3081.8 Mgas/s=1517.2 gasState%=19.82 batch=157.3MB alloc=307.8MB sys=2.5GB
[INFO] [09-27|19:23:09.137] [txpool] stat                            pending=0 baseFee=0 queued=0 alloc=319.6MB sys=2.5GB
[INFO] [09-27|19:23:28.339] [6/16 Execution] Executed blocks         number=13065768 %=72.366 blk/s=108.4 tx/s=2880.7 Mgas/s=1416.3 gasState%=20.64 batch=160.0MB alloc=291.9MB sys=2.5GB
[WARN] [09-27|19:23:41.706] [6/16 Execution] Blockhash mismatch      blockNumber=13067380 datastreamBlockHash=0x0786de7cafc0e9756afb2dccf28bfeff3633ae4be266f3eb316130c8ba049a25 calculatedBlockHash=0x775e53567ad619860fa1a4ad2a125b721720e0bee8f8bd620e97c2e0773a7608
[WARN] [09-27|19:23:41.717] [6/16 Execution] Blockhash mismatch      blockNumber=13067381 datastreamBlockHash=0x99140bf1ccf0c2dd25b4e857d436e8ba0f9604e656a925fb79e641c8f7bf4181 calculatedBlockHash=0xa95d123e785bed9a9e6fc128a4ae88ed8c1d5425f4434255e0e375b04a096a84
[WARN] [09-27|19:23:41.725] [6/16 Execution] Blockhash mismatch      blockNumber=13067382 datastreamBlockHash=0x5d2a429f0d5a70cd2619017c0437acebed674b175391d8446bc8fe773b561ed9 calculatedBlockHash=0x532684b403dcc4a5465bd9add8215926eda7c7cc61523aee70d7050eb705bd71
[WARN] [09-27|19:23:41.732] [6/16 Execution] Blockhash mismatch      blockNumber=13067383 datastreamBlockHash=0xc0fff99b69e150d867be2f1c6c55e8a480dc59b1da018f83045a3a8900832c3c calculatedBlockHash=0x0ad3dd79d5d18c78e1212e19374f09a460f3ebe75008dcdcab32575b88c896ef
[WARN] [09-27|19:23:41.739] [6/16 Execution] Blockhash mismatch      blockNumber=13067384 datastreamBlockHash=0xb5d6aa2f01d11acaa3c45a1a766518f334139f50da4d888e71af7801a9c0ed32 calculatedBlockHash=0x060a5e192fdf53ccaec5bd53936e868f975daddd210a31256dc5c00e0c989466
[WARN] [09-27|19:23:41.746] [6/16 Execution] Blockhash mismatch      blockNumber=13067385 datastreamBlockHash=0xb6716b395990ad57a2d7a508bad52ce9e7bec5c60eb7a6611c0bd9f9bb8b1907 calculatedBlockHash=0x29787df5b2c4739a07681469c47b7a73a82ad9b2b4b030da8d6c5c5d7a5dfb73
[WARN] [09-27|19:23:41.753] [6/16 Execution] Blockhash mismatch      blockNumber=13067386 datastreamBlockHash=0x259a73b067dda26d24813883f796caa76e3435b2b770db74be01f63a81f70f0c calculatedBlockHash=0xa008e0c82b2c2c5c5c618c25a611c3eafdf9eb725b3193e66f58e9fec28dae7a
[WARN] [09-27|19:23:41.760] [6/16 Execution] Blockhash mismatch      blockNumber=13067387 datastreamBlockHash=0x058f1988fd02ff86d8cb4acd6da4bfd839677dd6d92d795a5c739e81950e57a9 calculatedBlockHash=0x16892dc337fea208c50426590640753b658f1e4719803b611707ea7dc0379c54
[WARN] [09-27|19:23:41.762] [6/16 Execution] Blockhash mismatch      blockNumber=13067388 datastreamBlockHash=0x54c30a27e4dca4695f6327e7e96ab085b5a757fa7f915e6e8505df700c94de9f calculatedBlockHash=0x9b505976988d3a497ba6385e0a5567c58cd74ed94e474f3f29f4d4dbcc6cd1e9
[WARN] [09-27|19:23:41.769] [6/16 Execution] Blockhash mismatch      blockNumber=13067389 datastreamBlockHash=0xdaa8c5a3144d56b0ce514e768df54aafbfab037b8d81c24191d22a4cdd32a053 calculatedBlockHash=0x36fb91d2bbe964cce7b41fcc161e1f42f41dc4762baec9f8ab6b3216421e2d8d
[WARN] [09-27|19:23:41.777] [6/16 Execution] Blockhash mismatch      blockNumber=13067390 datastreamBlockHash=0x84dcb9ad4f58e1091bff603353c24918053e2eada773d7ba9ff3f0a9c2654ee3 calculatedBlockHash=0x1a5eb544aba4028ed4357ce23dec7417e6dc8b6cb124e07ae6957f14cf420baa
[WARN] [09-27|19:23:41.785] [6/16 Execution] Blockhash mismatch      blockNumber=13067391 datastreamBlockHash=0xd4e4cdf5bc113cb877f4791bea2c529a09c93bc71119736b27796ce6b0c8a539 calculatedBlockHash=0xab36c6469798afd77503e796d368ca03e3cff1fd18074c47ef481e1ac7327522
[WARN] [09-27|19:23:41.792] [6/16 Execution] Blockhash mismatch      blockNumber=13067392 datastreamBlockHash=0xa8de79433d145202c100acad7106f9e34d3239a62e58b5e96a978d5c3739fbd2 calculatedBlockHash=0x9716af46d507a6480815a48bae0df2b2cb8d98bf4e2196f52135bc0a971392c5
[WARN] [09-27|19:23:41.800] [6/16 Execution] Blockhash mismatch      blockNumber=13067393 datastreamBlockHash=0x2e4234816409720f626ee5818af1d195ffa7beca699b4046800201dc51c4e45b calculatedBlockHash=0xcee09181f758ef3cd41ab905843af85e85e4a9d922a16d36ad619944c6701f26
[WARN] [09-27|19:23:41.807] [6/16 Execution] Blockhash mismatch      blockNumber=13067394 datastreamBlockHash=0x5fab2bb9f035ba789e071134a0e686981b821cd0c4b9326cfa6703ddb76a0337 calculatedBlockHash=0xf376abe02efed5bc459cbb52506bfb6e238434c9d49ccd4deb8b901e413b511f
[WARN] [09-27|19:23:41.817] [6/16 Execution] Blockhash mismatch      blockNumber=13067395 datastreamBlockHash=0x0b4c9ed0e88d10219c3fd06538da6978f57b64c39c62602db6810ba4371cb085 calculatedBlockHash=0xdee2713aa0705bbc24a8fd9eff942512d17fbfce6e4e3c23405d962ade2efd81
[WARN] [09-27|19:23:41.823] [6/16 Execution] Blockhash mismatch      blockNumber=13067396 datastreamBlockHash=0xf0f8b23aa776cc6d0114083d34347c091c2cf63e

[V-Staykov]

THere seems to be some problem with the receipt post state. Investigating it right now. Is the sequencer erigon and what version?

[V-Staykov]

The block hash mismatch starts from block 12524592 it is connected to forkid8 bugs not being applied on the sequencer. Our node applies them and thus changes the blockhash and some of the receipts data.