This repository was archived by the owner on Jan 22, 2025. It is now read-only.
This repository was archived by the owner on Jan 22, 2025. It is now read-only.
Open
Description
Problem
Based on shred_insert_is_full metric from mainnet-beta, it seems like ~1% of nodes are repairing almost every shred in every slot.
Proposed Solution
- Debug what is going on with these nodes and why they are not getting shreds from turbine.
- Do they repair before they receive shreds from turbine, or they don't receive any shreds from TVU socket at all?
- Possibly their
ContactInfois not propagated in gossip, but why?
In the time interval
2023-09-06T13:59:28Z
2023-09-06T14:59:27Z
(7907 slots), the offending nodes seem to be:
node | number of slots fully repaired
8c4dZiN5MQQKVRjL3fpMx4cHbuU91XSjWKLTq4w2pneW 7907
EXAG1GJgsQKfML6DwdJbJ4hpotyDYhH1ZGuDhdNZZTn4 7907
5MC2bsQWTbKSCG6aZhTTGwCk7kzkoLH5YjgZFkn3vN4c 7907
Aowy8a3Yih7h4fVuBJ9m4zTSTR5RbutGihVgztkDQLPe 7907
3UrNqi8XYh5bh8CE4JF1256fLKX8eenrAXQJ4Y75Do6c 7907
HUjU6MUEtpzj8PpLEqFPLGC5VynkWfHkXZpskEfM6GdY 7907
BmjKDyDbPgkt8Pz7F5tr2GNFKqfg7PA9wPJjevcFyJ9Y 7907
EbuSoLTjhTFZbujGCvhtFgvaMbXjAVQPL3bUpGD62D4M 7907
A85mL9EUKnq8r52WpyHMLuZw77bv4buZrbAu8cx8BHjg 7907
DZ2omywE3SYm2SQXMWwGbcVUTWcjjZYA9RJxq7h25rif 7907
77RUN7CWAtQCVpdBcSkNU7jJaKtxy6rCcss2y9QBiMMB 7907
HTTod6mktmDvM5B1fHdyf8uUTaAL9HLTY9MaLRgCDrPd 7907
CmGiehaqWfEZwyhmN9rckNtnVMeZtsjz1obusNWGyj4p 7907
C4vi5tE3tTpBLMheM55t7NRinp9fvMywqaiQhr5YUSy8 7907
AE88LqgCpV7i3GD3JcW9FLGA48N32UsuSagtiPVzHAtH 7907
2NCzepxVangimxxDGLBiMYFfPS5ioRKr4aij6Rf668rg 7907
87T8k8EXRPxsTpF8TXGSWVSf4Bheaz4GEy73BPwm2CwH 7907
53qAF5HupqQMWa6Dy1Rsd6c3FDGrTo1hec5itK4YZGov 7906
9xkVy66XvA5VtMdsVHmqkBefoeQh7Hb4sJhMMhfJUULD 7906
6XkchfsH5LYpPpd9uPDyoKQtYZXPgK3h94nWjJZdwtdc 7905
7AVXHqRUU7xZDkQvGikrsTbjBeAYcKHz4ArRfECkz71E 7904
Fc6NNdS2j3EmrWbU6Uqt6wsKB5ef72NjaWfNxKYbULGD 7902
9XV9hf2oBdJdrcPaLWLALpnCRu9t5Cozd4hJWMZnF4iu 7884
dkisqBjujxMvG9HkmWK4aooockCCRcnYZEdR2fmN8TP 7811
Bxps8LSWxZVx618iK8rHvnCD5f9u7cTYuXz5sLsAGuSn 7798
Eye7jGJ4XypieFsVGBwm8VijbM5qPRJBU7nxGNwpukvT 7750
6zAsEYWbtV4skvZGM8Vddd2XYECYatodyxq3asjRyJTY 6986
G9qsqKnvR77FAmcLtcrkMrFvcDGoQ7LQB5xaXc7mD83u 6190
4vX1fgJnjYbYeWJxTDipTUGh93vxxooTUp4Kxvv5KSUF 6107
4oenxERWkYjZfmoTeRPRgXmMF9kkqUzgKSPjxL6gP67u 6067
Note that majority of above nodes are staked, in particular
Identity Vote Account Commission Last Vote Root Slot Skip Rate Credits Version Active Stake
8c4dZiN5MQQKVRjL3fpMx4cHbuU91XSjWKLTq4w2pneW G2b1Pi9kf3KFX73V7kD3PdPxYL3iJxc9WubMa6Az1kWs 10% 215952431 ( -4) 215952400 ( -4) - 365423 1.14.23 66268.738184708 SOL (0.02%)
4vX1fgJnjYbYeWJxTDipTUGh93vxxooTUp4Kxvv5KSUF 576M4qCLi4H3yzcvADMMjNA8bDrJuiYZz2XCXMxGvaPe 10% 215952435 ( 0) 215952404 ( 0) 6.25% 364401 1.14.24 67200.146615542 SOL (0.02%)
Bxps8LSWxZVx618iK8rHvnCD5f9u7cTYuXz5sLsAGuSn DDCWKg1piRArvzrfu3QC9bPKANz71LpYRuQaSJ2FnNQy 8% 215952433 ( -2) 215952402 ( -2) 2.08% 372696 1.16.9 67640.318607768 SOL (0.02%)
2NCzepxVangimxxDGLBiMYFfPS5ioRKr4aij6Rf668rg 7QFPC5o5dmJaKwntE8bu2ohvT91y9eouXAMRMM1Y7VRP 10% 215952433 ( -2) 215952402 ( -2) 0.00% 373212 1.14.23 68507.047162100 SOL (0.02%)
G9qsqKnvR77FAmcLtcrkMrFvcDGoQ7LQB5xaXc7mD83u A2XnPCfYMt8inTUX3DhbVZ6ZW7pmXquLKJ1knGupjaKS 10% 215952432 ( -3) 215952401 ( -3) 8.93% 363133 1.14.24 68699.255295438 SOL (0.02%)
Fc6NNdS2j3EmrWbU6Uqt6wsKB5ef72NjaWfNxKYbULGD 2tucttroqFNXsrYeMBQ8LfzKNfgwT2rHBzAF6RzbbHEp 0% 215952430 ( -5) 215952399 ( -5) 68.42% 372392 1.14.24 200318.059829372 SOL (0.05%)