8000 Strategy for enabling memtries during stateful-to-stateless validation protocol upgrade · Issue #11240 · near/nearcore · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Strategy for enabling memtries during stateful-to 8000 -stateless validation protocol upgrade #11240

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tayfunelmas opened this issue May 6, 2024 · 3 comments
Assignees
Labels
A-stateless-validation Area: stateless validation

Comments

@tayfunelmas
Copy link
Contributor
tayfunelmas commented May 6, 2024

Identify the right way to enable memtrie during the stateful-to-stateless validation protocol upgrade.
Before the upgrade all nodes will track all shards and they will start tracking only one or some shards after the upgrade. Memtrie is expected to be enabled in the case of tracking single or some shards, as it requires more memory. However, we may also need to think about how to make the transition from (stateful + disk tries) to (stateless + memtries). During this, we may need to run nodes with memtries while tracking all shards. Assuming this is the path to follow, we need to follow-ups.

  1. Profile the memory usage needed to do that (a similar task opened for RPC nodes tracking all nodes:
    Profile memory usage requirements of RPC and archival nodes in stateless validation #11230)

  2. Make sure after the protocol upgrade the memtries for the shards that are not tracked in the new epoch are unloaded, leaving the nodes only with memtries for their tracked shards.

Related thread here.

@tayfunelmas tayfunelmas added the A-stateless-validation Area: stateless validation label May 6, 2024
@tayfunelmas
Copy link
Contributor Author

Since @robin-near is involved in the initial discussions around this, assigning to Robin for now.

@tayfunelmas tayfunelmas changed the title Enabling memtries during stateful-to-stateless validation protocol upgrade Strategy for enabling memtries during stateful-to-stateless validation protocol upgrade May 6, 2024
@walnut-the-cat
Copy link
Contributor

we already have near/near-one-project-tracking#65 so we will want to clean one of them up

@robin-near
Copy link
Contributor

Closing this as it's tracked in near/near-one-project-tracking#65

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-stateless-validation Area: stateless validation
Projects
None yet
Development

No branches or pull requests

3 participants
2ABE
0