8000 Speedup refit by guyueh1 · Pull Request #519 · NVIDIA-NeMo/RL · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Speedup refit #519

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 13 commits into
base: yifu/deepseek_ep
Choose a base branch
from
Open

Speedup refit #519

wants to merge 13 commits into from

Conversation

guyueh1
Copy link
@guyueh1 guyueh1 commented Jun 16, 2025

What does this PR do ?

Accelerate the refit phase of large models.

Issues

List issues that this PR closes (syntax):

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

guyueh1 and others added 13 commits June 12, 2025 13:57
@guyueh1
Debug
3195207 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Run get_weights_for_ipc and get key map once for all
0d19e3a 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Tag version that seems to be working
ffb8b66 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Fix: use new weight param info every step
a096eff 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Cleanup
ce3429b 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
bugfix
e07e067 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Add more time logs
ed4d3cb 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@ZhiyuLi-Nvidia @guyueh1
profile reshard only
3dfe6e5 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Cleanup
0edfb89 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Rm redundant sync
20aeffd 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Cleanup
f0c12eb 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Fix dynamic batching corner case
da026c4 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
@guyueh1
Pack tensor at megatron worker and unpack at vllm worker
1b9696a 
Signed-off-by: Guyue Huang <guyueh@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@guyueh1 @ZhiyuLi-Nvidia
0