8000 draft: fp8 block scaling by jiemingz · Pull Request #543 · NVIDIA-NeMo/RL · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

draft: fp8 block scaling #543

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

draft: fp8 block scaling #543

wants to merge 4 commits into from

Conversation

jiemingz
Copy link
Contributor

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Issues

List issues that this PR closes (syntax):

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

@jiemingz jiemingz force-pushed the jiemingz/fp8_block branch from 1dc0e0b to b972ee9 Compare June 24, 2025 18:06
@jiemingz
block scaling
eaf3498 
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
@jiemingz jiemingz force-pushed the jiemingz/fp8_block branch from b972ee9 to a677cc1 Compare June 25, 2025 18:47
@jiemingz
big fixes
381c406 
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
@jiemingz jiemingz force-pushed the jiemingz/fp8_block branch from a677cc1 to 381c406 Compare June 25, 2025 18:50
@jiemingz
fix pow2
5b9c1ba 
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
@jiemingz jiemingz force-pushed the jiemingz/fp8_block branch from fb57ec1 to 5b9c1ba Compare June 26, 2025 14:35
@jiemingz
use deepgemm
37e1dd4 
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jiemingz
0