8000 [Unified Checkpoint] Checkpoint compression (#9183) by wtmlon · Pull Request #9490 · PaddlePaddle/PaddleNLP · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[Unified Checkpoint] Checkpoint compression (#9183) #9490

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Nov 25, 2024
Merged

[Unified Checkpoint] Checkpoint compression (#9183) #9490

merged 1 commit into from
Nov 25, 2024

Conversation

wtmlon
Copy link
Collaborator
@wtmlon wtmlon commented Nov 25, 2024

  • checkpoint compression init

  • add ckpt quant argument

  • add ckpt quant ci

  • fix ci

  • fix lint

  • remove stage O2, change O3 --> O2

  • support async save

  • file adjustment

  • magic string remove

  • ci fix

  • ci fix, code refinement

  • function extraction

  • fix ci

  • code refinement

  • fix ci

  • fix ci

  • support non merge tp ckpt quantization

  • fix ci

  • update

  • fix bug

  • code refactor

  • fix lint

  • fix ci

  • del old uc.py

  • fix lint

  • add mgpu ci

  • fix ci

  • multi thread loading

  • fix lint

  • fix bug

  • refactor code

  • add comment

  • fix lint

  • add comment

  • add comment

  • fix bug

  • fix bugs when ckpt no quant and no master weight

  • remove uni-test Conflicts:
    paddlenlp/transformers/model_utils.py

PR types

PR changes

Description

PR cherry-pick

@wtmlon
[Unified Checkpoint] Checkpoint compression (PaddlePaddle#9183)
aaba396 
* checkpoint compression init

* add ckpt quant argument

* add ckpt quant ci

* fix ci

* fix lint

* remove stage O2, change O3 --> O2

* support async save

* file adjustment

* magic string remove

* ci fix

* ci fix, code refinement

* function extraction

* fix ci

* code refinement

* fix ci

* fix ci

* support non merge tp ckpt quantization

* fix ci

* update

* fix bug

* code refactor

* fix lint

* fix ci

* del old uc.py

* fix lint

* add mgpu ci

* fix ci

* multi thread loading

* fix lint

* fix bug

* refactor code

* add comment

* fix lint

* add comment

* add comment

* fix bug

* fix bugs when ckpt no quant and no master weight

* remove uni-test
Conflicts:
	paddlenlp/transformers/model_utils.py
@paddle-bot Paddle-bot
Copy link
paddle-bot bot commented Nov 25, 2024

Thanks for your contribution!

@wtmlon wtmlon requested a review from DesmonDay November 25, 2024 07:52
@codecov Codecov
Copy link
codecov bot commented Nov 25, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 12.38095% with 276 lines in your changes missing coverage. Please review.

Project coverage is 52.62%. Comparing base (5861dfc) to head (aaba396).
Report is 37 commits behind head on release/3.0-beta2.

Files with missing lines Patch % Lines
...enlp/quantization/checkpoint_quantization_utils.py 9.17% 99 Missing ⚠️
...lp/quantization/unified_checkpoint_quantization.py 7.29% 89 Missing ⚠️
...p/trainer/unified_checkpoint/unified_checkpoint.py 2.85% 34 Missing ⚠️
paddlenlp/trainer/unified_checkpoint/utils.py 7.69% 24 Missing ⚠️
paddlenlp/trainer/unified_checkpoint/load_local.py 6.66% 14 Missing ⚠️
paddlenlp/transformers/model_utils.py 40.00% 12 Missing ⚠️
paddlenlp/trainer/trainer_utils.py 33.33% 2 Missing ⚠️
...dlenlp/trainer/unified_checkpoint/async_handler.py 33.33% 2 Missing ⚠️
Additional details and impacted files 
@@                  Coverage Diff                  @@
##           release/3.0-beta2    #9490      +/-   ##
=====================================================
- Coverage              52.73%   52.62%   -0.11%     
=====================================================
  Files                    667      669       +2     
  Lines                 107053   107338     +285     
=====================================================
+ Hits                   56455    56489      +34     
- Misses                 50598    50849     +251

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

DesmonDay
DesmonDay approved these changes Nov 25, 2024
View reviewed changes
Copy link
Contributor
@DesmonDay DesmonDay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DesmonDay DesmonDay merged commit 4c622f3 into PaddlePaddle:release/3.0-beta2 Nov 25, 2024
5 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@DesmonDay DesmonDay DesmonDay approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@wtmlon @DesmonDay
0