8000 feat: add Q4_0 avx2 version by foxever · Pull Request #209 · crabml/crabml · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

feat: add Q4_0 avx2 version #209

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Dec 28, 2024
Merged

feat: add Q4_0 avx2 version #209

merged 1 commit into from
Dec 28, 2024

Conversation

foxever
Copy link
Contributor
@foxever foxever commented Dec 28, 2024 •
edited
Loading
  • avx2 test is green, the ci workflow only setup in my fork repo, however, its performance is not ready to make a PR,
  • after made some investigation, huggingface/candle has implement a more complete quantized api set which is quite similar to current crabml's, fyi.

@flaneur2020 flaneur2020 merged commit a8615ea into crabml:main Dec 28, 2024
2 checks passed
@flaneur2020
Copy link
Collaborator

much appreciate for your contribution!

by the way, would you be interested in joining the crabml as a committer? I have sent you an invitation. please feel free to accept it at your convenience 🫡

@foxever
Copy link
Contributor Author
foxever commented Dec 29, 2024 •
edited
Loading

much appreciate for your contribution!

by the way, would you be interested in joining the crabml as a committer? I have sent you an invitation. please feel free to accept it at your convenience 🫡

It's my pleasure to join the project, thank you for the invitation!

@foxever
Copy link
Contributor Author
foxever commented Dec 29, 2024

close #174

@foxever foxever mentioned this pull request Dec 29, 2024
Closed
@foxever foxever deleted the feat/q4_0-avx2 branch December 30, 2024 00:48
iGxnon pushed a commit to iGxnon/crabml that referenced this pull request Feb 1, 2025
@foxever @iGxnon
feat: add Q4_0 avx2 version (crabml#209)
6422416
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@foxever @flaneur2020
0