8000 Add support for TII Falcon and Meditron LLM's by Smartappli · Pull Request #921 · serge-chat/serge · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add support for TII Falcon and Meditron LLM's #921

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 23 commits into from
Dec 1, 2023
Merged

Add support for TII Falcon and Meditron LLM's #921

merged 23 commits into from
Dec 1, 2023

Conversation

Smartappli
Copy link
Contributor
@Smartappli Smartappli commented Nov 30, 2023 •
edited
Loading

Add Falcon 180B-Chat
Add Falcon 180B
Add Falcon 40B
Add Falcon 40B-Instruct
Add Falcon 7B
Add Falcon 7B-Instruct

@gaby
Copy link
Member
gaby commented Dec 1, 2023

@Smartappli Thank you for the PR, are there any other smaller falcon models that could also be added on this PR? Thanks!

@Smartappli Smartappli changed the title Falcon 180 B Falcon 180B-Chat, Falcon 180B, Falcon 40B, Falcon 40B-Instruct, Falcon 7B, Falcon 7B-Instruct Dec 1, 2023
@gaby
Copy link
Member
gaby commented Dec 1, 2023

Some of the models are missing the "repo" key/value.

@Smartappli
Copy link
Contributor Author

Some of the models are missing the "repo" key/value.

Fixed, Thanks

gaby
gaby reviewed Dec 1, 2023
View reviewed changes
gaby
gaby reviewed Dec 1, 2023
View reviewed changes
gaby
gaby reviewed Dec 1, 2023
View reviewed changes
@Smartappli
Update models.json
4c5ad90 
Add Meditron 70B
@Smartappli
Update README.md
a921a11 
Add Meditron 70B
@gaby gaby changed the title Falcon 180B-Chat, Falcon 180B, Falcon 40B, Falcon 40B-Instruct, Falcon 7B, Falcon 7B-Instruct Add support for TII Falcon LLM's Dec 1, 2023
@gaby
Copy link
Member
gaby commented Dec 1, 2023

@Smartappli _ test_model_available[maddes8cht/tiiuae-falcon-40b-instruct-gguf-tiiuae-falcon-40b-Q4_K_M.gguf] _

It cant find that model

@gaby gaby changed the title Add support for TII Falcon LLM's Add support for TII Falcon and Meditron LLM's Dec 1, 2023
@gaby
Copy link
Member
gaby commented Dec 1, 2023

@Smartappli Models will be available in the next release, which is probably due this weekend. Thanks!

@gaby gaby merged commit a4c7e8e into serge-chat:main Dec 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gaby gaby gaby left review comments

Assignees
No one assigned
Labels
🧠 Models
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Smartappli @gaby
0