Replies: 2 comments 2 replies
-
|
Great question! torchtune is very flexible so most transformer models provided by the Hugging Face hub should work; however, you may need to define your own model component that plugs into the recipe (very easy). The models we provide under Is there a certain model you want to use that isn't covered by |
Beta Was this translation helpful? Give feedback.
-
|
Wanted to try out full fine-tuning for some smaller models like SmolLM2. Will try out according to what you suggested. Thanks. |
Beta Was this translation helpful? Give feedback.
-
|
Awesome, LMK how it goes! You can also probably get quicker responses from me and the team on Discord btw. |
Beta Was this translation helpful? Give feedback.
-
|
That's great to hear. Will surely join it. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Is it possible to download and fine-tune any model in Hugging Face by providing the token or only models listed under
torchtune.modelsare accessible?Beta Was this translation helpful? Give feedback.
All reactions