Please write better docs #1045
Replies: 1 comment 5 replies
-
|
Totally agree with the sentiment, we're constantly working to improve our docs :) anything in particular that frustrates you? |
Beta Was this translation helpful? Give feedback.
-
|
How about some examples of using custom datasets. |
Beta Was this translation helpful? Give feedback.
-
|
Please see the documentation here: https://pytorch.org/torchtune/main/tutorials/datasets.html#custom-unstructured-text-corpus, especially the "custom" sections and "Local and remote datasets". Let me know if anything is still not clear. For more visibility, we are planning an overhaul of our README to provide more quick examples and links to our docs. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I’ve been trying to load my custom dataset from Hugging Face, which is in the ShareGPT conversational style, and convert it to the Llama2Chat format using Torchtune. However, I’m encountering some issues and it’s not working as expected. From my understanding, Torchtune should handle the conversion from the ShareGPT format to the Llama2Chat format if the dataset is structured correctly. Do you have any code examples that demonstrate this process? I haven't been able to find any specific examples showing how to achieve this. Thanks for your help! |
Beta Was this translation helpful? Give feedback.
-
|
If I'm understanding what you're trying to do correctly, you have a dataset in the sharegpt sytle and you want to use it with llama2 chat format? You should be able to do this: dataset:
_component_: torchtune.datasets.chat_dataset
source: hf/custom_dataset
split: train
conversation_style: sharegpt
chat_format: torchtune.data.Llama2ChatFormatLet me know if that helps. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you, will try that out and let you know if it doesn't work. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
That is all
Beta Was this translation helpful? Give feedback.
All reactions