Open
Description
Some models' chat template looks like this:
......
{% if add_generation_prompt %}<|assistant|>
<think>{% endif %}
I'm hoping for this feature of after applying chat template, detect if last few chars are "<think>"(which can be set in "Reasoning Section Parsing")(+ last role is user to bypass if request is a role==assistant prefill) and process it in the LM Studio UI And send this "Start String"("<think>") back to API client in headless mode.
Metadata
Metadata
Assignees
Labels
No labels