Tags: x22x22/vllm
Tags
[Misc] Slight improvement of the BNB (vllm-project#19418) Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: Isotr0py <2037008807@qq.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
[Misc] Slight improvement of the BNB (vllm-project#19418) Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Co-authored-by: Isotr0py <2037008807@qq.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
[Misc] Fix a config typo in disable_hybrid_kv_cache_manager configura… …tion (vllm-project#19383) Signed-off-by: Siyuan Liu <lsiyuan@google.com>
[BugFix] FA2 MLA Accuracy Issue (vllm-project#18807) Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
[Bugfix] Mistral tool calling when content is list (vllm-project#18729) Signed-off-by: mgoin <mgoin64@gmail.com>
[BugFix][Attention] Fix sliding window attention in V1 giving incorre… …ct results (vllm-project#17574) Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
PreviousNext