Open
Description
In this recent run for E2E (NVIDIA L40S x4) LLAMA
, vllm fails to start:
vLLM failed to start. Retry with --enable-serving-output to learn more about the failure.
Using unknown model family: meta-llama specified by user.
8000
In this recent run for E2E (NVIDIA L40S x4) LLAMA
, vllm fails to start:
vLLM failed to start. Retry with --enable-serving-output to learn more about the failure.
Using unknown model family: meta-llama specified by user.