llmd is a LLMs daemonset, it provide model manager and get up and running large language models, it can use llama.cpp or vllm or sglang to running large language models.
-
Updated
Feb 11, 2025 - Makefile
#
vllm
Here is 1 public repository matching this topic...
Improve this page
Add a description, image, and links to the vllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vllm topic, visit your repo's landing page and select "manage topics."