Permalink
Comparing changes
Choose two branches to see what’s changed or to start a new pull request.
If you need to, you can also or
learn more about diff comparisons.
Open a pull request
Create a new pull request by comparing changes across two branches. If you need to, you can also .
Learn more about diff comparisons here.
...
- 7 commits
- 3 files changed
- 2 contributors
Commits on Jun 10, 2024
-
Add examples dir and model to Dockerfile
This makes two changes to the vLLM openai-compatible Dockerfile: * Copies the examples dir into the vllm-workspace so we can load the jinja2 template specifying the prompt * Copies our model (assumed to be in quantllavatest/) into the image, assuming we just bake the model in for now
-
-
-
Update model to vllm-2024.06.03-17.19.58_sweep=nubamebd_77074817cb24_…
…ckpt-800-quantized
-
Work around error reading VLLM_PORT tcp://a.b.c.d:8000
For some reason VLLM_PORT gets set as a full url
Commits on Aug 20, 2024
Commits on Oct 19, 2024
Loading
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff main...main