8000 Commits · xiaotianzhang01/ScaleLLM · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Dec 10, 2023

added inja (header-only library) template engine to parse chat template.
guocuimi
committed

Commits on Dec 8, 2023

moved top_p and top_k into sampler
guocuimi
committed

Commits on Dec 7, 2023

Commits on Dec 6, 2023

pass in token count directly to avoid using bincout in FrequencyPresencePenalty and simplify logics in kernel.
guocuimi
committed

Commits on Dec 5, 2023

Commits on Dec 4, 2023

[refactor] move hf model download logic into seperate python file; implement auto-download of safetensors in preference to pickles.
guocuimi
committed

Commits on Dec 3, 2023

Commits on Nov 30, 2023

added exception handling logic for http server to handle partial request, and updated readerme for docker image version.
guocuimi
committed

Commits on Nov 23, 2023

Commits on Nov 15, 2023

set up QEMU and Buildx for multiple platforms
guocuimi
committed

Commits on Nov 11, 2023

Commits on Nov 8, 2023

Commits on Nov 7, 2023

0