8000 Commits · solrex/vllm · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Mar 27, 2025

[V1] Refactor num_computed_tokens logic (#15307)

comaniac
and
WoosukKwon
authored

Commits on Mar 21, 2025

[Misc] Better RayExecutor and multiprocessing compatibility (#14705)
comaniac
authored

Commits on Mar 19, 2025

[Misc][V1] Skip device checking if not available (#15061)
comaniac
authored

Commits on Mar 11, 2025

[Bugfix][V1][PP] Only warmup sampler at last PP rank (#14643)
comaniac
authored
[V1][PP] Do not block engine core when no requests to schedule (#14585)
comaniac
authored
[MISC][V1] Handle exception of current_platform.get_device_name() in arg_utils (#14379)
comaniac
authored

Commits on Mar 8, 2025

[MISC][V1] Register process killing handler only in the main thread (#14380)
comaniac
authored

Commits on Mar 5, 2025

[V1][Bugfix] Do not reset prefix caching metrics (#14235)
comaniac
authored

Commits on Mar 4, 2025

[Misc] Remove lru_cache in NvmlCudaPlatform (#14156)
comaniac
authored

Commits on Mar 3, 2025

[Build] Make sure local main branch is synced when VLLM_USE_PRECOMPILED=1 (#13921)
comaniac
authored

Commits on Feb 19, 2025

[MISC] Logging the message about Ray teardown (#13502)

comaniac
and
ruisearch42
authored

Commits on Feb 17, 2025

[V1][PP] Fix intermediate tensor values (#13417)
comaniac
authored

Commits on Feb 15, 2025

[V1][PP] Run engine busy loop with batch queue (#13064)
comaniac
authored

Commits on Feb 13, 2025

[Build] Automatically use the wheel of the base commit with Python-only build (#13178)
comaniac
authored

Commits on Feb 11, 2025

[V1][Metrics] Add GPU prefix cache hit rate % gauge (#12592)
comaniac
authored

Commits on Feb 3, 2025

Commits on Jan 31, 2025

Commits on Jan 23, 2025

[V1] Add `uncache_blocks` (#12333)
comaniac
authored

Commits on Jan 22, 2025

[Core] Support `reset_prefix_cache` (#12284)
comaniac
authored

Commits on Jan 6, 2025

[Bugfix] Remove block size constraint (#11723)
comaniac
authored

Commits on Dec 18, 2024

[V1] Prefix caching for vision language models (#11187)
comaniac
authored

Commits on Dec 14, 2024

[Bugfix][V1] Re-compute an entire block when fully cache hit (#11186)
comaniac
authored

Commits on Dec 13, 2024

Commits on Dec 12, 2024

[Misc] Validate grammar and fail early (#11119)
comaniac
authored

Commits on Nov 8, 2024

[V1] Prefix caching (take 2) (#9972)
comaniac
authored

Commits on Oct 18, 2024

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)
comaniac
authored

Commits on Oct 4, 2024

[Misc] Fix CI lint (#9085)
comaniac
authored

Commits on Sep 24, 2024

[MISC] Skip dumping inputs when unpicklable (#8744)
comaniac
authored

Commits on Sep 12, 2024

[MISC] Dump model runner inputs when crashing (#8305)
comaniac
authored

Commits on Sep 10, 2024

[MISC] Keep chunked prefill enabled by default with long context when prefix caching is enabled (#8342)
comaniac
authored

Commits on Sep 4, 2024

0