8000 Commits · errord/vllm · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Apr 12, 2025

[BugFix] Handle non-contiguous tensors properly when serializing (#16492)
njhill
authored

Commits on Apr 10, 2025

[V1] Zero-copy tensor/ndarray serialization/transmission (#13790)
njhill
authored

Commits on Apr 7, 2025

[V1][BugFix] Exit properly if engine core fails during startup (#16137)
njhill
authored

Commits on Apr 4, 2025

[V1] DP scale-out (1/N): Use zmq ROUTER/DEALER sockets for input queue (#15906)
njhill
authored

Commits on Mar 29, 2025

[Misc][V1] Misc code streamlining (#15723)
njhill
authored

Commits on Mar 27, 2025

[V1] AsyncLLM data parallel (#13923)
njhill
authored

Commits on Mar 26, 2025

[V1][Sampler] Faster top-k only implementation (#15478)
njhill
authored

Commits on Mar 25, 2025

[V1][Minor] Use `SchedulerInterface` type for engine scheduler field (#15499)
njhill
authored

Commits on Mar 24, 2025

Commits on Mar 21, 2025

[V1] Avoid redundant input processing in n>1 case (#14985)
njhill
authored

Commits on Mar 20, 2025

[BugFix] Lazily import XgrammarBackend to avoid early cuda init (#15171)
njhill
authored

Commits on Mar 19, 2025

[FrontEnd][Perf] `merge_async_iterators` fast-path for single-prompt requests (#15150)
njhill
authored

Commits on Mar 16, 2025

Commits on Mar 14, 2025

[Misc][Minor] Simplify `SamplingParams.__post_init__()` (#14772)
njhill
authored

Commits on Mar 12, 2025

[BugFix][V1] Fix parallel sampling finishing/aborts (#14512)
njhill
authored

Commits on Mar 7, 2025

[V1] Eagerly remove finished requests from the batch (#14388)
njhill
authored

Commits on Mar 5, 2025

Commits on Mar 4, 2025

[V1][BugFix] Fix remaining sync engine client shutdown errors/hangs (#13869)
njhill
authored

Commits on Mar 3, 2025

[V1] Simplify stats logging (#14082)
njhill
authored

Commits on Feb 23, 2025

Commits on Feb 21, 2025

[V1][Sampler] Avoid an operation during temperature application (#13587)
njhill
authored

Commits on Feb 20, 2025

[BugFix] Avoid error traceback in logs when V1 `LLM` terminates (#13565)
njhill
authored

Commits on Feb 19, 2025

[V1][Core] Generic mechanism for handling engine utility (#13060)
njhill
authored

Commits on Feb 18, 2025

[V1] Optimize handling of sampling metadata and req_ids list (#13244)
njhill
authored

Commits on Feb 15, 2025

Commits on Feb 14, 2025

[V1] Simplify GPUModelRunner._update_states check (#13265)
njhill
authored

Commits on Feb 10, 2025

[V1] Use msgpack for core request serialization (#12918)
njhill
authored

Commits on Feb 5, 2025

[V1][Misc] Shorten `FinishReason` enum and use constant strings (#12760)
njhill
authored

Commits on Jan 24, 2025

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

njhill
and
Robert Shaw
authored

0