8000 Commits · noooop/vllm · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Mar 25, 2025

[bugfix] add supports_v1 platform interface (#15417)
joerunde
authored

Commits on Mar 13, 2025

[bugfix] fixup warning message for plugged schedulers for v1 (#14700)
joerunde
authored

Commits on Mar 12, 2025

[core][V1] pluggable scheduler (#14466)
joerunde
authored

Commits on Feb 26, 2025

[Bugfix] Do not crash V0 engine on input errors (#13101)
joerunde
authored

Commits on Feb 20, 2025

[Frontend] Add backend-specific options for guided decoding (#13505)
joerunde
authored

Commits on Feb 14, 2025

[Core] Reduce TTFT with concurrent partial prefills (#10235)

authored

Commits on Jan 15, 2025

[Bugfix] use right truncation for non-generative tasks (#12050)
joerunde
authored

Commits on Jan 10, 2025

[Bugfix] Validate lora adapters to avoid crashing server (#11727)

joerunde
and
jeejeelee
authored

Commits on Jan 1, 2025

[Bugfix][Refactor] Unify model management in frontend (#11660)
joerunde
authored

Commits on Dec 18, 2024

[Bugfix] fix minicpmv test (#11304)
joerunde
authored

Commits on Dec 17, 2024

[Bugfix] Fix request cancellation without polling (#11190)
joerunde
authored

Commits on Dec 10, 2024

Commits on Nov 6, 2024

[V1] Make v1 more testable (#9888)
joerunde
authored

Commits on Nov 1, 2024

[Bugfix][Frontend] Reject guided decoding in multistep mode (#9892)
joerunde
authored

Commits on Oct 30, 2024

Commits on Oct 29, 2024

[Bugfix][Frontend] Guard against bad token ids (#9634)
joerunde
authored

Commits on Oct 22, 2024

:bug: Fixup more test failures from memory profiling (#9563)
joerunde
authored

Commits on Oct 19, 2024

Commits on Oct 18, 2024

[Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352)
joerunde
authored

Commits on Oct 1, 2024

[Frontend][Core] Move guided decoding params into sampling params (#8252)

joerunde
and
njhill
authored

Commits on Sep 25, 2024

[Bugfix] Use heartbeats instead of health checks (#8583)
joerunde
authored

Commits on Sep 18, 2024

[Bugfix] add `dead_error` property to engine client (#8574)
joerunde
authored

Commits on Sep 17, 2024

Commits on Sep 12, 2024

[Bugfix] Offline mode fix (#8376)
joerunde
authored

Commits on Sep 7, 2024

[CI/Build] Use python 3.12 in cuda image (#8133)
joerunde
authored

Commits on Aug 22, 2024

Commits on Aug 8, 2024

[Frontend] Kill the server on engine death (#6594)
joerunde
authored

Commits on Jun 29, 2024

[Kernel] Add punica dimensions for Granite 3b and 8b (#5930)
joerunde
authored

Commits on Jun 18, 2024

[Kernel] Add punica dimensions for Granite 13b (#5559)
joerunde
authored

0