8000 Commits · stone-wlg/vllm · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Apr 21, 2025

~~[TPU][V1] Implicitly adjust page size when there's SMEM OOM (#16871)~~
~~yaochengji~~
~~authored~~
~~[V1][Spec Decode] Handle draft tokens beyond max_model_len (#16087)~~
~~WoosukKwon~~
~~authored~~
~~[Core] Speed up decode by remove synchronizing operation in sampler (#16436)~~

chanh
and
Chanh Nguyen
authored
~~[Doc] mention how to install in CPU editable mode (#16923)~~
~~davidxia~~
~~authored~~
~~[doc] install required python3-dev apt package (#16888)~~
~~davidxia~~
~~authored~~
~~[XPU][Bugfix] minor fix for XPU (#15591)~~
~~yma11~~
~~authored~~
~~Raise error for data-parallel with benchmark_throughput (#16737)~~

kartikx
and
simon-mo
authored
~~[Bugfix] Fix GLM rotary_dim issue and support v1 (#16912)~~
~~Isotr0py~~
~~authored~~
~~[Misc] Refactor platform to get device specific stream and event (#14411)~~
~~shen-shanshan~~
~~authored~~
~~[Misc] fix collect_env version parse (#15267)~~
~~wangxiyuan~~
~~authored~~
~~Restore buffers when wake up from level 2 sleep (#16564) (#16889)~~
~~fingertap~~
~~authored~~
~~[Doc] Split dummy_processor_inputs() in Multimodal Docs (#16915)~~
~~alex-jw-brooks~~
~~authored~~
~~[Bugfix] Fix distributed bug in Qwen2.5-VL & Qwen2.5-Omni (#16907)~~
~~fyabc~~
~~authored~~
~~[CI/CD][V1] Add spec decode tests to CI (#16900)~~
~~WoosukKwon~~
~~authored~~
~~[Bugfix] Fix v1/spec_decode/test_ngram.py (#16895)~~
~~zixi-qi~~
~~authored~~

Commits on Apr 20, 2025

~~[easy] Pass compile_fx only the config patches (#16845)~~
~~zou3519~~
~~authored~~
~~Improve configs - `CacheConfig` (#16835)~~
~~hmellor~~
~~authored~~

Commits on Apr 19, 2025

~~Serialize tensors using int8 views (#16866)~~

p88h
and
njhill
authored
~~Log how much time loading a compiled artifact takes (#16848)~~
~~zou3519~~
~~authored~~
~~[doc] update hyperlink (#16877)~~
~~reidliu41~~
~~authored~~
~~[VLM] Clean up models (#16873)~~
~~DarkLight1337~~
~~authored~~
~~[Model] Qwen2.5-Omni Cleanup (#16872)~~
~~ywang96~~
~~authored~~
~~[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477)~~

Isotr0py
and
DarkLight1337
authored
~~[V1][Misc] stop update prefix cache stats when logs_stats is disabled (#16460)~~
~~vie-serendipity~~
~~authored~~
~~[Misc] Benchmarks for audio models (#16505)~~
~~NickLucche~~
~~authored~~
~~[Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591)~~

NickLucche
and
joennlae
authored
~~[rocm][MI300] llama4 maverick fp8 moe config tp8 (#16847)~~
~~divakar-amd~~
~~authored~~
~~[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130)~~

~~authored~~
~~[release] Publish neuron docker image (#16733)~~
~~omrishiv~~
~~authored~~

~~Previous~~

~~Next~~

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms

Privacy

Security

Status

Docs

Contact

0