8000 Allow uneven shards for multi-GPU inference in vllm backend by KiddoZhu · Pull Request #494 · NVIDIA-NeMo/RL · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Allow uneven shards for multi-GPU inference in vllm backend#494

Merged
SahilJain314 merged 2 commits intomainfrom
zhaochengz/multi-gpu_eval
Jun 27, 2025
Merged

Allow uneven shards for multi-GPU inference in vllm backend#494
SahilJain314 merged 2 commits intomainfrom
zhaochengz/multi-gpu_eval

Commits

Commits on Jun 9, 2025

Commits on Jun 26, 2025
0