8000 [RayLLM] RayLLM / vLLM production stack integration · Issue #53331 · ray-project/ray · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings
[RayLLM] RayLLM / vLLM production stack integration #53331
New issue
New issue
Closed
Closed
[RayLLM] RayLLM / vLLM production stack integration#53331
Labels
enhancementRequest for new feature and/or capabilityllmquestionJust a question :)serveRay Serve Related IssuetriageNeeds triage (eg: priority, bug/not-bug, and owning component)usability
@kevin85421

Description

@kevin85421
kevin85421
opened on May 27, 2025

Description

https://discuss.ray.io/t/ray-serve-integration-with-production-stack/22553

Is there a plan that Ray would integrate with vllm production-stack as both have a router?

Use case

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementRequest for new feature and/or capabilityllmquestionJust a question :)serveRay Serve Related IssuetriageNeeds triage (eg: priority, bug/not-bug, and owning component)usability

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions
      0