8000 [Serve] Make replica scheduler backoff configurable · Issue #52871 · ray-project/ray · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[Serve] Make replica scheduler backoff configurable #52871
New issue
New issue
Open
#53991
Open
[Serve] Make replica scheduler backoff configurable#52871
#53991
Labels
community-backlogenhancementRequest for new feature and/or capabilitygood-first-issueGreat starter issue for someone just starting to contribute to RayserveRay Serve Related IssuetriageNeeds triage (eg: priority, bug/not-bug, and owning component)
@akyang-anyscale

Description

@akyang-anyscale
akyang-anyscale
opened on May 8, 2025

Description

The backoff time when the replica scheduler fails to choose a replica is hardcoded. We should make this configurable by the user.

We should also lower the defaults.

Use case

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    community-backlogenhancementRequest for new feature and/or capabilitygood-first-issueGreat starter issue for someone just starting to contribute to RayserveRay Serve Related IssuetriageNeeds triage (eg: priority, bug/not-bug, and owning component)

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions
      0