8000 [Ray: Serve] Model Composition primitives should be part of Serve Core API docs. · Issue #32837 · ray-project/ray · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[Ray: Serve] Model Composition primitives should be part of Serve Core API docs. #32837
New issue
New issue
Open
Open
[Ray: Serve] Model Composition primitives should be part of Serve Core API docs.#32837
Labels
P2Important issue, but not time-criticaldocsAn issue or change related to documentationpending-cleanupThis issue is pending cleanup. It will be removed in 2 weeks after being assigned.serveRay Serve Related Issue
@dmatrix

Description

@dmatrix
dmatrix
opened on Feb 25, 2023

Description

Model composition APIs are incomplete as part of ray.serve.* API docs. While we have examples for all those deployment patterns, there are no API docs or code snippets for any of the primitives: InputNode, Model, DAGDriver, etc.

We have spoken at length about model composition at meetups and conferences, yet no complete & comprehensive API docs. Let's make all this part of our efforts to improve Ray Serve developer UX experience.

Link

This API page is incomplete
This Serve API page should be comprehensive and should include all the APIs we use in your deployment graph examples

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issue, but not time-criticaldocsAn issue or change related to documentationpending-cleanupThis issue is pending cleanup. It will be removed in 2 weeks after being assigned.serveRay Serve Related Issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions
      0