8000 GitHub · Where software is built
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Support HTTPRoute -> InferencePool Directly #648
Open
@robscott

Description

@robscott

Description:
All of the OSS Inference Extension docs focus on a common use case where a HTTPRoute points directly to an InferencePool. This expectation is now being translated into conformance tests. To ensure Envoy AI Gateway can pass those conformance tests, it would be useful if it supported this direct attachment model from HTTPRoute -> InferencePool.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0