8000 Change available sampling parameters depending on API · Issue #465 · PAIR-code/deliberate-lab · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Change available sampling parameters depending on API #465
Open
@mkbehr

Description

@mkbehr

As of today, we have frequency penalty and presence penalty parameters that can be passed through to Gemini and OpenAI APIs, but they'll be ignored for Ollama. That could confuse experimenters. The confusion could get worse if we ever add support for more complicated parameters with less-broad support (e.g. mirostat, min p). Ideally we'd note which APIs support which parameters, and only display applicable ones.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0