Open
Description
Hi Micah, I created a pull request to allow cross-region inference, as the existing code does a model-ID check and doesn't allow using CRIS profiles as far as I could tell. The implementation is detailed in the pull request, so adding this issue to track officially adding CRIS support. I am offering the pull request as my own implementation, but you may have a better way.
Newer models like Claude Sonnet 3.7 are only available using CRIS, which was the motivation for the update.
Thanks,
Wallace
Metadata
Metadata
Assignees
Labels
No labels