Added a hardcoded list of computer use models for litellm as a fallba… #4052
Conversation
…ck for older litellm versions
|
So it’s not loaded dynamically? |
It's still loaded dynamically. This is a fallback if they're running an old version of litellm, which was a good callout. So:
I'm not set on this being how we do it, it's just an option |
|
I thought they were saying that old versions of LiteLLM would also load the config file dynamically. Did you have a chance to try? |
I checked with an older version and supports_computer_use just isn't present in /v1/models/info - I suspected that based on the code I had to change but I should have double checked it manually sooner I think the part of the PR that was necessary was https://github.com/BerriAI/litellm/blob/acaa80294c2c86892a80f49bc15994393f869300/litellm/utils.py#L4502 - so maybe they meant values of properties are loaded via the config but entirely new properties aren't |
Description
This adds a hardcoded list of litellm computer use models as a fallback for users still on an older litellm verison before supports_computer_use was added to the v1/model/info endpoint
Test Procedure
Type of Change
Pre-flight Checklist
npm test) and code is formatted and linted (npm run format && npm run lint)npm run changeset(required for user-facing changes)Screenshots
Additional Notes
Important
Adds a hardcoded fallback list for computer use models in LiteLLM to handle older versions lacking
supports_computer_use.LITELLM_COMPUTER_USE_MODELSinapi.tsfor fallback in older LiteLLM versions.getLiteLLMModelsinlitellm.tsto use fallback list whensupports_computer_useis missing.supports_computer_useover fallback.litellm.test.tsfor fallback detection and prioritization of explicitsupports_computer_use.This description was created by
for 870b0a0. You can customize this summary. It will automatically update as commits are pushed.