Open
Description
I reached out on Gitter but I'm not sure if that's still actively used:
With all the LLM and VLM models announced and released recently, are there thoughts or plans around supporting those types of models in DeepDetect? I'm specifically most interested in multimodal models like the new HuggingFace SmolVLM Instruct models and Microsoft Florence-2 vision models, both based on the HuggingFace Transformers library.
SmolVLM is available as a variety of ONNX models, while Florence-2 is available as pytorch .bin, both with their own set of various configs for the model, tokenizers, preprocessors, etc, so I'm not sure how much (or which) is viable for use in DeepDetect.