8000 gemma-3-12b-pt-8bit is missing a chat processor · Issue #338 · Blaizzy/mlx-vlm · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

gemma-3-12b-pt-8bit is missing a chat processor #338

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jrp2014 opened this issue May 4, 2025 · 0 comments
Open

gemma-3-12b-pt-8bit is missing a chat processor #338

jrp2014 opened this issue May 4, 2025 · 0 comments

Comments

@jrp2014
Copy link
jrp2014 commented May 4, 2025

Presumably this is a model configuration issue, rather than an mlx-vlm one?

2025-05-04 22:22:25,344 - INFO - Processing '20250503-170407_DSC03793_DxO.jpg' with model: mlx-community/gemma-3-12b-pt-8bit
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
Fetching 13 files: 100%|█████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 32092.97it/s]
Fetching 13 files: 100%|██████████████████████████████████████████████████████████████| 13/13 [00:00<00:00, 8024.42it/s]
2025-05-04 22:23:04,029 - ERROR - Failed during 'model_load' for model mlx-community/gemma-3-12b-pt-8bit: ValueError: No chat template is set for this processor. Please either set the `chat_template` attribute, or provide a chat template as an argument. See https://huggingface.co/docs/transformers/main/en/chat_templating for more information.
[FAIL] gemma-3-12b-pt-8bit (Stage: model_load)
  ERROR: Model gemma-3-12b-pt-8bit failed during 'model_load'.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant
0