How to load this model or its BF16 version using Transformers
#9
by
haoyang-amd
- opened
Hi, I'm li haoyang from AMD. Thank you for your outstanding work.
I'd like to know how to load this model or its BF16 version using Transformers. I noticed that Ministral-3-3B-Instruct-2512 can be loaded via Transformers, but its weight files differ significantly from the 675B version. Do you have plans to support it in Transformers?
I encountered an error when using this file(transformers/models/mistral3/convert_mistral3_weights_to_hf.py) for conversion, and I'm not sure if this script is valid.
We very much welcome community contributions to integrate mistral-large-3 in Transformers but this is not something we plan on doing from our side for now.
juliendenize
changed discussion status to
closed