https://huggingface.co/axolotl-ai-co/deepseek-v3-8b
#1402
by
saipangon
- opened
It's queued! :D
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#deepseek-v3-8b-GGUF for quants to appear.
This model unfortunately failed with the following error during SafeTensors to GGUF conversion:
WARNING:gguf.gguf_writer:Duplicated key name 'deepseek2.attention.key_length', overwriting it with new value 256 of type UINT32
WARNING:gguf.gguf_writer:Duplicated key name 'deepseek2.attention.value_length', overwriting it with new value 192 of type UINT32
Traceback (most recent call last):
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 9178, in <module>
main()
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 9172, in main
model_instance.write()
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 440, in write
self.prepare_metadata(vocab_only=False)
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 536, in prepare_metadata
super().prepare_metadata(vocab_only=vocab_only)
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 430, in prepare_metadata
self.set_gguf_parameters()
File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 6539, in set_gguf_parameters
if hparams["scoring_func"] == "sigmoid":
KeyError: 'scoring_func'
job finished, status 1
job-done<0 deepseek-v3-8b noquant 1>
error/1 KeyError: 'scoring_func'
https://huggingface.co/axolotl-ai-co/deepseek-v3-8b