https://huggingface.co/axolotl-ai-co/deepseek-v3-8b

#1402
by saipangon - opened

https://huggingface.co/axolotl-ai-co/deepseek-v3-8b
Do something for this model, people :D

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#deepseek-v3-8b-GGUF for quants to appear.

This model unfortunately failed with the following error during SafeTensors to GGUF conversion:

WARNING:gguf.gguf_writer:Duplicated key name 'deepseek2.attention.key_length', overwriting it with new value 256 of type UINT32
WARNING:gguf.gguf_writer:Duplicated key name 'deepseek2.attention.value_length', overwriting it with new value 192 of type UINT32
Traceback (most recent call last):
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 9178, in <module>
    main()
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 9172, in main
    model_instance.write()
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 440, in write
    self.prepare_metadata(vocab_only=False)
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 536, in prepare_metadata
    super().prepare_metadata(vocab_only=vocab_only)
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 430, in prepare_metadata
    self.set_gguf_parameters()
  File "/llmjob/llama.cpp/convert_hf_to_gguf.py", line 6539, in set_gguf_parameters
    if hparams["scoring_func"] == "sigmoid":
KeyError: 'scoring_func'
job finished, status 1
job-done<0 deepseek-v3-8b noquant 1>

error/1 KeyError: 'scoring_func'
https://huggingface.co/axolotl-ai-co/deepseek-v3-8b

Sign up or log in to comment