AngelSlim/DeepSeek-R1-0528_w4a8_fp8
363B
•
Updated
•
11
•
2
Deepseek-quant
The collection of quantization models of DeepSeek and Deepseek_r1_distill
-
-
AngelSlim/Deepseek_r1_distill_qwen-1_5b_fp8_static
Updated • 18 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_awq
2B • Updated • 7 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_gptq
2B • Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_awq
15B • Updated • 5 -
AngelSlim/Deepseek_r1_distill_qwen-14b_fp8_static
15B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_gptq
15B • Updated • 42 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_gptq
33B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_gptq
8B • Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_awq
8B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_awq
33B • Updated • 12 -
AngelSlim/Deepseek_r1_distill_qwen-7b_fp8_static
8B • Updated • 16 -
AngelSlim/Deepseek_r1_distill_qwen-32b_fp8_static
33B • Updated • 5