Data-free quantization w/ Q-Palette
updated
bdbj/Llama-3.2-1B-qpal-df-tcq-4bit
0.5B • Updated
bdbj/Llama-3.2-1B-qpal-df-tcq-3.25bit
0.5B • Updated
• 1
bdbj/Llama-3.2-1B-qpal-df-tcq-3bit
0.4B • Updated
bdbj/Llama-3.2-1B-qpal-df-msq-4bit
0.5B • Updated
bdbj/Llama-3.2-1B-qpal-df-msq-3.25bit
0.5B • Updated
bdbj/Llama-3.2-1B-qpal-df-msq-3bit
0.4B • Updated
bdbj/Llama-3.2-3B-qpal-df-tcq-4bit
1B • Updated
bdbj/Llama-3.2-3B-qpal-df-tcq-3.25bit
1.0B • Updated
bdbj/Llama-3.2-3B-qpal-df-tcq-3bit
0.9B • Updated
bdbj/Llama-3.2-3B-qpal-df-msq-4bit
1B • Updated
bdbj/Llama-3.2-3B-qpal-df-msq-3.25bit
1.0B • Updated
bdbj/Llama-3.2-3B-qpal-df-msq-3bit
0.9B • Updated
bdbj/Llama-3.1-8B-qpal-df-tcq-4bit
3B • Updated
bdbj/Llama-3.1-8B-qpal-df-tcq-3.25bit
2B • Updated
bdbj/Llama-3.1-8B-qpal-df-tcq-3bit
2B • Updated
bdbj/Llama-3.1-8b-qpal-df-msq-4bit
3B • Updated
bdbj/Llama-3.1-8b-qpal-df-msq-3.25bit
2B • Updated
bdbj/Llama-3.1-8b-qpal-df-msq-3bit
2B • Updated
bdbj/Qwen2.5-7B-qpal-df-msq-4.25bit
3B • Updated
bdbj/Qwen2.5-7B-qpal-df-msq-4bit
3B • Updated
• 3
bdbj/Qwen2.5-7B-qpal-df-msq-3.75bit
3B • Updated
• 2
bdbj/Qwen2.5-7B-qpal-df-msq-3.5bit
3B • Updated
• 2
bdbj/Qwen2.5-7B-qpal-df-msq-3.25bit
2B • Updated
• 3
bdbj/Llama-3.1-70B-qpal-df-msq-4.25bit
20B • Updated
bdbj/Llama-3.1-70B-qpal-df-msq-4bit
19B • Updated
bdbj/Llama-3.1-70B-qpal-df-msq-3.63bit
17B • Updated
bdbj/Llama-3.1-70B-qpal-df-msq-3.4bit
16B • Updated
bdbj/Llama-3.1-70B-qpal-df-msq-3.25bit
16B • Updated
bdbj/Llama-3.1-8b-qpal-df-msq-fig1c
2B • Updated
bdbj/Llama-3.1-8b-qpal-df-msq-fig1d
Updated