New discussion

Some benchmarks

🔥 3
2
#13 opened 18 days ago by
tarruda

IQ5_K 136.891 GiB

🔥 2
23
#9 opened 30 days ago by
Hunterx

Ot parameters

3
#8 opened about 1 month ago by
theracn

IQ4_XS with iMatrix

🔥 1
3
#7 opened about 1 month ago by
Nexesenex

IQ4_KSS?

6
#6 opened about 1 month ago by
jpbwin

Quant fail?

6
#5 opened about 1 month ago by
nimishchaudhari

IQ2_KS model merging failed

2
#4 opened about 1 month ago by
lan0004

Thank you!

👍 6
16
#1 opened about 1 month ago by
anikifoss