My "4-bit" quant was 6.2 bits per weight

(koleslaw.ai)

3 points | by murphman 5 hours ago ago

1 comments