Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes)

(github.com)

5 points | by Griffith-7 16 hours ago ago

1 comments

  • DiabloD3 10 hours ago ago

    Neat, can't wait to see a llama.cpp PR for this.