TurboPrefill: 3.27× Prefill Speedup in Llama.cpp

(devpost.com)

1 points | by trykhlieb 9 hours ago ago

3 comments

  • trykhlieb 9 hours ago ago

    TurboPrefill by Trykhlieb is now also available for ik_llama.cpp by Ivan Kawrakow.

  • 9 hours ago ago
    [deleted]
  • trykhlieb 9 hours ago ago

    [dead]