Benchmarking Fable, Sol, and Kimi K3 on SlopCodeBench

(github.com)

6 points | by dhorthy 5 hours ago ago

1 comments

  • Bolwin an hour ago ago

    Two things

    1. If we're using native harnesses, I'd have preferred you use kimi code, not opencode 2. The variation in the two kimi providers just shows how you can't trust n = 1 trials