Serving a 1T open model at 511 tok.s single-stream, lossless, on four B200s

(brainsless.com)

7 points | by alsufiman 2 days ago ago

1 comments