18 points | by sanchitmonga22 3 hours ago ago
2 comments
Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.
how does this compare with sglang
Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.
how does this compare with sglang