Lost in Backpropagation: The LM Head Is a Gradient Bottleneck

(arxiv.org)

4 points | by famouswaffles 20 hours ago ago

No comments yet.