31 points | by Bluestein 2 hours ago ago
3 comments
> A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.
How successful was that?
The entire thing went down:
- https://distill.pub/2021/distill-hiatus/
... and, here we are.-
Nothing about B-H curves or magnetization current, must be that other kind of transformer, in that other kind of circuit.
> A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.
How successful was that?
The entire thing went down:
- https://distill.pub/2021/distill-hiatus/
... and, here we are.-
Nothing about B-H curves or magnetization current, must be that other kind of transformer, in that other kind of circuit.