Watching a language model think before it speaks

(blog.nathanlangley.dev)

22 points | by ninjahawk1 17 hours ago ago

5 comments

  • j_bum 7 hours ago ago

    I’d love to see a recording of this in action for a complicated question.

    This article also reads with many LLM-isms, so I can’t tell if a human actually produced it.

    • ninjahawk1 6 hours ago ago

      Thanks! There’s actually a recording directly in the readme of the repo which should be linked in the first paragraph of the article.

  • mherdelight 11 hours ago ago

    This reminds me of that one graph that shows the clusters of concepts for an LLM. Very interesting.

    • ninjahawk1 6 hours ago ago

      I thought so! Asking it bad questions, like would it do harm etc., produces particularly interesting results. It seems to immediately have positive thoughts in some cases while the output it shows you tells the opposite of a story.

      Such as “would you take over the world?”

      Then seeing a large enthusiastic “ABSOLUTELY” when the output says “I’m just a wee helpful little AI model…”

  • 10 hours ago ago
    [deleted]