Show HN: LLM Attention Visualization

(ishamf.dev)

22 points | by ifz 1 hour ago

2 comments

  • sva_ 12 minutes ago
    I highly question this simplistic idea of high vector magnitude = high influence.
    • ifz 2 minutes ago
      I don't disagree with that. I did add an entire caveat paragraph there.

      To me, it's more of a neat visualization, not something that can be used to interpret LLM behavior. Even with a lot of simplification, it can show some interesting patterns.

  • colophontio 29 minutes ago
    [dead]