News Score: Score the News, Sort the News, Rewrite the Headlines

How an LLM Works, as a City

idle Press Run to start The city is idle. Type a prompt below and watch a single token make the round trip. Residual stream idle 12 numbers standing in for the 4,096+ a real model carries. Blue is negative, warm is positive. Attention softmax over the KV cache Runs at the Attention Plaza. Next token logits → softmax Computed at the Vocabulary Stadium. Context Output nothing yet Districts click to fly there...

Read more at laurentiugabriel.github.io

© News Score  score the news, sort the news, rewrite the headlines