Notes

How AI models actually work, one short note at a time.

Why a model's output is plausible rather than true, and what that means for where a human checks. Same text as John Gabrick's LinkedIn posts, dated.

Diagram showing next-token prediction: an input phrase followed by candidate next words with probability bars, illustrating that a language model samples a plausible token rather than choosing a true one.

An LLM doesn't look facts up. It predicts the next token.

One word at a time, weighted by patterns it saw in training.

That single fact explains the failure everyone keeps hitting. When a model invents a drug interaction that sounds right, it isn't malfunctioning. It's doing the only thing it ever does, picking a plausible next word. Plausible and true only usually overlap.

Once you see that, "why did it make this up" stops being mysterious, and "where do we require a human to check" becomes the real design question.

Permalink