A dated index of working notes.

A mechanical bibliography for observations, project notes, and longer pieces as they take shape.

A Model without a head is just a body

The title itself is an example of why context matters. This article explores how context is built into token representations and how a model arrives at its next-token prediction.

Your words are not what the model sees

Part one of a tour from prompt to model: how tokenizers turn text into token IDs, why character counting is awkward, and how IDs become vectors.

tinyloop: What makes clankers clank

A deliberately small coding agent, you can understand in an afternoon