glassbox

visualise the transformer, one stage at a time

normalization
feed-forward
position
key/value heads
parameters per block

One pass through the model, top to bottom. Every shape and count is computed from the configuration above rather than drawn. Open a stage to branch out the arithmetic inside it.