Induction heads - illustrated
This is my full walkthrough of induction heads. It includes some extra detail about the exact mathematical operations involved.
A full explanation for what the diagram is, and why I decided to make it, can be found in this LessWrong post.