Inside the Transformer

Follow your prompt through every layer of a GPT-2 model

Enter any question or phrase, then watch GPT-2 process it step by step.

12Layers
768Dimensions
12Attention Heads
50,257Vocab Size