Matteo Saponati, Pascal Josef Sager, Pau Vilimelis Aceituno, Thilo Stadelmann, Benjamin F Grewe
The underlying structures of self-attention: symmetry, directionality, and emergent dynamics in Transformer training,
International Conference on Machine Learning, 2025