Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don’t

Published in ICML 2026, 2026

A study of which architectural choices affect the expressivity of padded transformers.