Why All Language Models Learn Numbers the Same Way

This research reveals a striking phenomenon: despite different architectures and training methods, language models independently converge on nearly identical numerical representations using periodic features. This universal pattern offers critical insights into AI interpretability and suggests deep principles govern how neural networks develop mathematical understanding.