Transformers Outperform Traditional Logic in Expressive Efficiency

This research reveals that Transformers can represent complex formal languages far more compactly than traditional models like finite automata or LTL formulas. While this efficiency underscores their immense expressive power, it also confirms that formally verifying their behavior is an extremely difficult computational challenge.