Why Generative AI Can't Drive Scientific Discovery

Rich Sutton argues that generative AI systems face a fundamental limitation: they can either replicate existing patterns accurately (producing good but unoriginal output) or diverge from training data (creating novel but unreliable content). This distinction matters crucially for science and discovery, where AI's current approach may be structurally incapable of making genuine breakthroughs.