Measuring progress toward AGI: A cognitive framework

Google DeepMind released a paper proposing a cognitive taxonomy with 10 key cognitive abilities (perception, reasoning, metacognition, etc.) as a scientific framework for measuring AI progress toward AGI. They outline a three-stage evaluation protocol benchmarking AI against human baselines and have partnered with Kaggle to launch a hackathon focused on building evaluations for the five least-measured abilities: learning, metacognition, attention, executive functions, and social cognition.