The Skill Paradox: Why Self-Generated AI Tools Underperform

SkillBench challenges a fundamental assumption in AI agent research: that models can autonomously improve by generating their own skills. Instead, the study reveals self-generated skills provide no meaningful benefit, while meticulously curated human skills boost performance by over 16 percentage points. This finding reframes AI optimization away from scaling toward strategic skill design and cost-effective deployment.