Web Rot Reality Check: How Anti-Bot Systems Inflate Dead Domain Estimates

Conventional web rot estimates are nearly double the actual death rate because they conflate genuinely dead domains with live servers deploying anti-bot blocking. This distinction is critical for web developers and crawler builders—dead domains should be skipped entirely, while blocked ones need different client strategies to retrieve content. The research reframes the 'dead web' narrative and provides practical guidance for handling failed requests.