TL;DR: In May 2026, Anthropic split its web crawler into three distinct agents: ClaudeBot, Claude-User, and Claude-SearchBot. Many UK SMEs are accidentally blocking their AI visibility by using outdated "blanket" robots.txt rules. To secure citations in Claude’s search results, you must allow Claude-SearchBot and Claude-User while selectively managing ClaudeBot. This article explains how to configure your site to feed AI engines the right signals while protecting your trainin