14 articles
Ranking and being cited have come apart. A page can hold position one and never appear in an AI answer, or be quoted constantly while ranking on page three — so they are now two tracks, not one. This cluster is about the second track. The headline finding it keeps returning to: the web has decided how to say no to AI (80.5% of domains publish AI rules in robots.txt) and has barely started on how to be understood by it (only 8.4% serve an agent a machine-readable page — Cloudflare Radar, 13 July 2026). The block decision is a crowded room. The readability decision is an empty one.
· 14 min read
ClaudeBot is Anthropic's AI training crawler, one of three. In our check of 10,000 top sites, 64% of those that block it still let Claude-SearchBot in.
· 35 min read
I completed six AI SEO courses in the past year. Here's the order I'd take them in, who each one suits, and what they cost, from free to $319 a month.
· 14 min read
We checked the web's top 100,000 domains for llms.txt. Only 8.6% publish one, and nearly a third of those were generated automatically by the platform.
· 20 min read
Search-purpose crawling reached 10.6% of AI-bot requests in September 2026, four times January's share, as GPTBot halved to 6.2% and PerplexityBot grew sixfold since July. Our monthly AI crawler report.
· 21 min read
Perplexity now crawls 4,056 pages for every referral it sends back, up from 112 in January. Anthropic fell to 482:1, below OpenAI for the first time, as ChatGPT's links stopped passing a referrer. Cloudflare Radar's crawl-to-refer ratios, month by month to October 2026.
· 17 min read
Only 46% of AI-crawler requests now get a 200 OK, more than a quarter are blocked or throttled, and which bot dominates flips completely by country.
· 20 min read
50+ ChatGPT prompts for keyword research, content optimization and competitor analysis — grouped by the job each one actually does well, with the outputs you need to verify before acting on them.
· 25 min read
Branded prompts are already 92-97% solved on every AI engine. Discovery prompts collapse to 11-18%. Here's how to close the gap that decides who AI names.
· 14 min read
What 41M AI search results reveal—and what has changed since 2025. Compare platform patterns, technical requirements, and a practical 2026 workflow.
· 16 min read
91.3% of the AI Overview citations we track already rank in the organic top 20 — but AI Mode pulls 33.8% from beyond the top 100. Here's what to fix first.
· 11 min read
Voice search is transforming SEO in 2026. Discover key strategies to optimize your content for voice queries, leverage AI advancements, and stay ahead in the digital landscape. Learn how to adapt your SEO tactics for better rankings and increased visibility in the era of voice-first search.
· 21 min read
30+ sourced AI SEO stats for 2026: AI Overviews reach 2B users, organic CTR drops 61% where they appear, and AI traffic converts up to 23x better. See the data.
· 16 min read
Only 12.4% of AI crawling across the sites we track answers live questions. Here's what answer engine optimization requires in 2026, and how to measure it.
· 8 min read
The surge in popularity of ChatGPT can be credited to its astonishingly accurate and creative text generation. However, it’s not just the ability to generate text that makes ChatGPT popular. It’s the breadth of applications across various industries, ranging from customer service, content marketing, virtual assistants, and of course, our area of focus- SEO.
Get our research the day it ships, new free tools as they launch, and notes from the B2B SaaS SEO playbook our agent runs.
