SEO
llms.txt: What Marketers Need to Know Before Testing It
llms.txt promises a curated path for AI crawlers, but no major AI platform confirms using it. Here's what Semrush found and how to test it.
Technical SEO.
SEO
SEO Best Practices for Google and AI Search
SEO now has to satisfy Google and AI agents. Here are the layers that earn rankings, citations and brand mentions in an AI-first search world.
SEO
Noarchive’s New Role in AI Visibility
Google retired the noarchive meta tag, but Bing repurposed it for Copilot and AI training. Here’s what search marketers need to audit now.
SEO
Robots.txt in 2026: Crawling Rules, AI Opt-Outs and Gaps
Robots.txt is voluntary, narrow and now central to AI training opt-outs. Here's what SEO and performance marketers need to know about RFC 9309, GPTBot blocks and crawler gaps.
AI in Marketing
Text-Only AI Sites Strip Out the Action Layer
Markdown mirrors solve reading, not doing. Here's why semantic HTML and machine-readable form feedback matter more for AI agents.
SEO
Google Indexing API Job Site Approvals Are Going Silent
Job site operators report months-long silence on Google Indexing API approvals even though Google still recommends the tool. Here's what SEOs should do.
SEO
Google Lighthouse Adds AI Agent Discovery Audit
Lighthouse 13.5 adds an experimental audit for AI agent resource discovery. Here’s what it checks and why a Not Applicable result is not always a problem.
SEO
Cloudflare’s AI Training Block Now Spares Googlebot
Cloudflare's new Disallow AI Training setting lets sites block AI training without losing Google, Bing, or Apple search visibility. Here's what to check before toggling.
SEO
Cloudflare’s Bot Policy Sync Automates AI Crawler Rules
Cloudflare's Bot Preference Sync writes robots.txt entries from your AI bot settings. Here's how it works, the SEO tradeoffs, and the quick audit to run.
SEO
How to Check If Your Page Shows Up in AI Search
Use a distinctive 20-30 word snippet and an exact-match prompt in ChatGPT, Claude or Gemini to see if AI search can retrieve your page.
