Measuring AI search honestly, limits included.

Visits from AI tools are recorded in two places with different rules. For Google's own AI features, the AI features guide says sites appearing in AI Overviews and AI Mode are included in overall Search Console data, reported in the Performance report under the Web search type. Search Console's help page says clicking a link in an AI Overview or AI Mode counts as a click, and that an AI Overview occupies a single position with all its links assigned that position. In Google Analytics, the default channel group says Organic Search includes Google's AI Overviews and AI Mode.

For other assistants, the default channel group has an AI Assistant channel for visits from sources like ChatGPT, Gemini, Deepseek, Copilot or Grok, and it excludes Google's AI Overviews and AI Mode. The channel is defined by the medium "ai-assistant", which Analytics sets if the referrer matches a list of AI assistants. On our reading, that means the channel counts what Analytics can recognise, not necessarily every visit that began in an AI tool. Google's own AI features sit elsewhere, so the two sets of numbers should be read separately, not added together. In the same definitions, Direct is the channel for users arriving via a saved link or by entering a URL, Referral covers non-ad links on other sites or apps, and Unassigned is used when no other channel rule matches. Which of these an individual AI visit lands in depends on the data Analytics receives, which the documentation does not detail.

Cultured Digital covers AI referral traffic in analytics. Needing to measure AI referral traffic properly is one of the reasons clients come to us for this service.

Analytics shows only people who clicked. It cannot show how an assistant describes you when nobody clicks, which is why prompt tracking exists. None of Google, OpenAI or Perplexity documents a method for tracking brand appearances in answers, so what follows is reasoning, not sourced guidance.

The case for repeatable prompts comes from the vendors' own caveats. Google says AI Overviews often do not trigger, and that AI Mode and AI Overviews may use different models and techniques, so the links they show vary. Search Console treats a follow-up question in AI Mode as a new query. OpenAI says results and citations can be incomplete, outdated or incorrect. If answers vary like that, one run of one prompt proves little. A fixed set of prompts, recorded with dates, at least makes changes comparable over time.

Whether an AI answer appears at all is itself a variable. Google says AI Overviews are shown only when its systems judge them additive, so presence changes by query. Recording whether an answer appeared, as well as whether you were mentioned in it, keeps a missing mention from being misread as a loss when there was simply no answer to appear in. Equally, because Search Console counts each follow-up in AI Mode as a new query, query counts there are not counts of conversations.

Cultured Digital covers repeatable prompt sets and tracking. Because answer engines are probabilistic and change often, we treat any single result as one observation. What we report as observed is what the tools actually said, with prompts and dates. We do not promise anything like "ranking #1 in ChatGPT".

Every measurement above has an edge. Search Console does not include data from Search Labs experiments, according to its help page. Because every link in an AI Overview shares one position, position data cannot show where within the answer a link appeared. The pages we read include AI features within overall Web search data and do not describe a separate AI-only report.

Third-party tools add their own limits. The OpenAI and Perplexity pages we read describe crawlers and search features, not reporting, so we found nothing that gives site owners data on how often a page is cited. OpenAI warns that citations may be incomplete, outdated or incorrect. Analytics classification depends on the referrer matching a list. We found no documentation that lets anyone attribute a change in AI visibility to a specific site change with certainty.

Clicks are also only one outcome. Google's AI features guide suggests tracking conversions and time spent on your site in tools such as Google Analytics alongside Search Console, a reminder that traffic counts are not the same as business results. And Search Console data describes appearances in Google, so none of it speaks to what ChatGPT, Perplexity or Gemini apps show.

This is why we separate what was observed, what is inferred, what is actionable and what is unknown, and why a claim that cannot be evidenced does not go in the report. The same reasoning applies to ordinary SEO reports: see our note on unavailable data versus zero and what clients should see in SEO reporting. Measurement design is covered under Measure.