Besaid

Method4 min read

Why sample size is the number that matters most

A visibility figure is only as trustworthy as the n behind it. A short, practical explainer.

Measuring visibility is polling, not ranking

Because AI answers are probabilistic, measuring visibility is closer to polling than to checking a rank. Ask an engine a question once and you have an anecdote. Ask it many times, across models and conditions, and you have an estimate — with a margin of error that shrinks as you ask more. The sample size, n, is what tells you which of those two you are holding.

Why we write it as θ

We write visibility as θ (theta) — statisticians' notation for a probability you are estimating, not a fact you have looked up. Writing it that way is a standing reminder: the honest object is 'the estimated chance an answer mentions you', and it should never be reported without the n that supports it.

The failure mode: small-n confidence

A brand mentioned in four of five answers looks like an 80% star — until you notice the next five samples land at 40%, and the 'trend' was noise all along. Small samples swing wildly; the fix is not a cleverer chart but more data, and the discipline to widen the error bars honestly when the data is thin.

Sample size guards against cherry-picking

With enough small, hand-picked prompt sets, almost any story can be told. A disclosed, stable, reasonably large sample makes that far harder — the denominator is the honest constraint that keeps a measurement from becoming a marketing exercise. When you read any AI-visibility claim, the first question is not 'how high?' but 'out of how many?'

Sources & further reading

  1. Related: How to read an AI-visibility reportThe three questions to ask of any visibility number.

Want to see this on your own brand?

Start with a free diagnostic — real evidence of what AI says about you today.

Get a free diagnostic