Skip to content
Passieon

How to track your AI visibility: a monthly method

By Hamza Rivera, updated

TL;DR
  • AI answers change from run to run, so one check proves nothing. Track a fixed list of questions on a schedule and count how often you appear.
  • Log four things per run: whether you are named, your position in any list, who else is named, and which pages are cited.
  • Pair that with your own analytics, where you filter referrals from AI tools, and with Search Console for Google.
  • Report a share across several runs, and keep the method fixed so months can be compared.

Owners often check once, see their name missing or present, and draw a conclusion. That is like judging the weather from one minute at the window. This guide sets out a method you can run by hand in under an hour a month, and says what to look for when you move to a paid tool.

We run this sampling in our GEO and AEO services.

Think of it like this

It is closer to polling than to a ranking. You ask the same question to a group, many times, and report the share who give each answer. A single reply tells you what one person said.

Step 1: build the question list

Write 10 to 20 questions a real customer would ask, in their words. Mix three kinds: broad ("who is a good roofer in Dayton"), specific ("how much does it take to replace a flat roof, and who does it locally") and comparison ("X versus Y for small shops"). Keep the list fixed. If you change questions every month you cannot compare months.

Step 2: control the conditions

  • Use a fresh chat for each question, so earlier answers do not shape later ones.
  • Note the date, the tool and the plan you used. Free and paid plans can behave differently.
  • Use the same location wording each time.
  • Run each question three to five times, because answers vary.

Step 3: log what comes back

FieldWhy it mattersVerdict
Named or notThe headline numberAlways log
Position in a listShows how strong the mention isLog
Others namedShows who you compete withLog
Pages citedShows which of your pages workAlways log
Tone of the descriptionCatches wrong factsLog if named

Step 4: turn it into a share

If a question was asked four times and your name came up in one, your share on that question is one in four. Add the questions up for an overall figure, and keep each question's figure too, because the average hides which topics are weak. Report the trend over months, not the number from a single month.

Step 5: use your own analytics

Look at referral traffic in your analytics. Visits that arrive from AI tools sometimes carry the tool's domain as the referrer, though many arrive with no referrer at all, so the count will be low. Treat it as a floor. Tag any links you control, such as those in ads, with UTM parameters so they are separable. For Google's AI features, Search Console reports on pages in the same performance data as ordinary search.

Step 6: check what is wrong, not only what is missing

When you are named, read the description. Wrong hours, an old address or a service you do not offer are worth fixing at the source, which is usually a page of yours or a directory listing. A mention with wrong facts can cost you a customer.

Using a paid tracker

Paid tools automate the sampling. We are not comparing vendors here, and have not tested enough of them to rank any. Ask any tool you consider these questions:

  • How many runs per question does it do?
  • Does it show the raw answers, so you can read them?
  • Does it say which model and plan it queries?
  • Can you export the data?

Our free AI visibility checker is a quick first look. It is one snapshot and does not replace repeated sampling.

Mistakes to avoid

  • Judging from one run.
  • Changing the question list every month.
  • Asking in a chat that already holds your earlier answers.
  • Reporting a "score" that nobody can explain.

A single AI answer is a snapshot of a mood. Ask again after lunch and it may have changed its mind.

One last thing

Save the raw answers, not only your tally. When the numbers move, the text tells you why.

Where to go from here

We run this sampling as part of our GEO and AEO services, with the raw answers included. The steps to improve what you find are in how to get mentioned in ChatGPT. Passieon is an independent agency.

Sources

Frequently asked questions

How do I check if ChatGPT mentions my business?

Ask a fixed list of customer questions in fresh chats, several times each, and log whether you are named and which pages are cited.

Why can one check mislead me?

AI answers vary from run to run, so a single result is one sample. Count how often you appear across several runs.

Can I see AI traffic in my analytics?

Sometimes. Some visits carry the tool as the referrer, but many carry none, so treat the count as a minimum.

Do I need a paid tracking tool?

Not to start. A monthly manual check takes under an hour. Paid tools help once you track many questions.

How often should I check?

Monthly is enough for most small businesses, using the same questions each time.

Want this done for your site? See what our GEO and AEO services page covers, or read the client results.

Book a call with us

A 30-minute call in your working hours. Tell us what you sell and where, and we will tell you what we would do first and what it involves. Prefer email? Send your website through the form and the Passieon Team will reply by email.

Book a call

Message us

Message us

Ask anything about your site or where your inquiries are going. It goes straight to a person, not a bot. Leave an email and you get a reply.