AI answer tracking · Agents Workshop

More and more shoppers skip the search results and ask ChatGPT, Gemini or Claude directly, or read the AI overview at the top of Google. Every week the "Content & Search" duty asks these AIs the questions your buyers ask and checks whether they mention you, where you rank, and whether they cite your site, then compares you with competitors.

Getting started

Open the "Content & Search" duty page. The first time, a card "AI answer tracking: decide what to track" appears in your feed.
The card shows what AI suggests from your brand profile (category, markets, stage): how many questions to track, how many name your brand, which AIs, who the competitors are, and roughly how many credits a month (Claude listed separately).
If it looks right, click "Looks good". To adjust, click "Edit": untick questions, swap in candidates, switch off an AI, remove wrong competitors, then click "Use my edits".
A round then runs automatically every Monday morning. To see results now, click "Run now" on the board; when Claude is on, it first tells you how many credits the round costs and only runs after you confirm.

The "Category" in your brand profile (Settings → Company profile → This brand) is what AI picks questions from. Brand analysis fills one in; fix it if it's off.

Reading the board

The board sits at the top of the duty page and only shows once there's data:

Four numbers: mention rate (share of answers that mention you), citation rate (share that cite your site), average position (where you come among you and your competitors), share of voice (your mentions out of yours plus competitors'). The small line is the last few weeks.
Trend: mention rate, one line per AI, drawn once there are three weeks.
Each question × each AI: green dot plus a number = mentioned, at that position; blue badge = cited your site; grey × = not mentioned; blank = couldn't check this cell (not counted as "not mentioned", and not charged). The small arrow at the end of a row says better or worse than last week.
Keyword rankings: where your tracked keywords rank on Google, the weekly change, whether the AI overview includes you, and Search Console's real average position next to it (trust that one when they disagree).
Most-cited sites: the sites the AIs cited most over the last 4 weeks, marked as yours, competitors' or forums and media. Expand one to see which pages were cited — busy outside sites that don't mention you are where PR should go.
Us vs competitors: how many times you and each competitor were mentioned in this week's answers.

AI answers vary a little every time, so watch the trend, not a single week. If too many cells couldn't be checked in a week (under 90%), that week shows no up/down arrows.

Reading one answer

Click any cell in the grid and that answer opens in the right panel:

The top line shows the AI, market, week, and the tone AI judged (positive / neutral / negative; the question mark shows the quote it's based on).
Only the first three lines show at first; your brand is green and competitors orange. Click "Show all" for the whole answer.
Below are the sites the answer cited, numbered in the order they appear; your own sites come first, in bold.
Tick "Compare with last week": new text is green and removed text is struck through; newly cited sites are tagged "New", and sites that disappeared are listed under "Gone".
The row of dots at the bottom is this cell over the past twelve weeks: solid green = mentioned (position above it), grey = not mentioned, hollow = couldn't check.

Changing what you track

"Tracking settings" at the top right of the board opens "Settings → Tracking" in the right panel; every change takes effect right away:

AIs to track: one tick each for ChatGPT, Gemini, Claude and Google AI Overviews. Claude shows roughly how many credits it costs a month.
How many to track: 5 / 10 / 20. You can edit a tracked question (the old one stays in history and a new one starts, so history always matches the original wording), untick it, pick from candidates or add your own.
Our aliases, competitors, keywords, markets, how often, ranking on mobile or desktop: add or remove them here.
To have AI suggest again from your latest brand profile, click "Ask AI to suggest again"; a new card waits for your decision.

FAQ

Claude's answer differs from what I see on claude.ai: the Claude column is taken from Claude's web-search answers and may differ slightly from the website.
Roughly how many credits a month: one brand, one market, 8 questions, four AIs and 20 keywords, one round a week, comes to about 155 credits a month, most of it Claude. Without Claude it's about 30. The exact number is shown in "Tracking settings".
Are the numbers made by AI: no. Mentioned or not, position and citations are counted by rules; only the "tone" is AI's judgement, and it always comes with a quote.
Can I export or delete the history: yes. Answers and their sources are kept long-term; you can export them, or delete a time range or the whole brand's history.