AI is genuinely astonishing. Ask it almost anything about your marketing and it will hand you back a plausible, well-structured, confidently-worded answer in seconds. Attribution models, ad copy, audience segments, budget splits — all instant, all fluent.
But here's what running real client accounts has taught us: the quality of the answer was never really the bottleneck. The question was.
Give an AI model a bad question and it will still give you a great-sounding answer. That's the trap. It doesn't push back and ask whether you're measuring the right thing. It doesn't tell you your tracking is crediting the wrong channel for a sale that would have happened anyway. It answers exactly what you asked — competently, fluently, and sometimes completely irrelevantly to the problem you actually have.
We see this constantly. Someone asks "how do I lower my cost per click?" and gets a dozen tactical answers back — tighter match types, better ad copy, dayparting. All correct. All beside the point, if the real question was "why are we paying for clicks on our own brand name that we'd have got for free?"
The genius isn't in generating the answer to "how do I lower my CPC." It's in noticing that's the wrong question in the first place.
The part nothing has automated
AI is brilliant at compressing the distance between question and answer — genuinely, it's changed how fast we work. But it's not yet any good at knowing which question was worth asking. That still takes someone who understands the account, the business, and where the numbers might be lying to you.
So we use AI heavily, but we've learned not to trust an answer until we've interrogated the question behind it. That's not really a caveat about AI — it's been true of every analytics tool we've ever used. AI just makes it more dangerous, because it answers with so much confidence that it's easy to stop asking whether the question was right in the first place.
Where the value still is
If there's one thing worth taking from this: before you ask an AI tool — or an agency, or a dashboard — for an answer, spend longer on the question. That's still where the value is.
Want a second opinion on the questions you're asking?
Book a free strategy call. We'll look at your current account and tell you honestly whether you're solving the right problem.
Book a free strategy call →