The Measurement Question That Separates Real Agencies From Vendors
Ask your agency how they tie a specific piece of content to a specific revenue dollar. The answer reveals whether they're a partner or a vendor.
John Efrati · Published May 25, 2026
Here’s a question that will tell you if you’re working with a real agency or an expensive vendor.
Ask them: “How do you tie a specific piece of content to a specific revenue dollar?”
If they answer with “engagement” or “impressions” or “brand awareness,” they’re a vendor.
If they walk you through UTM tagging, conversion API setup, attribution windows, and offline conversion uploads, they’re an agency.
The first one bills monthly. The second one stays for years.
Why this question is the test
Measurement is the dividing line in agency work. Every agency claims to measure. Almost no agency measures well.
The vendors talk about engagement because engagement is easy to deliver and easy to display. A dashboard with engagement metrics looks impressive. Likes. Comments. Shares. Impressions. None of it ties to revenue.
The real agencies talk about attribution because attribution is hard. It requires:
- UTM tagging on every link, consistently
- Pixel installation on every conversion page
- Server-side conversion API setup for iOS users
- Attribution window configuration in the ad platform
- Offline conversion uploads for sales that close outside digital
- Cross-device tracking
- Lookback window analysis
This is unglamorous work. It doesn’t show up in the agency’s portfolio. But it’s the only work that lets you connect a specific video to a specific dollar.
What good measurement looks like
A real agency’s measurement system answers four questions for any given period:
- Which videos drove leads, and how many?
- Which videos drove revenue, and how much?
- What’s the cost per lead and cost per acquisition by content piece?
- Which formats, hooks, and topics produced the highest conversion?
If your agency can’t answer those four questions, you don’t have a measurement system. You have a dashboard that looks like measurement.
Why most agencies skip this
Two reasons.
It’s expensive to deliver. Setting up real attribution takes a competent technical person at the agency, plus integration with the client’s tools. Most agencies don’t have that person, or they don’t want to invest in it.
It exposes the work. Once you have real attribution, the truth comes out. Some videos drive 80% of the conversions. Others drive zero. The agency has to defend the zeros. Without attribution, every video can be hand-waved as “brand building.”
Real agencies welcome the exposure because the data lets them iterate. Vendors avoid it because it threatens the contract.
What to do this week
Ask your agency the question. Listen to the answer.
If it’s vague, schedule a follow-up specifically about measurement. Make them walk you through the technical setup. If they can’t, the relationship is one-sided.
You’re paying for content. They should be paying off in revenue. If you can’t see the connection, neither can they.
Want a measurement system that ties content to revenue? That’s how every Sprint starts with us.