How to Evaluate Your Marketing Agency: 7 Criteria to Check Before You Renew

Knowing how to evaluate your marketing agency before renewal is one of the most valuable things you can do as a business owner, and almost no one does it rigorously. Renewal time arrives, and the default move is to scan a few recent reports, think back on whether the conversations felt productive, and make a gut call. By the time the frustration has been building for months, the decision is emotional, not analytical.

This post gives you a framework to run that evaluation before you hit that point: seven specific criteria, each one answerable from data your agency should already be producing. You don't need to hire a consultant or commission a competitive audit. You need about an hour and the willingness to look honestly at what you find.

If most of your answers are solid, renew with confidence. If several make you uneasy, that's worth a direct conversation with your agency before you do anything else. And if you've had that conversation and still don't like what you're hearing, it's worth understanding what a different structure could look like. This is a framework for marketing agency accountability, not a checklist for finding reasons to leave.

1. Are They Reporting on Revenue Metrics, or Just Activity?

The fastest way to evaluate your marketing agency: pull your last three reports and find the lead metric. If it's impressions or follower growth rather than leads generated, cost per lead, or conversion rate, your agency is measuring activity rather than outcomes. That's the core marketing agency accountability problem in most underperforming engagements, and it almost never gets named until someone finally asks.

What a Vanity-Metric Report Looks Like

If the headline numbers in your monthly report are impressions, follower counts, reach, and post likes, your agency is reporting on vanity metrics. They feel like progress because they go up, but they have no reliable relationship to revenue. A report built around reach as the centerpiece, with downstream outcomes as an afterthought or absent entirely, is a structural accountability problem. It tends to persist because no one calls it out.

What a Revenue-Connected Report Looks Like

A solid marketing agency performance review is structured around marketing KPIs that connect to actual business results: leads generated by channel, cost per lead, conversion rate by landing page or campaign, and some form of pipeline attribution if your sales cycle is long enough to warrant it. Conversion tracking should be set up and functioning so every report tells you not just what traffic came in, but what that traffic did. ROAS should appear in any report that covers paid media.

How to Ask for the Change

If your current reports don't include revenue-connected metrics, make a direct request: ask your agency to restructure reporting so leads generated, cost per lead, and conversion rate are the lead story each month. The way they respond matters. An agency genuinely invested in evaluating marketing agency ROI will welcome the exercise. An agency that deflects or explains why those numbers are hard to track has something to protect.

2. Did You Agree on Benchmarks in Month One, and Are You Hitting Them?

A competent agency establishes starting metrics in the first 30 to 60 days: your current cost per lead, organic traffic baseline, ad click-through rates, and conversion benchmarks. Without that foundation, every future report is floating. There's no honest way to say performance has improved if no one documented where it started.

The 90-Day Baseline

The 90-Day Baseline is the practice of documenting your starting metrics, specifically cost per lead, organic traffic, and conversion rate, in the first 30 to 60 days of an agency engagement. Without it, there's no honest way to measure whether performance has improved or declined. It's the single most important structural piece of any new engagement, and it's the one most often skipped. If your agency didn't establish baselines in the early weeks, ask yourself: how are you supposed to know whether the numbers you're looking at now represent progress or noise? "Traffic is up 12%" is meaningful if you know where you started. It's meaningless if nobody wrote that down. For a clearer picture of <a href="/blog/what-to-expect-from-a-marketing-agency/">what to expect in the first 90 days</a>, that post lays it out month by month.

What to Do If No Baseline Was Set

If you didn't set performance benchmarks at the start, you're not stuck. Ask your agency to pull your month-one or month-two data and reconstruct the baseline retroactively. It's not ideal, but it gives you a reference point. And the way they respond to that request will tell you something too. An agency genuinely invested in marketing ROI will welcome the exercise. An agency that deflects or stalls has something to protect.

How to Use Benchmarks Going Forward

Once benchmarks exist, use them as the frame for every monthly conversation. Each report should explicitly compare current performance against the established baseline, not just against last month. Trend lines over six or more months reveal things a single month comparison never will. If your agency isn't building reports with that longitudinal view, ask for it.

3. Is Your Cost Per Lead Improving Over Time?

Good paid campaigns and well-executed SEO both compound. A Google Ads account that's been running for nine months should have cleaner negative keyword lists, better Quality Score history, and sharper audience targeting than it did in month two. An SEO program should be building domain authority, which means each new piece of content gets more traction than the last. Lead generation metrics should trend in the right direction over time.

How to Calculate It Yourself

The math is simple. Take your total channel spend and divide it by the number of leads or conversions that channel produced. That's your cost per lead for that period. Now run the same number for two or three prior months and compare. Flat is not good enough. Worsening without explanation is a real problem. If you're running paid search and want a clearer benchmark, our <a href="/portland-digital-advertising-agency/">digital advertising page</a> covers what healthy paid media optimization actually looks like in practice.

When a Plateau Is Normal vs. When It's a Problem

Some plateau is expected when a market gets more competitive or a season shifts. The difference between a good agency and a mediocre one isn't whether performance ever dips. It's whether they catch it, explain it accurately, and arrive to the next conversation with an adjusted plan. If CPL has been flat or climbing for two or three consecutive months and you haven't heard a word about it unprompted, the issue isn't the market.

Paid vs. Organic: Different Timelines, Same Standard

Paid channels should show cost-per-lead improvement within the first few months as targeting tightens. Organic channels, including SEO and content, have longer compounding curves and usually take six to twelve months before the trajectory becomes clear. Hold each channel to the timeline that fits its nature, but hold them all to the same standard: demonstrable progress, explained clearly, with a plan when things stall.

4. Are You Getting Strategy, or Just Execution?

Most business owners assume they're getting strategy because they're paying a retainer. They're often getting execution. There's a meaningful difference, and the agency-client relationship you end up with depends almost entirely on which one you have.

What Execution-Only Looks Like

An execution-only engagement looks like this: every call is a status update on what got done last week, strategy conversations happened during onboarding and basically nowhere since, and when you bring up a new channel or idea, the agency says yes and builds a plan around whatever you suggested. That's not nothing, but it's not what you're paying retainer value for.

What a Real Strategic Partner Looks Like

A real strategic partner brings a quarterly roadmap, explains the reasoning behind channel recommendations, and sometimes tells you the tactic you're excited about isn't the right call right now. They surface things you didn't ask about: a competitor launched something new, a keyword cluster is gaining volume, an ad format you're not using is outperforming in your category. That's the work. If that doesn't sound familiar, you might have an <a href="/portland-outsourced-marketing-agency/">outsourced marketing partner</a> in name only.

Where Strategy Shows Up in SEO and Organic Channels

Strategy is especially visible, or noticeably absent, in organic channel management. If your agency is producing content without a documented keyword rationale, or running your SEO program without a clear authority-building plan tied to business outcomes, that's execution masquerading as strategy. A good <a href="/portland-seo-marketing-agency/">SEO agency</a> should be able to show you the logic connecting every piece of content to a ranking goal and a downstream conversion.

5. Can You Describe What's Working, Without Looking Anything Up?

Here's an honest test: without pulling up anything, can you describe what's performing in your marketing program right now? Which channel is generating the most leads? What's being tested? What got deprioritized last month and why? If you can answer those questions with reasonable confidence, your agency's reporting transparency is doing its job. If you'd have to send an email to find out, it isn't.

What Proactive Communication Actually Looks Like

Proactive communication means a standing monthly report delivered without prompting, a clear written narrative alongside the data rather than just a marketing dashboard screenshot, and some form of week-to-week visibility into what's actively being worked on. Not everyone needs a daily Slack update, but you should never have to wonder whether anything is happening.

The Communication-Performance Connection

Agencies that communicate well tend to perform better. It's not a coincidence. Proactive communication and proactive optimization come from the same underlying culture. Agencies that go quiet when results are soft are usually the same ones that never flag a problem until you do. If your agency only reaches out when things are going well, take note of that pattern.

How to Reset Communication Expectations Mid-Engagement

If reporting feels opaque, make a specific ask: request a written narrative summary alongside your next monthly report, and ask that it include one section on what underperformed and why. That single structural change tells you a lot about whether the agency is willing to be honest in writing, not just in verbal reassurances.

6. Does the Agency Push Back, or Just Say Yes?

A "yes agency" is one of the most expensive problems a business can have, and it's the one least likely to get named. When an agency agrees with every idea you bring, approves every direction you suggest, and never recommends a different path than the one you asked for, they're prioritizing your comfort over your results. That's not expertise. That's order-taking with a nicer invoice.

Why Healthy Friction Is a Feature

Healthy friction means the people running your marketing actually have a point of view, which is what you're paying for. You should be at least a little suspicious if your agency has never told you no. For more on the structural reasons agencies fall into this pattern, the post on <a href="/blog/why-marketing-agencies-overpromise-and-how-sproutbox-is-different/">why agencies overpromise</a> is worth reading before you renew.

How to Test for It Deliberately

In your next check-in, bring a tactic or channel you've been curious about that may not be the right fit for your business right now. A good agency will either validate it with reasoning or push back with a better alternative. An agency that just says "yes, we can add that" without any qualifying conversation is showing you exactly how they'll handle every future decision.

7. How Does the Agency Handle a Bad Quarter?

Any agency looks competent when campaigns are performing and leads are flowing. The real character of the agency-client relationship shows up when something misses: a campaign underperforms, a channel goes flat, or an algorithm shift hits organic traffic. What happens next is the most revealing data point in the entire engagement.

What a Good Response Looks Like

A good agency explains what happened with specificity, owns the parts that were within their control, and shows up to the next conversation with an adjusted plan. Both things can be true simultaneously: external forces were real, and the agency also dropped something. The ones worth keeping are the ones who can say both out loud.

What a Bad Response Looks Like

A mediocre agency produces a long explanation about external factors, platform changes, and market conditions, with no ownership and no adjusted plan. Watch for reports that describe what happened without recommending anything different going forward. That's a pattern, not a one-time miss.

Why This Can't Be Measured on a Spreadsheet

This one is about trust, and trust only accumulates through how an agency behaves when things go sideways. If you've never had a bad quarter together, you don't actually know yet. For more on <a href="/blog/how-to-work-with-a-marketing-agency/">what a good agency relationship looks like</a> in practice, that post covers the client side of the equation too.

Frequently Asked Questions

How do I know if my marketing agency is actually working?

The clearest signal is whether cost per lead and conversion rates are improving over time. If they are, the agency is working. If reports focus on reach and impressions without connecting them to actual leads or pipeline, and no one has established baseline benchmarks, you don't have enough data to answer the question yet. That gap is itself a problem worth addressing directly with your agency.

What metrics should a marketing agency report on each month?

A solid monthly report covers: leads generated by channel, cost per lead, organic traffic and keyword position movement, conversion rate by campaign or landing page, ROAS for any paid media, and some form of pipeline attribution if your sales cycle allows it. Reach and impressions can appear, but they shouldn't lead the report. Revenue-connected metrics should.

When should I fire my marketing agency?

Fire your agency if: cost per lead has been flat or worsening for three or more consecutive months with no credible explanation or adjusted plan, you're regularly discovering problems before they do, the reporting doesn't include conversion data, or they've never pushed back on a single thing you've suggested. One bad quarter is a data point. A pattern without accountability is a reason to leave.

How do I find a marketing agency in Portland I can actually trust?

Ask two things in your first conversation: what baselines did they establish in month one for past clients, and how do they handle a quarter where results miss? The answers reveal accountability culture faster than any portfolio review. Sproutbox is a Portland-based full-service digital marketing agency. If you want a concrete starting point, the <a href="/portland-outsourced-marketing-agency/">Portland outsourced marketing page</a> explains how we structure engagements and what the first 90 days actually look like.

What is a marketing agency performance review and how often should I do one?

A marketing agency performance review is a structured evaluation of your agency's results against documented benchmarks, covering cost per lead, conversion rate, reporting quality, and strategic contribution. You should run a formal version at least quarterly, and always before renewing a contract. The seven-criteria framework in this post is designed to make that review repeatable and data-driven rather than based on gut feel.

How to Evaluate Your Marketing Agency: Run the Framework Before You Renew

These seven criteria take less than an hour to work through, and they give you an objective foundation for a conversation that most businesses have entirely on gut feel. Run them before you renew, not after you've already started to pull away. The goal isn't to find reasons to leave. It's to know clearly whether you have reasons to stay.

If the answers to most of these make you uneasy, start with a direct conversation with your agency. If you've had that conversation and still don't like what you're hearing, it's worth understanding what a different structure could look like. You can see <a href="/pricing/">how Sproutbox structures its retainers</a> if you want something concrete to compare against.

If you're asking these questions and not liking the answers, we're happy to take a look. <a href="/schedule/">Schedule a call</a>, no pressure, no pitch deck, just an honest conversation about what you're seeing and whether there's a better path.