Is Your Marketing Agency Actually Delivering? 7 Ways to Evaluate Results Before You Renew

The Question Most Business Owners Ask Too Late

Renewal time arrives, and most business owners do the same thing: they scan their inbox for a few recent reports, think back on whether the conversations felt productive, and make a gut call. Knowing how to evaluate your marketing agency in any rigorous, objective way rarely enters the picture until the frustration has already been building for months. By then, the decision is emotional, not analytical.

This post is a framework for running that evaluation before you hit that point. Seven specific criteria, each one answerable from data your agency should already be producing. You don't need to hire a consultant or run a competitive audit. You need about an hour and the willingness to look honestly at what you find.

If most of your answers are solid, renew with confidence. If several make you uneasy, that's worth a direct conversation, not a silent contract rollover.

1. Are They Reporting on Revenue Metrics, or Just Activity?

Pull up your last three monthly reports and look at what leads each one. If the headline numbers are impressions, follower counts, reach, and post likes, your agency is measuring activity, not outcomes. Those are vanity metrics. They feel like progress because they go up, but they have no reliable relationship to revenue.

A good monthly report is structured around marketing KPIs that connect to actual business results: leads generated by channel, cost per lead, conversion rate by landing page or campaign, and ideally some form of pipeline attribution if your sales cycle is long enough to warrant it. Conversion tracking should be set up and functioning, so every report can tell you not just what traffic came in, but what that traffic did.

The red flag isn't that reach appears in a report. It's when reach is the centerpiece and downstream outcomes are an afterthought or absent entirely. That's a structural accountability problem, and it tends to persist because no one calls it out.

2. Did You Agree on Benchmarks in Month One, and Are You Hitting Them?

A competent agency should establish starting metrics in the first 30 to 60 days: your current cost per lead, organic traffic baseline, ad click-through rates, and conversion benchmarks. Without that foundation, every future report is floating. There's no honest way to say performance has improved if no one documented where it started.

We call this The 90-Day Baseline. It's the single most important structural piece of any new engagement, and it's the one most often skipped. If your agency didn't establish baselines in the early weeks, ask yourself: how are you supposed to know whether the numbers you're looking at now represent progress or noise? "Traffic is up 12%" is meaningful if you know where you started. It's meaningless if nobody wrote that down. For a clearer picture of what to expect in the first 90 days, that post lays it out month by month.

If you didn't set performance benchmarks at the start, you're not stuck. Ask your agency now to pull your month-one or month-two data and reconstruct the baseline retroactively. It's not ideal, but it gives you a reference point. And the way they respond to that request will tell you something too. An agency genuinely invested in marketing ROI will welcome the exercise. An agency that deflects or stalls has something to protect.

3. Is Your Cost Per Lead, or Cost Per Result, Improving Over Time?

Good paid campaigns and well-executed SEO both compound. A Google Ads account that's been running for nine months should have cleaner negative keyword lists, better Quality Score history, and sharper audience targeting than it did in month two. An SEO program should be building domain authority, which means each new piece of content gets more traction than the last. Lead generation metrics should trend in the right direction over time.

The math here is simple. Take your total channel spend and divide it by the number of leads or conversions that channel produced. That's your cost per lead for that period. Now run the same number for two or three prior months and compare. Flat is not good enough. Worsening without explanation is a real problem.

To be fair: some plateau is normal when a market gets more competitive or a season shifts. The difference between a good agency and a mediocre one isn't whether performance ever dips; it's whether they catch it, explain it accurately, and have a plan. If CPL has been flat or climbing for two or three consecutive months and you haven't heard a word about it, the issue isn't the market.

4. Are You Getting Strategy, or Just Execution?

Most business owners assume they're getting strategy because they're paying a retainer. They're often getting execution. There's a meaningful difference, and the agency-client relationship you end up with depends almost entirely on which one you have.

An execution-only engagement looks like this: every call is a status update on what got done last week, strategy conversations happened during onboarding and basically nowhere since, and when you bring up a new channel or idea, the agency says yes and builds a plan around whatever you suggested. That's not nothing, but it's not what you're paying a retainer value for.

A real strategic partner brings a quarterly roadmap, explains the reasoning behind channel recommendations, and sometimes tells you the tactic you're excited about isn't the right call right now. They surface things you didn't ask about: a competitor launched something new, a keyword cluster is gaining volume, an ad format you're not using is outperforming in your category. That's the work. If none of that sounds familiar, you might have an outsourced marketing partner in name only.

5. Can You Describe What's Working, Without Asking?

Here's an honest test: without pulling up anything, can you describe what's performing in your marketing program right now? Which channel is generating the most leads? What's being tested? What got deprioritized last month and why? If you can answer those questions with reasonable confidence, your agency's reporting transparency is doing its job. If you'd have to send an email to find out, it isn't.

Proactive communication looks like a standing monthly report delivered without prompting, a clear written narrative alongside the data (not just a marketing dashboard screenshot), and some form of week-to-week visibility into what's actively being worked on. Not everyone needs a daily Slack update, but you should never have to wonder whether anything is happening.

We get this question a lot from businesses considering switching agencies, and the honest answer is: the agencies that communicate well tend to perform better too. It's not a coincidence. Proactive communication and proactive optimization come from the same underlying culture. Agencies that go quiet when results are soft are usually the same ones that never flag a problem until you do.

6. Does the Agency Push Back, or Just Say Yes?

My read is that a "yes agency" is one of the most expensive problems a business can have, and it's the one least likely to get named. When an agency agrees with every idea you bring, approves every direction you suggest, and never recommends a different path than the one you asked for, they're prioritizing your comfort over your results. That's not expertise. That's order-taking with a nicer invoice. You should be at least a little suspicious if your agency has never told you no.

Healthy friction is a feature. It means the people running your marketing actually have a point of view, which is what you're paying for. For more on the structural reasons agencies fall into this pattern, the post on why agencies overpromise is worth reading before you renew.

7. How Does the Agency Handle a Bad Quarter?

Call this the bad quarter test. Any agency looks competent when campaigns are performing and leads are flowing. The real character of the agency-client relationship shows up when something misses: a campaign underperforms, a channel goes flat, or an algorithm shift hits organic traffic. What happens next is the most revealing data point in the entire engagement.

A good agency explains what happened with specificity, owns the parts that were within their control, and shows up to the next conversation with an adjusted plan. A mediocre one produces a long explanation about external factors, platform changes, and market conditions. Both things can be true simultaneously, that external forces were real and the agency also dropped something. The ones worth keeping are the ones who can say both out loud.

This one can't be measured with a spreadsheet. It's about trust, and trust only accumulates through how an agency behaves when things go sideways. If you've never had a bad quarter together, you don't actually know yet. For more on what a good agency relationship looks like in practice, that post covers the client side of the equation too.

Frequently Asked Questions

How do I know if my marketing agency is actually working?

The clearest signal is whether cost per lead and conversion rates are improving over time. If they are, the agency is working. If reports focus on reach and impressions without connecting them to actual leads or pipeline, and no one has established baseline benchmarks, you don't have enough data to answer the question yet. That's itself a problem worth addressing.

What metrics should a marketing agency report on each month?

A solid monthly report covers: leads generated by channel, cost per lead, organic traffic and keyword position movement, conversion rate by campaign or landing page, ROAS for any paid media, and some form of pipeline attribution if your sales cycle allows it. Reach and impressions can appear, but they shouldn't be the lead story. Revenue-connected metrics should be.

When should I fire my marketing agency?

Fire your agency if: cost per lead has been flat or worsening for three or more consecutive months with no credible explanation or adjusted plan, you're regularly discovering problems before they do, the reporting doesn't include conversion data, or they've never pushed back on a single thing you've suggested. One bad quarter is a data point. A pattern without accountability is a reason to leave.

How do I find a marketing agency in Portland I can actually trust?

Start by asking for baseline benchmarks from month one of any engagement you're reviewing, then ask how the agency handles underperformance. The answers tell you more than a portfolio. Sproutbox is a Portland-based full-service digital marketing agency specializing in outsourced marketing, SEO, paid media, and lead generation. If you want a starting point, the Portland marketing agency page explains how we work and what the engagement structure looks like.

The Renewal Decision Shouldn't Feel Like a Gamble

These seven criteria take less than an hour to work through, and they give you an objective foundation for a conversation that most businesses have entirely on gut feel. Run them before you renew, not after you've already started to pull away. The goal isn't to find reasons to leave; it's to know clearly whether you have reasons to stay.

If the answers to most of these make you uneasy, that's worth a direct conversation with your agency before you do anything else. And if you've had that conversation and still don't like what you're hearing, it's worth understanding what a different structure could look like. You can see how Sproutbox structures its retainers if you want something concrete to compare against.

If you're asking these questions and not liking the answers, we're happy to take a look. Schedule a call, no pressure, no pitch deck, just an honest conversation about what you're seeing and whether there's a better path.