Most agency searches stall in the same place: a long list of plausible names, a folder of capabilities decks, and no objective way to compare them. This framework fixes that. It gives you a side-by-side scorecard you can apply to any shortlist, in any market, so the decision is driven by evidence rather than the slickest pitch.
## Build the shortlist before you compare
A good shortlist is five to seven agencies, deliberately mixed:
- Two specialists in your priority discipline (e.g. paid social, SEO, brand). - Two full-service partners that could own multiple channels. - One sector specialist who already knows your buyers. - One challenger, smaller, hungrier, often sharper.
This mix forces you to compare different operating models, not just different logos.
## The comparison scorecard
Score each agency from 1–5 across the eight dimensions below. Multiply by the weighting that matters most to your business.
### 1. Services match (weight: high) Does their core offer line up with the work you actually need? Beware agencies that bolt on disciplines they do not deliver in-house.
### 2. Sector experience (weight: high if your sector is technical or regulated) Look for relevant case studies, named clients, and people on the team who have lived in your industry.
### 3. Case-study credibility Numbers, timeframes, budgets, and the client's own words. Vague "300% growth" claims without context score zero.
### 4. Reviews and references Independent platforms (Clutch, Google, LinkedIn recommendations) and at least two reference calls you arrange yourself.
### 5. Strategic depth The pitch should include a point of view on your business, not just a menu of services. Ask them to critique your current marketing.
### 6. Reporting and transparency Request a sample monthly report. Look for outcome metrics, honest commentary on what failed, and a clear next-step plan.
### 7. Commercial structure Is pricing legible? Are media spend, tooling, and production costs separated from agency fees? Are there exit terms you can live with?
### 8. People and chemistry The team you meet in the pitch must be the team that runs your account. Score the operators, not the pitch lead.
## A worked example
| Dimension | Weight | Agency A | Agency B | Agency C | |---|---|---|---|---| | Services match | 3 | 5 (15) | 4 (12) | 3 (9) | | Sector experience | 3 | 3 (9) | 5 (15) | 4 (12) | | Case-study credibility | 2 | 4 (8) | 5 (10) | 3 (6) | | Reviews & references | 2 | 4 (8) | 4 (8) | 5 (10) | | Strategic depth | 3 | 5 (15) | 4 (12) | 3 (9) | | Reporting & transparency | 2 | 3 (6) | 5 (10) | 4 (8) | | Commercial structure | 2 | 4 (8) | 3 (6) | 5 (10) | | People & chemistry | 2 | 5 (10) | 4 (8) | 4 (8) | | **Total** | | **79** | **81** | **72** |
The scorecard rarely produces a runaway winner, and that is the point. It surfaces the real trade-offs (sector depth vs. commercial flexibility, strategic firepower vs. reporting maturity) so you can choose with eyes open.
## What to ask in the pitch
- "Show us a campaign you would not run again, and why." - "Which of our current marketing channels would you cut on day one?" - "What does your team do internally vs. outsource?" - "How will you make our internal team better, not just busier?" - "What is the smallest meaningful result we should expect in 90 days?"
## After the pitch
Within 24 hours, have each evaluator score independently, *then* compare. Group scoring biases the room toward whoever speaks first. Discuss the gaps in scores; that is where the real insight lives.
Finally, do the reference calls. Ask each reference: *"What do they do brilliantly? Where do they need to be managed?"* Honest answers from current clients are worth more than any deck.
