How to Evaluate a B2B SEO Agency Without Getting Burned

TL;DR

A B2B SEO agency is a specialized firm that provides search engine optimization strategy, technical audits, content optimization, link acquisition, and performance reporting for B2B companies selling to other businesses. Evaluating one well means asking 14 specific questions across four categories: who actually does the work, how the agency thinks about keyword strategy, whether reporting is honest, and what happens when results underperform. Agencies that can answer 12 or more are operators. Agencies that deflect three or more are order-takers.

I've sat on the other side of the sales table for sixteen years. I've watched B2B companies hire the wrong SEO agency with enough regularity that the pattern is almost boring. The mistake is rarely about price. It is almost always about the evaluation process being too generic to surface the things that actually matter.

Below are the 14 questions I use to evaluate any B2B SEO agency on a single sales call. They separate operators from order-takers in about 45 minutes.

Why most B2B SEO agency evaluations produce bad decisions

Most companies evaluating a B2B SEO agency walk into the sales call with the wrong questions. They ask about case studies, they ask about client logos, they ask about the agency's process. The agency has polished answers for all of these. None of them reveal what the engagement will actually feel like twelve months in.

The signals that matter sit behind the polished pitch. Who actually does the work day to day. How does the agency make keyword strategy decisions. What happens when rankings do not move. How does the agency handle the quarter where everything goes sideways.

A buyer who knows what to ask can surface all of this in a single conversation. A buyer who doesn't will sign a retainer and find out over six to nine painful months.

The four categories every evaluation should cover

The 14 questions break into four categories. Each category is designed to reveal a specific failure mode common in B2B SEO agency engagements.

• Category one is staffing and delivery. Who actually does the SEO work and at what seniority.

  
  

• Category two is strategic approach. How does the agency think about keywords, content, and technical SEO as an integrated system.

  
  

• Category three is reporting and accountability. What metrics does the agency report on and what does transparency actually look like.

  
  

• Category four is problem handling. What happens when the engagement underperforms and how does the agency respond.

Run the evaluation in that order. Earlier categories reveal the most and set up the later questions.

Questions that reveal whether the agency actually does SEO work in-house

Three questions expose the staffing structure fast.

Question one. Who on your team will actually write the content, do the technical audits, and run the link acquisition for our account. Ask for names and titles, not just roles. Agencies that answer with fuzzy role descriptions are likely outsourcing the work to contractors and marking it up.

Question two. What percentage of the work on our account is done in-house versus by contractors or offshore teams. A legitimate B2B SEO agency will have mixed staffing. Agencies that claim 100 percent in-house are often misrepresenting. Agencies that are 80 percent offshore without disclosing it are a problem.

Question three. How many active B2B SEO accounts does our assigned strategist manage right now. Over twelve is a yellow flag. Over twenty is a red flag. The strategist will not have time for your account.

Questions that reveal how the agency thinks about keyword strategy

Four questions expose how the agency actually approaches keyword strategy, not how they pitch it.

Question four. Walk me through how you would approach keyword strategy for our business in the first 90 days. The strong answer names specific steps. SERP analysis, competitive keyword gap, customer conversation mining, intent mapping. The weak answer is vague about process and pivots to talking about tools.

Question five. How do you decide between going after a high-volume keyword versus a long-tail cluster. A good answer involves math — search volume, ranking probability, CPC as an intent signal, topical authority. A bad answer involves whichever keywords the client asks for.

Question six. Give me a specific example of a keyword strategy decision you disagreed with a client about and how you handled it. Agencies that have never disagreed with a client are yes-shops. They will execute badly-aimed briefs without pushback.

Question seven. What is your point of view on AI answer engines and how that changes keyword and content strategy in 2026. Agencies that do not have a formed opinion here are behind. The SERP landscape is mid-shift and any agency worth hiring has thought about it.

Questions that reveal whether the agency's reporting is honest

Three questions separate honest reporters from impression-inflators.

Question eight. What metrics do you report on monthly and which ones do you refuse to optimize for. A healthy agency will name metrics they will not chase — usually impressions, share of voice, or branded search volume — because they know these metrics can be gamed without moving pipeline. An agency that reports on everything is optimizing for the client's comfort, not the client's business.

Question nine. What is the worst quarter you have ever had with a client and what did the report look like. Agencies that can describe a bad quarter honestly will describe yours honestly. Agencies that have never had a bad quarter are rewriting history.

Question ten. How do you connect SEO outcomes to pipeline and revenue. Agencies that cannot answer this beyond generalities are doing SEO in isolation from the business. At B2B scale, this is disqualifying.

Questions that reveal how the agency handles underperformance

Four questions reveal how the agency behaves when the engagement goes sideways.

Question eleven. If three months in we are not seeing progress on our priority keywords,

what happens. Good answers involve a specific reset process, a renegotiation window, and clear escalation. Weak answers involve vague reassurance about time horizons.

Question twelve. What is your exit process if we decide the engagement is not working. Agencies that pretend this conversation will never happen are the ones who handle it badly when it does.

Question thirteen. What do you typically do when a client's internal team blocks the work. Every long SEO engagement hits this wall. The agency either has a playbook for it or does not.

Question fourteen. What is something you have changed about your agency in the last twelve months based on client feedback. This is the culture question. Agencies that cannot name a single change are not learning. Agencies that can name three or four are operators.

Red flags that should end the conversation immediately

Four behaviors should stop the evaluation mid-call.

🚩 The agency guarantees specific ranking positions. Nobody can guarantee Google ranking outcomes honestly. This is a lie that agencies tell to close nervous buyers. Walk away.

🚩 The agency refuses to name the people who will work on your account. The sales call features senior strategists who will never touch the account once signed. If the agency will not commit to named team members, the delivery team is a mystery until month two.

🚩 The agency describes their link acquisition as a trade secret. Legitimate link acquisition is digital PR, data studies, guest placements, and relationship work. Agencies that hide their link strategy are usually buying links in ways that will damage your domain.

🚩 The agency can't explain how they measure success beyond rankings and traffic. If pipeline, revenue, and attribution are not in the conversation by the second meeting, the agency will optimize for vanity metrics and you will pay for it at renewal.

What a strong B2B SEO agency answer actually sounds like

For reference, here is what a strong answer to question four — the keyword strategy question — actually sounds like.

We would start by pulling your current organic footprint in SEMRush to baseline what is working and what is underperforming. We would cross-reference that with your top three competitors to identify keyword gaps where you are under-indexed. Then we would interview three or four people on your sales team to surface the language your customers actually use, because half the keywords that matter will not show up in SERP research.

By week six we would have a prioritized keyword roadmap, mapped to your ICP, with ranking probability estimates and a monthly production capacity aligned to your retainer tier.

This is what operator thinking sounds like. Specific, sequenced, tied to the business, grounded in tools and process. If the agency's answer is vaguer than this, they are winging it or they are too junior to be running your engagement.

How to run a 60-minute agency evaluation call

Structure the call tightly. The agency will default to a pitch-driven flow if you let them. You need to run the call.

First ten minutes. Brief introduction on your side, then go straight into question one. Tell the agency upfront that you have 14 evaluation questions and would like to work through as many as possible. Sets the tone and prevents the pitch monologue.

Next forty minutes. Work through the four question categories. Aim for ten minutes per category. If the agency is giving short, direct answers, you will get to all 14. If they are giving nine-minute monologues on each question, you will get to six and that itself is data.

Final ten minutes. Let the agency ask their questions. Their questions reveal as much as their answers. Agencies that ask about your pipeline, your attribution, and your competitors are thinking like your partner. Agencies that ask about your budget are thinking like your vendor.

Frequently asked questions

What is a B2B SEO agency?

A B2B SEO agency is a specialized firm that provides search engine optimization services for companies selling to other businesses. The work typically includes keyword strategy, technical SEO audits, content optimization, link acquisition, and performance reporting, usually delivered on a monthly retainer. Good B2B SEO agencies connect SEO outcomes to pipeline and revenue, not just rankings and traffic.

How do you evaluate a B2B SEO agency before hiring?

Evaluate a B2B SEO agency across four categories on a single call. Who actually does the work and at what seniority, how the agency thinks about keyword strategy as a system, whether reporting connects to pipeline rather than vanity metrics, and how the agency handles underperformance. Agencies that answer 12 of 14 specific questions credibly are operators. Agencies that deflect three or more are order-takers.

What questions should you ask a B2B SEO agency in a sales call?

The most revealing questions include naming who will actually work on your account day to day, what percentage of work is outsourced to contractors, how the agency decides between high-volume and long-tail keywords, the worst quarter they have had with a client, how they connect SEO outcomes to pipeline, and what happens if three months in there is no progress on your priority keywords.

What are the biggest red flags when evaluating a B2B SEO agency?

Four red flags should end the evaluation. Guaranteeing specific ranking positions, which is

impossible to do honestly. Refusing to name the specific people who will work on your account. Describing link acquisition strategy as a trade secret, which usually hides paid links. Failing to discuss pipeline or revenue attribution by the second meeting.

How many clients should a B2B SEO agency strategist manage at once?

A B2B SEO agency strategist managing more than twelve active accounts is a yellow flag, and more than twenty is a red flag. At high account loads the strategist cannot do the deep thinking that makes an engagement work. Ask for the specific account load on your strategist before signing.

What does a healthy B2B SEO agency engagement actually look like?

A healthy engagement has a named strategist who carries fewer than twelve accounts, in-house delivery for the majority of the work, reporting that connects rankings to pipeline and revenue, willingness to discuss both successes and failures honestly, and a specific process for what happens if progress stalls in the first 90 days. These are the observable signals of operator-quality agencies.

Should a B2B SEO agency guarantee ranking results?

No legitimate B2B SEO agency guarantees specific ranking positions. Google's algorithm evolves constantly, competitive dynamics shift, and SERP features change what ranking even means. Agencies that guarantee rankings are either lying to close deals or using black-hat tactics that will damage the client's domain within six to twelve months.