An Agency Evaluation Scorecard Hosts Can Print and Use

Most independent hosts evaluate a marketing agency the way they'd evaluate a first date: gut feeling, tone of the sales call, a portfolio that looks impressive at a glance. That approach works fine until the agency you hired based on vibes turns out to have a completely different process, ownership structure, or exit terms than you assumed going in.

A scorecard doesn't replace judgment - it structures it. Walking through the same set of concrete questions with every agency you talk to makes the comparison fair and makes it much harder for a strong sales pitch to paper over a weak process underneath.

This isn't about finding the cheapest option or the most impressive-sounding one. It's about finding the agency whose actual process, ownership terms, and deliverables match what your specific property and stage of business actually need. This is not legal advice.

Ownership of Assets and Accounts

Ask directly who owns the listing photos, the written copy, and any website or content built during the engagement if you leave the agency. Some agencies retain rights to creative work by default unless the contract says otherwise, which can leave a host starting from zero after a switch.

Ask who holds login credentials to platform accounts, analytics tools, and any advertising accounts set up on the property's behalf. An agency that won't clearly answer this question, or that structures access so the host can't independently verify what's happening, is a real flag worth weighing heavily.

Get asset and access ownership terms in writing before signing, not as a verbal assurance during the sales process. Verbal assurances rarely survive a dispute; contract language does.

Actual Process, Not Just Promised Outcomes

Ask what a typical month of work actually looks like - not the results promised, but the concrete tasks: how many photos are taken, how often copy is revised, what reporting is delivered and on what schedule.

Ask for an example of past work on a comparable property, ideally one you can look at directly rather than a curated screenshot. A specific, verifiable example says more than a general claim about experience.

Ask what happens when something isn't working - a listing update that didn't move performance, a photo set that underperformed. An agency with a clear process for revisiting and adjusting is more valuable long-term than one that only talks about wins.

Pricing Structure and What It Actually Covers

Get a full accounting of what's included in the quoted price versus what's billed separately - photography, paid advertising spend, additional revisions, rush requests. A low headline price with many add-ons can end up costing more than a higher all-in quote.

Ask how pricing changes over time - does it increase with property performance, with portfolio size, with contract renewal - so you're not surprised by a renewal quote that looks nothing like the initial engagement.

Compare pricing structures across at least two or three agencies before deciding, not to find the cheapest option, but to understand what's a typical inclusion versus what one agency is charging extra for that another bundles in.

Communication and Response Expectations

Ask directly what response time to expect for routine questions versus urgent issues, and get that in writing rather than relying on how responsive the sales team was during the pitch - which is not always representative of ongoing account service.

Ask who your specific point of contact will be day to day, and whether that's the same person handling multiple accounts or a dedicated contact. A larger portfolio per account manager often means slower, more templated responses.

Ask what reporting actually looks like - a real example, not a description - and whether it's something you can interpret without a follow-up call every time, or whether it requires the agency to translate their own numbers for you.

Exit Terms Before You Need Them

Ask what the contract requires to end the engagement - notice period, remaining term commitment, any early termination fee - before you sign, not when you're already trying to leave.

Ask what happens to active advertising campaigns, ongoing SEO work, or any in-progress projects if the engagement ends mid-cycle. An unclear answer here often means a messy, disruptive transition later.

Ask for a written commitment on data and asset handoff timing if you leave - how quickly will photos, copy, and performance history be transferred, and in what format. A vague or evasive answer to this specific question is one of the more reliable red flags available.

References and Verification, Not Just Testimonials

Ask for at least one reference you can contact directly, ideally a host with a property comparable in size or market to yours, not just a polished written testimonial curated for the agency's own marketing.

When you do speak with a reference, ask about the parts of the relationship that aren't flattering - what took longer than expected, what required pushing back on, what they'd do differently if starting over.

Search independently for the agency's past work rather than relying only on what they choose to show you. A quick, direct look at a live listing they claim to manage tells you more than a case study slide.

Fit for Your Specific Stage and Property Type

An agency that specializes in scaling multi-unit portfolios may not be the right fit for a single-property owner who needs hands-on, detailed local knowledge, and the reverse is equally true. Ask directly what property types and portfolio sizes make up most of their current client base.

Ask how they'd approach your specific property's actual constraints - a unique layout, a niche market, a regulatory environment - rather than accepting a generic answer about their overall approach to marketing.

If an agency's answer to a specific question about your property sounds identical to what they'd say about any property, that's worth noting. The best-fit agencies usually engage with the particulars, not just the pitch.

Using the Scorecard Across Multiple Conversations

Fill out the same scorecard for every agency you talk to, even the one that feels like an obvious front-runner after the first call. A structured comparison catches gaps that a strong first impression can otherwise paper over.

Revisit the completed scorecards after a short cooling-off period rather than deciding immediately after the last call, when the most recent conversation tends to carry disproportionate weight in the decision.

Keep the completed scorecard on file after you decide. If the relationship doesn't work out as expected, it becomes a useful record of what was promised at the outset versus what was actually delivered.

Related Reading

More independent-host scorecard and worksheet reading already live on Crest & Cove.

• The Independent Host Marketing Scorecard: A 100-Point Diagnostic

• Listing Quality Scorecard: Photos, Copy, Amenities, and Rules

• A Market Fit Scorecard Before You Buy or Launch a Stay

• A Seasonal Readiness Worksheet Independent Hosts Can Keep

• A Content Brief Worksheet for Town and Niche Host Posts

• A Weekly Host Marketing Operating Rhythm on One Page

• A Pre-Photoshoot Prep Worksheet Independent Hosts Can Use

• How Independent Hosts Should Read a Market Report

• First Photos: Airbnb Listing Order

• Access Instructions, Conversion, and Insurance

• Pet-Friendly Vacation Rental Marketing

• Direct Booking UX Patterns That Convert

Frequently Asked Questions

What's the most important question to ask an agency about asset ownership?

Ask directly who owns the listing photos, written copy, and any website or content built during the engagement if you ever leave. Some agencies retain rights to creative work by default unless the contract says otherwise, which can leave a host starting from zero after a switch. The same goes for login credentials to platform accounts and ad accounts - an agency that won't answer clearly there is a real flag. Get it in writing before signing, since a verbal assurance rarely survives an actual dispute.

How can a host verify an agency's claimed process instead of just trusting the pitch?

Ask for a specific, verifiable example of past work on a comparable property, ideally one you can look at directly rather than a curated screenshot, and ask what a typical month of actual tasks looks like rather than just the promised outcomes. Also ask what happens when something isn't working - a listing update that didn't move performance, a photo set that underperformed. An agency with a clear process for revisiting and adjusting is worth more long-term than one that only talks about wins.

What pricing details often get missed during agency evaluation?

Get a full accounting of what's included in the quoted price versus billed separately - photography, paid advertising spend, extra revisions, rush requests. A low headline price with many add-ons can end up costing more than a higher all-in quote. Ask how pricing changes over time too, whether it rises with property performance, portfolio size, or contract renewal, so a renewal quote doesn't blindside you later. Compare structures across two or three agencies before deciding.

Why do exit terms matter before signing rather than after?

Ask what the contract requires to end the engagement - notice period, remaining term commitment, any early termination fee - before you sign, not once you're already trying to leave. Also ask what happens to active advertising campaigns or in-progress projects if the engagement ends mid-cycle, and get a written commitment on how quickly photos, copy, and performance history transfer. A vague or evasive answer on handoff timing is one of the more reliable red flags available.

Should a host trust written testimonials from an agency's own marketing?

Treat a polished testimonial as a starting point, not verification. Ask for at least one reference you can contact directly, ideally a host with a comparable property, and when you do talk to them, ask about the parts of the relationship that weren't flattering - what took longer than expected, what required pushing back on. Search independently for the agency's past work too, rather than relying only on what they choose to show you.

How does portfolio size affect the level of service a host should expect?

Ask who your specific point of contact will be day to day, and whether that's the same person handling multiple accounts or a dedicated contact. A larger portfolio per account manager often means slower, more templated responses. Ask directly what response time to expect for routine questions versus urgent issues too, and get that in writing rather than relying on how responsive the sales team was during the pitch, which isn't always representative of ongoing service.

Is a specialized agency always better than a generalist one?

Not necessarily - fit depends on your property type and stage of business. An agency that specializes in scaling multi-unit portfolios may not be the right fit for a single-property owner who needs hands-on, detailed local knowledge, and the reverse is equally true. Ask directly what property types and portfolio sizes make up most of their current client base, and how they'd approach your specific property's actual constraints rather than a generic answer.

What should happen after filling out the scorecard for multiple agencies?

Fill out the same scorecard for every agency you talk to, even the one that feels like an obvious front-runner after the first call, since a structured comparison catches gaps a strong first impression can paper over. Revisit the completed scorecards after a short cooling-off period rather than deciding immediately after the last call, when the most recent conversation tends to carry disproportionate weight. Keep the finished scorecard on file after you decide, as a record of what was promised.

Work with Crest & Cove Creative

A confident sales call tells you almost nothing about who owns your photos if you leave, or what a real month of work looks like. A scorecard turns comparison into something concrete.

We're happy to walk any host through what a fair agency evaluation should cover, including the questions most sales calls never answer. Reach out at crestcove.co or (256) 998-7502. Send the live listing draft and the facts you can actually cite.

Reach out at crestcove.co or (256) 998-7502.