Websites With Chat, Mystery-Shopped: How to Test Competitors’ Chat in One Hour and Copy What Works

Websites with chat are everywhere in your industry, and each one is a free lesson. Some answer in seconds with exactly the right detail; others greet you with a generic bot that goes nowhere. Testing them politely, as a curious visitor, shows you what customers in your market have come to expect and where your own chat stands. This guide gives you a one-hour method: which sites to pick, what to ask, what to record, how to stay ethical, and a scorecard that ranks your chat against three competitors and lists exactly where they beat you.

3competitor sites
7things to record
2visits each
1 hrtotal time

⚡ In short

  • Pick three competitors your customers also visit, plus your own site.
  • Ask each one the same genuine question, once in working hours and once after hours, from a phone.
  • Record seven things: visibility, greeting, reply time, answer, handover, contact request and after-hours.
  • Score them below, then copy the specific habits that beat you, not the whole setup.
Websites with chat in LiveChatBot: the chat widget on an online store answering a delivery question
How it looks in LiveChatBot: the chat widget on an online store answering a delivery question.

Why bother

Your customers compare you, so compare yourself first

Customers rarely visit just one shop, online or offline, and most of the websites with chat in your niche get the same questions you do. Someone looking for a coaching class, a sofa or a dentist opens three or four tabs and asks the same question in each. Whoever answers clearly and quickly gets the next step: the call, the visit, the order.

That makes competitor websites with chat the best benchmark you have. Industry averages are vague and often come from big companies with large teams. Your competitors are your real benchmark: the same customers, the same questions, similar budgets.

Mystery shopping their chat tells you three useful things:

  • The expectation level. If two competitors reply within a minute, a 15-minute reply from you looks slow, even if it’s good for a small team.
  • Good ideas you haven’t thought of. A greeting that mentions free delivery on the product page. A bot that asks the pin code first. A callback offer when nobody is free.
  • Gaps you can win on. If nobody handles after-hours enquiries well, a simple away form that promises a reply by 10 am already puts you ahead.

The point isn’t to copy a competitor’s whole setup. It’s to find two or three specific habits worth adopting, and one or two gaps worth owning.

Pick the sites

Four sites, chosen on purpose

The comparison only means something if the sites are real alternatives for your customers.

1

Your own site

Always include it, tested the same way as the others. Owners are often surprised by their own chat on a phone.

2

The local leader

The business customers mention most often in your area or niche. It sets the expectation.

3

A similar-sized rival

A business with a team like yours. If they manage something, you can too.

4

A wildcard

A well-run business from a neighbouring industry or another city. It brings ideas your direct rivals don’t have.

Ethics

Mystery shop politely: rules to follow

The other side of every chat is a real person or a bot someone paid for. Testing should cost them almost nothing.

Ask genuine questions

Ask something a real customer would ask and you would genuinely like to know. “Do you deliver to Thane, and how long does it take?” is fine. Fake complaints, fake orders and trick questions are not.

Don’t give false personal details

If they ask for a phone number or email, either decline politely (“I’m just comparing for now, thanks”) or end the chat. Never enter someone else’s details, and don’t invent ones that waste their follow-up time.

Keep it short

Two or three messages are enough to judge reply time, answer quality and handover. Thank them and close.

Don’t publish or name and shame

This research is for you. Note what you learn, not who did badly. If you share results with your team, focus on the habit, not the company.

Respect the after-hours form

When you test after hours, look at what the site offers. Only submit the form if you’re genuinely happy to be contacted, and if you do, reply to them when they get back to you.

What to ask

Test questions that reveal a lot

Pick one that fits your industry and use the same wording on every site.

Do you deliver to [your area] and how many days does it take? Is cash on delivery available?
What does a basic [service] cost, and can I book for this Saturday?
Is the weekend batch for [course] still open, and what are the fees?
Do you have a slot tomorrow evening, and do I need to pay in advance?
Thanks. If I have more questions later, how can I reach you?

Free tool

Score your chat against three competitors

Name the sites, choose what you saw for each, and press the button. The scorecard ranks all four and lists where a competitor beat you.

What you saw
Chat visible on a phone within 5 seconds
Greeting
First reply
Answer to your question
When stuck, offered a person or callback
Asked for contact details
After-hours visit

Runs only in your browser; nothing is saved. Scores are out of 100; “Not tested” is left out and the score is scaled to the parts you did test.

What to record

Seven observations, and how to judge each

Write things down during the visit, not afterwards. A notes app with one line per site is enough. Here’s what each row of the scorecard means.

1. Visible on a phone within 5 seconds

Open the site on your phone over mobile data. Count how long until the chat button appears. If a cookie banner covers it or it only appears after scrolling, note “slow or hidden”.

2. Greeting

Did the chat greet you, and did the greeting fit the page? “Need help choosing a size?” on a product page beats a generic “Hi, how can we help?” on every page.

3. First reply time

From your message to the first reply that addresses your question. An instant “We’ll be with you shortly” doesn’t count; a useful bot answer does. Our response time guide explains what customers expect.

4. Answer

Correct and complete, partly, or wrong. “Please call us” in reply to a simple price question counts as partly at best.

5. Handover

If the bot or person couldn’t answer, did they offer a person, a callback or a ticket? If your question was answered, choose “not needed”.

6. Contact request

Asking for an email after helping is good practice. Demanding it before answering is a barrier. Never asking means a lost lead if you leave.

7. After hours

Visit again outside working hours. Did a form or bot capture your question with a clear promise of when they’d reply?

Turning findings into changes

Copy the habit, not the software

Typical gaps a mystery shop reveals, and a small fix for each.

Competitors reply in a minute; you take ten.
🚩 You nowYou reply from a laptop only.
✅ TryAnswer from your phone too, and set notifications so new chats aren’t missed.
A rival greets visitors on product pages.
🚩 You nowYou show one generic greeting everywhere.
✅ TryWrite two or three page-specific greetings for your busiest pages.
Nobody answers after 8 pm.
🚩 You nowYour chat shows ‘offline’ and nothing else.
✅ TryAdd an away form with a clear promise: ‘We’ll reply by 10 am.’
The leader’s bot answers delivery questions instantly.
🚩 You nowYour team types the same answer 20 times a day.
✅ TrySave the answer once and let a bot or saved reply send it.

One-hour plan

Run the whole exercise in a single sitting, plus one evening visit

Block the time in your calendar. Repeat every three months.

0–10 minChoose and list the sites

Your own, the local leader, a similar-sized rival and a wildcard.

10–15 minWrite your test question

One genuine question in your customers’ words, the same for every site.

15–45 minDaytime visits on your phone

About seven minutes per site. Record each row as you go.

EveningAfter-hours visits

Five minutes, all four sites, after closing time.

45–60 minScore and decide

Fill in the scorecard. Pick two habits to copy and one gap to own.

Act on it

Fix your own chat this week

Studying websites with chat is only useful if your own changes. Take the gaps the scorecard listed and turn each into a single task with a date.

Most fixes are small. If competitors greet visitors on product pages, write a page-specific greeting and show it with a proactive message; see proactive live chat. If they capture after-hours enquiries better, set opening hours and an away form. If their first message is warmer and clearer, rewrite yours with our welcome message guide. If they answer common questions instantly, save those answers and let a bot send them.

In LiveChatBot, all of these are included in the free plan: Flows for proactive greetings with page and device conditions, opening hours with an away form that collects email or phone, saved replies, an AI Agent that answers from your knowledge, and an Android app so you can reply from anywhere. The free plan covers two websites with 100 visitors per website each month. Set it up on livechatbot.in, then mystery-shop yourself again in a week.

One last tip: ask a friend to test your site the same way, without telling them what you changed. Your own visits are biased; you know the answers already. A fresh visitor shows you what customers actually experience.

Frequently asked questions

Is it okay to test competitors’ websites with chat?

Yes, if you behave like a genuine visitor: ask real questions, keep it short, don’t give false details and don’t publish the results.

How many competitors should I test?

Three is enough: the local leader, a similar-sized rival and one well-run business from a nearby industry, plus your own site.

Should I test from a phone or a laptop?

A phone on mobile data first, because that’s how most visitors arrive. Add a laptop visit if your customers mostly buy from desktops.

What matters most in the scores?

The answer to your question and the first reply time carry the most weight, because they decide whether a visitor takes the next step.

How often should I repeat it?

Every three months, or after you or a competitor change something big, like adding a bot or new opening hours.

Keep reading

Related guides

📘

Website Chat App Requirements: Write a One-Page Spec Before You Choose (Free Spec Builder)

Read the guide →

🧭

Website Bot Visitors: How to Spot Crawlers, AI Scrapers and Spam Bots in Your Traffic and Chat

Read the guide →

🛠️

Web Chatroom Safety for Members and Moderators: Room Rules, Scam Patterns and a Free Oversharing Screener

Read the guide →

Make your chat the one customers remember

Benchmark it, fix the gaps and answer faster than the competition. Start free on livechatbot.in.