Websites With Chat, Mystery-Shopped: How to Test Competitors’ Chat in One Hour and Copy What Works
Websites with chat are everywhere in your industry, and each one is a free lesson. Some answer in seconds with exactly the right detail; others greet you with a generic bot that goes nowhere. Testing them politely, as a curious visitor, shows you what customers in your market have come to expect and where your own chat stands. This guide gives you a one-hour method: which sites to pick, what to ask, what to record, how to stay ethical, and a scorecard that ranks your chat against three competitors and lists exactly where they beat you.
⚡ In short
- Pick three competitors your customers also visit, plus your own site.
- Ask each one the same genuine question, once in working hours and once after hours, from a phone.
- Record seven things: visibility, greeting, reply time, answer, handover, contact request and after-hours.
- Score them below, then copy the specific habits that beat you, not the whole setup.

Why bother
Your customers compare you, so compare yourself first
Customers rarely visit just one shop, online or offline, and most of the websites with chat in your niche get the same questions you do. Someone looking for a coaching class, a sofa or a dentist opens three or four tabs and asks the same question in each. Whoever answers clearly and quickly gets the next step: the call, the visit, the order.
That makes competitor websites with chat the best benchmark you have. Industry averages are vague and often come from big companies with large teams. Your competitors are your real benchmark: the same customers, the same questions, similar budgets.
Mystery shopping their chat tells you three useful things:
- The expectation level. If two competitors reply within a minute, a 15-minute reply from you looks slow, even if it’s good for a small team.
- Good ideas you haven’t thought of. A greeting that mentions free delivery on the product page. A bot that asks the pin code first. A callback offer when nobody is free.
- Gaps you can win on. If nobody handles after-hours enquiries well, a simple away form that promises a reply by 10 am already puts you ahead.
The point isn’t to copy a competitor’s whole setup. It’s to find two or three specific habits worth adopting, and one or two gaps worth owning.
Pick the sites
Four sites, chosen on purpose
The comparison only means something if the sites are real alternatives for your customers.
1
Your own site
Always include it, tested the same way as the others. Owners are often surprised by their own chat on a phone.
2
The local leader
The business customers mention most often in your area or niche. It sets the expectation.
3
A similar-sized rival
A business with a team like yours. If they manage something, you can too.
4
A wildcard
A well-run business from a neighbouring industry or another city. It brings ideas your direct rivals don’t have.
Ethics
Mystery shop politely: rules to follow
The other side of every chat is a real person or a bot someone paid for. Testing should cost them almost nothing.
Ask genuine questions
Ask something a real customer would ask and you would genuinely like to know. “Do you deliver to Thane, and how long does it take?” is fine. Fake complaints, fake orders and trick questions are not.
Don’t give false personal details
If they ask for a phone number or email, either decline politely (“I’m just comparing for now, thanks”) or end the chat. Never enter someone else’s details, and don’t invent ones that waste their follow-up time.
Keep it short
Two or three messages are enough to judge reply time, answer quality and handover. Thank them and close.
Don’t publish or name and shame
This research is for you. Note what you learn, not who did badly. If you share results with your team, focus on the habit, not the company.
Respect the after-hours form
When you test after hours, look at what the site offers. Only submit the form if you’re genuinely happy to be contacted, and if you do, reply to them when they get back to you.
What to ask
Test questions that reveal a lot
Pick one that fits your industry and use the same wording on every site.
Free tool
Score your chat against three competitors
Name the sites, choose what you saw for each, and press the button. The scorecard ranks all four and lists where a competitor beat you.
| What you saw | ||||
|---|---|---|---|---|
| Chat visible on a phone within 5 seconds | ||||
| Greeting | ||||
| First reply | ||||
| Answer to your question | ||||
| When stuck, offered a person or callback | ||||
| Asked for contact details | ||||
| After-hours visit |
Runs only in your browser; nothing is saved. Scores are out of 100; “Not tested” is left out and the score is scaled to the parts you did test.
What to record
Seven observations, and how to judge each
Write things down during the visit, not afterwards. A notes app with one line per site is enough. Here’s what each row of the scorecard means.
1. Visible on a phone within 5 seconds
Open the site on your phone over mobile data. Count how long until the chat button appears. If a cookie banner covers it or it only appears after scrolling, note “slow or hidden”.
2. Greeting
Did the chat greet you, and did the greeting fit the page? “Need help choosing a size?” on a product page beats a generic “Hi, how can we help?” on every page.
3. First reply time
From your message to the first reply that addresses your question. An instant “We’ll be with you shortly” doesn’t count; a useful bot answer does. Our response time guide explains what customers expect.
4. Answer
Correct and complete, partly, or wrong. “Please call us” in reply to a simple price question counts as partly at best.
5. Handover
If the bot or person couldn’t answer, did they offer a person, a callback or a ticket? If your question was answered, choose “not needed”.
6. Contact request
Asking for an email after helping is good practice. Demanding it before answering is a barrier. Never asking means a lost lead if you leave.
7. After hours
Visit again outside working hours. Did a form or bot capture your question with a clear promise of when they’d reply?
Turning findings into changes
Copy the habit, not the software
Typical gaps a mystery shop reveals, and a small fix for each.
One-hour plan
Run the whole exercise in a single sitting, plus one evening visit
Block the time in your calendar. Repeat every three months.
Your own, the local leader, a similar-sized rival and a wildcard.
One genuine question in your customers’ words, the same for every site.
About seven minutes per site. Record each row as you go.
Five minutes, all four sites, after closing time.
Fill in the scorecard. Pick two habits to copy and one gap to own.
Act on it
Fix your own chat this week
Studying websites with chat is only useful if your own changes. Take the gaps the scorecard listed and turn each into a single task with a date.
Most fixes are small. If competitors greet visitors on product pages, write a page-specific greeting and show it with a proactive message; see proactive live chat. If they capture after-hours enquiries better, set opening hours and an away form. If their first message is warmer and clearer, rewrite yours with our welcome message guide. If they answer common questions instantly, save those answers and let a bot send them.
In LiveChatBot, all of these are included in the free plan: Flows for proactive greetings with page and device conditions, opening hours with an away form that collects email or phone, saved replies, an AI Agent that answers from your knowledge, and an Android app so you can reply from anywhere. The free plan covers two websites with 100 visitors per website each month. Set it up on livechatbot.in, then mystery-shop yourself again in a week.
One last tip: ask a friend to test your site the same way, without telling them what you changed. Your own visits are biased; you know the answers already. A fresh visitor shows you what customers actually experience.
Frequently asked questions
Is it okay to test competitors’ websites with chat?
Yes, if you behave like a genuine visitor: ask real questions, keep it short, don’t give false details and don’t publish the results.
How many competitors should I test?
Three is enough: the local leader, a similar-sized rival and one well-run business from a nearby industry, plus your own site.
Should I test from a phone or a laptop?
A phone on mobile data first, because that’s how most visitors arrive. Add a laptop visit if your customers mostly buy from desktops.
What matters most in the scores?
The answer to your question and the first reply time carry the most weight, because they decide whether a visitor takes the next step.
How often should I repeat it?
Every three months, or after you or a competitor change something big, like adding a bot or new opening hours.
Keep reading
Related guides
Website Chat App Requirements: Write a One-Page Spec Before You Choose (Free Spec Builder)
Website Bot Visitors: How to Spot Crawlers, AI Scrapers and Spam Bots in Your Traffic and Chat
Web Chatroom Safety for Members and Moderators: Room Rules, Scam Patterns and a Free Oversharing Screener
Make your chat the one customers remember
Benchmark it, fix the gaps and answer faster than the competition. Start free on livechatbot.in.