AI Chatbot for Your Website: The 10-Question Test Before You Switch One On
AI chatbot tools all look the same on a sales page. The difference shows when a customer asks something tricky. Here’s how to tell a safe bot from a risky one before your customers find out.
β‘ In short
- A website bot should answer only from your content. You are responsible for what it says.
- Run the 10-question test below on any tool before you buy.
- Use the calculator to see if it will save your team real time.

The basics
A website chatbot is not ChatGPT
Two kinds of tools show up when you search for this. This guide is about the second kind.
General AI assistant
- Used by one person for their own questions
- Answers from everything it learned
- Often guesses when unsure
- The user decides whether to trust it
Chatbot on your website
- Used by your visitors and customers
- Answers only from your FAQ and pages
- Hands over to a person when unsure
- Your business is responsible for every answer
How an AI chatbot answers a question
Six moments in one chat, from the first question to a person stepping in. Click any step, or press Play.
π‘ Why step 2 matters: AI writes by predicting likely words. Without your content to work from, a confident answer can still be wrong.
Learn from others
Two real cases where chatbots went wrong
Air Canada, 2024
The bot told a grieving passenger he could claim a bereavement discount after flying. The real policy said no.
The airline argued the bot was "responsible for its own actions". A tribunal disagreed and made the airline pay.
DPD, 2024
After a system update, the delivery firm's bot swore at a customer and wrote a poem mocking the company.
DPD switched the AI part off while it fixed the problem.
What these cases teach
- Whatever the bot says, your business said it.
- Refunds and policy calls go to a person.
- Read the bot's chats weekly. Use this 20-minute routine.
The checklist
The 10-question test for any AI chatbot
Ask every tool these questions, including ours. Then check the answers yourself in the tool's test chat.
Accuracy and safety
1
Where do its answers come from?
β Good: only your knowledge and pages
π© Red flag: "it already knows everything"
2
What happens when it doesn't know?
β Good: it says so and hands over
π© Red flag: it answers anyway
3
Can visitors reach a person anytime?
β Good: a visible "Talk to a person" button
π© Red flag: visitors must argue with the bot
4
Can I block topics?
β Good: plain rules like "Never promise a refund"
π© Red flag: no control over behaviour
Control and day-to-day use
5
Can I test it before customers see it?
β Good: a private test chat
π© Red flag: you find problems live
6
Can I read every bot chat?
β Good: full transcripts and a resolution number
π© Red flag: only totals
7
How do I fix a wrong answer?
β Good: edit the knowledge and it works straight away
π© Red flag: "raise a ticket" or "retrain the model"
8
Does it say it's a bot?
β Good: yes, with a name you choose
π© Red flag: it pretends to be human
Cost and data
9
What happens at the usage limit?
β Good: a clear monthly limit, then a simpler mode or your team takes over
π© Red flag: surprise bills, or it goes silent
10
Where does chat data go?
β Good: it names every processor, AI providers included
π© Red flag: vague answers
The two that matter most
Questions 2 and 3. In a June 2025 Gartner survey of 4,800+ customers, the top worry about AI service was not being able to reach a person.
Do the maths
Will it pay off? Try the numbers
Use last month's chats, or emails and WhatsApp messages if you don't have chat yet.
Count after-hours chats too
Chats that came in when nobody was online are lost leads. A bot that answers and takes an email turns them into a morning call list.
When you don't need one yet
Under about 100 chats a month? Live chat with saved replies is probably enough.
Getting started
What to give it first
Write answers the way you'd say them on the phone. Ten clear answers beat a hundred vague ones.
Give it
- Your 10β20 most-asked questions
- Delivery, returns and warranty
- Prices that rarely change
- Hours, address and how to book
Keep out
- Customer personal data
- Internal notes and passwords
- Prices that change daily
- Medical, legal or money advice
1
Knowledge
Type questions and answers, or copy your web pages.
2
Name & tone
Pick a name and style, then add rules.
3
Try it out
Test privately. Visitors see nothing.
4
Pass to a person
Show the "Talk to a person" button.
Free FAQ mode or Advanced AI
Free FAQ mode
Replies with your best-matching answer, exactly as you wrote it.
Advanced AI
Writes natural replies from the same knowledge. It never goes outside your content. See the AI Agent.
FAQ
Is an AI chatbot the same as ChatGPT?
No. ChatGPT answers from everything it has learned. A website chatbot should answer only from your business information and hand over when it can't.
Can it answer in Hindi or Hinglish?
Yes, visitors can write in their own language. Add your key answers in the languages your customers use.
Will a chatbot replace my support team?
No. It handles repeat questions and night-time chats. Complaints, refunds and sales still need people. See chatbot vs live chat.
Am I responsible for wrong answers?
Treat it as if you are. The Air Canada tribunal held the company responsible. This is general information, not legal advice.
How long does setup take?
About an hour for your top questions, then 20 minutes a week reading chats.
Keep reading
Related guides
Chat Bot Online Free Test: 15 Questions That Show if a Bot Is Any Good
Bot Chat AI or Button Bot? A 2-Minute Quiz to Pick the Right One for Your Website
Artificial Bot or Real Person? How to Tell Visitors Honestly, With Wording You Can Copy
Bots Example: Building a Real Bot for a Coaching Institute, Step by Step
More to read
More guides on this topic
24/7 AI Customer Support Chatbot: Test What Actually Happens at 2 AM Before You Buy One (Free Midnight Test Script)
Best Conversational AI Chatbot: Ten Test Conversations to Run Before You Choose, Each Built to Expose a Weakness (Free Copy-Ready Test Script)
AI Chatbot With Website Training: The 12-Question Acceptance Test to Run Before You Trust It With Customers (Free Test Checklist)
Try it on your own questions
Add your top 10 questions, test them privately, and switch on when you're happy. Free to start.