Start your website chatbot with five questions customers already ask
A website chatbot is easiest to evaluate when you give it a narrow job. Look at recent sales enquiries or support tickets and pick five questions that repeat often and have answers your team can verify. Opening hours, delivery regions and which documents to bring to an appointment are sensible starting points.
Give the assistant approved answers
Write a short reference answer for each question and link it to the page or document the team maintains. Name someone to update the source when prices, hours or processes change. Decide which questions should go directly to a person, such as account-specific requests or quotations that need judgement. Keep the amount of customer information captured in a conversation proportionate to the handoff.
Test variations and unusual requests
- Ask the same question in several ways and check the facts in each reply.
- Ask for information that is absent from the approved material. Check whether the assistant asks a clarifying question or offers a human handoff.
- Try an ambiguous request that could apply to two services. Review what the assistant assumes and what it asks.
- Follow a handoff through to the person who will reply. Check the context they receive and what the visitor sees.
Decide what earns a wider rollout
Pick a short pilot period and review a sample of conversations. Track incorrect answers, repeat questions and the proportion of handoffs the team could act on. Expand the topic list only when the test explains where the assistant is helping and where supervision still matters.
For a scoped pilot with approved answers and a defined handoff, see our AI chatbot and assistant service.