Practical guide
Design a test set of difficult product questions
Design a test set of difficult product questions: a practical process, a clearly illustrated example and checks to use before the next live session.
A practical process
- Collect ambiguous, incomplete and easily confused questions from real operating notes
- Write the expected answer or escalation before testing the assistant
- Keep failed examples so later changes can be checked against the same set.
Worked example
For example, include questions about a missing accessory, an old price and an unsupported device model. A useful test set checks whether the assistant knows when to answer, clarify or stop and ask for verification.
Before the next session
Use the current Aseacast product overview to check which parts of this workflow fit your setup.