You are using Azure AI Language's custom question answering feature to build a FAQ bot. The knowledge base contains many question-and-answer pairs. Users sometimes ask questions that are paraphrases of the stored questions. You need to improve the likelihood that the bot returns the correct answer for paraphrased questions. Which action should you take?
Alternate questions allow you to provide multiple phrasings for the same answer. When a user asks a paraphrased question, the service can match it to an alternate question and return the associated answer. This directly improves recall for variations in wording without changing the underlying model or adding unrelated content.
Why this answer
Adding alternate questions to each question-and-answer pair is the most direct way to improve matching for paraphrased queries. The service uses these variants to better understand different ways users might ask the same thing. Raising the threshold, accepting all active learning suggestions, or trying to change the embedding model do not reliably address the need to match paraphrases.
Exam trap
The trap here is thinking that raising the confidence threshold improves answer quality for paraphrases, when it actually makes the bot stricter and more likely to return no answer.