AI-102 Implement natural language processing solutions Practice Test 2 — 15 Questions

Question 1

Which THREE components are required to build a custom named entity recognition (NER) model in Azure Cognitive Service for Language?

Accepted Answer

A set of labeled documents for training.. A custom NER model in Azure Cognitive Service for Language requires a set of labeled documents for training. These labeled documents define the entities and their spans within text, which the model uses to learn patterns for extraction. Without labeled data, the model cannot be trained to recognize custom entities.

Answer

A QnA Maker knowledge base for entity definitions.

Answer

A LUIS application to handle entity extraction.

Question 2

A company is building a chatbot using Azure Bot Service and Language Understanding (LUIS). The chatbot needs to handle user intents for booking flights and checking flight status. After testing, the chatbot frequently fails to distinguish between the two intents when users mention flight numbers. Which action should the engineer take to improve intent recognition?

Accepted Answer

Add more utterances that include flight numbers to the training data for both intents.. Adding more utterances that include flight numbers to both intents provides LUIS with more varied examples of how flight numbers appear in natural language, enabling the model to learn distinguishing patterns. Without sufficient training data containing flight numbers, LUIS cannot reliably differentiate between 'BookFlight' and 'CheckFlightStatus' when users mention flight numbers, as the entity alone does not determine intent.

Answer

Increase the number of intents to split the flight-related queries further.

Answer

Reduce the confidence score threshold for intent detection.

Answer

Use the prebuilt domain for flight booking to improve accuracy.

Question 3

A hospital uses Azure Cognitive Service for Language to extract medical entities from clinical notes. The extraction accuracy for medication names and dosages is low. The engineer needs to improve performance without adding new training data. Which solution should the engineer implement?

Accepted Answer

Use custom entity recognition with a prebuilt healthcare entity component.. The engineer can use custom entity recognition with a prebuilt healthcare entity component, which leverages the existing Text Analytics for Health model's pre-trained entities (including medication names and dosages) without requiring additional training data. This approach combines the prebuilt healthcare model's high accuracy for medical entities with custom entity recognition to fine-tune extraction for specific clinical notes, improving performance without adding new annotated data.

Answer

Add more training data with annotated entities.

Answer

Retrain the Text Analytics for Health model with additional labeled data.

Answer

Increase the confidence threshold for entity extraction.

Question 4

A developer is using Azure Cognitive Service for Language to perform sentiment analysis on customer reviews. The service returns sentiment labels (positive, negative, neutral) and confidence scores. For a particular review, the service returns 'positive' with a confidence score of 0.55. The developer wants to ensure that only high-confidence results are used. What should the developer do?

Accepted Answer

Configure a minimum confidence threshold of 0.75 in the application logic.. The developer must implement a confidence threshold in the application logic to filter out low-confidence results. The Azure Cognitive Service for Language returns confidence scores between 0 and 1 for each sentiment label, and the developer can set a minimum threshold (e.g., 0.75) to ensure only high-confidence predictions are used. This approach does not require retraining the model or modifying the input text, as the threshold is applied post-inference in the client code.

Answer

Use the Text Analytics for Health API instead.

Answer

Retrain the sentiment analysis model with additional labeled data.

Answer

Adjust the input text by removing ambiguous phrases.

Question 5

Which THREE actions should an engineer take when deploying a custom question answering project in Azure Cognitive Service for Language?

Accepted Answer

Set up a multi-turn extraction policy for follow-up questions.. Multi-turn extraction is a core feature of custom question answering that allows the system to handle follow-up questions by maintaining context across turns. This is essential for conversational flows where a user's subsequent query depends on the previous answer, and it is configured via the project settings in Language Studio.

Answer

Integrate LUIS for intent detection.

Answer

Configure a single-turn extraction policy.

Question 6

You are analyzing a document using Azure Cognitive Service for Language named entity recognition. The exhibit shows a partial JSON response for entity extraction. The engineer notices that 'Jane Smith' has a low confidence score of 0.45. Which action should the engineer take to improve the confidence score for similar entities?

Accepted Answer

Provide more context around the entity in the input text, such as titles or roles.. Providing more context around the entity, such as titles or roles (e.g., 'Dr. Jane Smith' or 'CEO Jane Smith'), gives the prebuilt named entity recognition (NER) model additional linguistic cues that improve its confidence in classifying the entity. Azure Cognitive Service for Language's NER uses a pre-trained model that does not support retraining with custom labels; instead, it relies on surrounding context to disambiguate entities. Adding descriptive terms helps the model leverage its training on patterns where such context correlates with higher confidence scores.

Answer

Retrain the entity recognition model with labeled examples of 'Jane Smith'.

Answer

Use a different language detection model to improve entity recognition.

Answer

Decrease the confidence threshold to 0.3 to include 'Jane Smith' as a valid entity.

Question 7

A large retail company deploys a custom text classification model using Azure Cognitive Service for Language to categorize customer support tickets into 'Billing', 'Technical', and 'General' categories. The model is trained on 10,000 labeled tickets from the past year. After deployment, the model performs well on new tickets but shows a significant drop in accuracy for tickets submitted during holiday seasons, where the volume of billing issues spikes. The engineering team suspects concept drift. They need to maintain high accuracy without manual retraining every season. Which action should the engineer take?

Accepted Answer

Enable active learning on the model and set up a human review loop for low-confidence predictions.. Active learning in Azure Cognitive Service for Language automatically identifies low-confidence predictions and sends them for human review, creating a continuous feedback loop that adapts to concept drift without manual retraining. This allows the model to improve its accuracy on seasonal billing spikes by learning from newly labeled examples, while the human review loop ensures quality control.

Answer

Add subcategories to the classification schema to better capture seasonal patterns.

Answer

Increase the number of training examples per category to 15,000 each.

Answer

Schedule monthly retraining using the original 10,000 tickets plus the new tickets.

Question 8

A company is building a chatbot using Azure Language Service and wants to ensure that the chatbot can understand user intents and extract entities from user utterances. The chatbot must be able to handle multiple intents in a single utterance and must support pre-built entities such as numbers and dates. Which action should the developer take to configure the Language service accordingly?

Accepted Answer

Enable the 'Multiple intents' setting in the Language service project.. The Azure Language Service's Conversational Language Understanding (CLU) project includes a 'Multiple intents' setting that, when enabled, allows the model to predict more than one intent per utterance. This is essential for handling compound user inputs where the user expresses multiple goals in a single sentence.

Answer

Upgrade the Language service tier from Standard to Custom.

Answer

Configure the project to use Orchestration workflow.

Answer

Set the project language to 'Multilingual' to enable entity recognition.

Answer

Define list entities for numbers and dates.

Question 9

A healthcare company is developing a solution to analyze patient feedback using Azure AI Language. The solution must extract key phrases, detect sentiment, and identify personally identifiable information (PII) such as patient names and medical record numbers from unstructured text. The company has strict compliance requirements: all text processing must occur within the United States region, and no data may leave the Azure geography. The development team has provisioned a Language resource in the East US region and has been testing the solution. During testing, the team notices that the PII detection feature is returning results, but the key phrase extraction and sentiment analysis are failing with a 403 error. The error message indicates that the resource is not allowed to access these features. The team has verified that the resource is in the S0 tier. What should the team do to resolve the issue?

Accepted Answer

Verify regional availability of the features and recreate the Language resource in a supported region if necessary.. The 403 error indicates an authorization or regional availability issue, not a tier or key problem. Key phrase extraction and sentiment analysis are available in all regions that support the Language service, but PII detection may have broader regional support. The team must verify that the East US region supports all three features; if not, they need to recreate the resource in a supported region like West US or South Central US to ensure compliance with the United States geography requirement.

Answer

Switch to the free tier to access all features.

Answer

Upgrade the Language resource to the S1 tier to enable all features.

Answer

Regenerate the API key and update the application code.

Question 10

Drag and drop the steps to deploy a custom language model using Azure AI Language into the correct order.

Accepted Answer

Step 1: Have labeled data ready, Step 2: Create the Azure AI Language resource, Step 3: Train the custom language model, Step 4: Evaluate the model performance, Step 5: Deploy the model to an endpoint. First, have labeled data ready, then create the resource, train the model, evaluate, and deploy.

Answer

Step 1: Create the Azure AI Language resource, Step 2: Have labeled data ready, Step 3: Train the custom language model, Step 4: Evaluate the model performance, Step 5: Deploy the model to an endpoint

Answer

Step 1: Have labeled data ready, Step 2: Create the Azure AI Language resource, Step 3: Evaluate the model performance, Step 4: Train the custom language model, Step 5: Deploy the model to an endpoint

Answer

Step 1: Have labeled data ready, Step 2: Create the Azure AI Language resource, Step 3: Train the custom language model, Step 4: Deploy the model to an endpoint, Step 5: Evaluate the model performance

Question 11

Match each Azure AI term to its definition.

Accepted Answer

Azure Cognitive Services: A collection of AI services and APIs that help you build intelligent applications without needing direct AI or data science skills.. Correct matches: Azure Cognitive Services provides pre-built AI APIs; Azure Machine Learning is for ML lifecycle; Azure Bot Service for building bots. Common confusion involves swapping definitions of Cognitive Services and Machine Learning.

Answer

Azure Cognitive Services: A service for building and training machine learning models.

Answer

Azure Machine Learning: A collection of pre-built AI APIs for vision, speech, language, etc.

Answer

Azure Bot Service: A service that provides pre-built AI models for natural language processing.

Question 12

A healthcare organization is building a clinical decision support system that must extract medical entities (e.g., symptoms, diagnoses, medications) from unstructured clinical notes. The solution must be able to detect relationships between entities, such as 'medication X treats symptom Y'. Which Azure AI service should be used?

Accepted Answer

Azure AI Language - Custom NER with entity linking. Azure AI Language's Custom Named Entity Recognition (NER) with entity linking allows training a model to extract domain-specific medical entities such as symptoms, diagnoses, and medications from unstructured clinical notes. Entity linking connects these entities to a knowledge base (e.g., UMLS), which contains structured relationships between medical concepts, enabling the inference of relationships like 'medication X treats symptom Y'. Thus, Custom NER with entity linking is the appropriate service for both entity extraction and relationship detection.

Answer

Azure AI Translator

Answer

Azure AI Speech-to-Text

Answer

Azure AI Document Intelligence (formerly Form Recognizer)

Question 13

You are developing a chatbot for a retail company using Azure AI Language's custom question answering. The chatbot must provide answers from a knowledge base of 500 FAQ documents. Users often ask the same question in different wording, and the chatbot fails to return an answer for paraphrased queries. What is the most effective solution?

Accepted Answer

Enable active learning in the project settings and periodically publish the updated knowledge base.. Enabling active learning in Azure AI Language's custom question answering allows the system to learn from user interactions. It suggests alternative phrasings for existing QnA pairs, which helps answer paraphrased queries without manual effort. Option A is wrong because Direct Line Speech channel is for voice interactions, not improving answer coverage. Option C is wrong because simply adding more documents does not address the paraphrasing issue; it may increase redundancy but not handle different wording of the same question. Option D is wrong because manually adding alternate phrases is time-consuming and not scalable; active learning automates this process by identifying and suggesting variations based on user queries.

Answer

Use Azure AI Bot Service's Direct Line Speech channel to improve accuracy.

Answer

Increase the number of FAQ documents in the knowledge base.

Answer

Manually add alternate question phrases to the knowledge base for each QnA pair.

Question 14

A company wants to analyze customer reviews to determine whether sentiment is positive, negative, or neutral. The solution must also extract key phrases such as 'great battery life' and 'poor camera quality'. Which Azure AI feature should be used?

Accepted Answer

Azure AI Language - Sentiment Analysis and Key Phrase Extraction. Azure AI Language's Sentiment Analysis and Key Phrase Extraction are specifically designed to evaluate text for positive, negative, or neutral sentiment and to extract meaningful phrases like 'great battery life' or 'poor camera quality'. This combined capability directly matches the dual requirement of sentiment classification and key phrase extraction in a single API call, using pre-built models that require no custom training.

Answer

Azure AI Language - Named Entity Recognition (NER)

Answer

Azure AI Content Safety

Answer

Azure AI Language Understanding (LUIS)

Question 15

You are building a multilingual support chatbot using Azure AI Language. The chatbot must understand user queries in English, Spanish, and French, and respond in the same language. The solution should minimize latency and cost. What is the recommended approach?

Accepted Answer

Use a single Azure AI Language project with multilingual support enabled.. Azure AI Language supports multilingual projects natively, allowing a single model to process queries in English, Spanish, and French without additional translation steps. This minimizes latency (no round-trip translation) and cost (no Translator API consumption), while maintaining response accuracy in the user's original language.

Answer

Use Azure AI Translator to translate all queries to English, process with an English-only project, then translate responses back.

Answer

Create separate Azure AI Language projects for each language and route queries based on detected language.

Answer

Use a single English-only project and rely on Azure AI Translator for all non-English queries.