AI0-001 Implementing AI Solutions Practice Test 10 — 15 Questions

Question 1

A hospital's AI triage assistant summarizes patient notes for clinicians. During post-deployment monitoring, the team notices the model's outputs drift in tone and length after the vendor silently updated the underlying foundation model. The application code did not change. Which action best restores reproducibility and protects against future silent model changes?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Pin the model to a specific dated version or snapshot and re-run the evaluation suite before promoting any new version.. Silent foundation-model updates change behavior even when application code is untouched, so the model must be treated as a pinned, versioned dependency. Freezing a dated snapshot and requiring evaluation before promoting any new version restores reproducibility and blocks unevaluated changes from reaching clinicians. Token limits, output templates, and faster monitoring do not control which model version serves traffic.

Answer

Increase the monitoring sample rate so the team detects drift faster on the next update.

Answer

Lower the max tokens parameter so outputs cannot drift in length after the vendor update.

Answer

Add a post-processing step that rewrites every summary into a fixed template before display.

Question 2

A retail company wants its customer support chatbot to answer questions about current promotions that change weekly. The team has an LLM API but does not want to retrain the model each week. Which implementation approach is MOST appropriate?

Accepted Answer

Use retrieval-augmented generation to inject current promotion content into the prompt at query time.. Retrieval-augmented generation separates knowledge from model weights, so weekly promotion changes are handled by updating the retrieval corpus rather than retraining. This keeps the LLM stable while ensuring answers reflect current content. Fine-tuning and prompt-stuffing either violate the no-retraining constraint or scale poorly, making retrieval the most appropriate implementation.

Answer

Deploy a smaller open-source model and periodically replace it with a newly trained version each week.

Answer

Increase the model's context window and paste all historical promotions into every system prompt.

Answer

Fine-tune the LLM on a weekly export of promotion documents.

Question 3

A media company runs an AI content moderation pipeline that classifies user uploads into allowed, review, and blocked categories. The team notices that the model's blocked decisions have drifted: content that was previously labeled review is now being blocked, and appeals are rising. Which action should the team take FIRST to diagnose the drift?

Accepted Answer

Compare the distribution of input features and predicted labels between the current production window and the training baseline.. Drift diagnosis is an evidence-gathering step. Comparing production feature and label distributions against the training baseline isolates whether inputs, outputs, or both have moved. That measurement determines whether the fix is retraining, recalibration, or pipeline repair. Retraining, threshold changes, and interviews all act before the cause is known and can compound the problem.

Answer

Immediately retrain the model on the most recent two weeks of moderation decisions.

Answer

Interview the moderation reviewers to collect qualitative feedback about recent content.

Answer

Raise the block threshold so fewer items receive the blocked label.

Question 4

A healthcare provider is deploying an AI model to predict patient readmission risk. The model was trained on historical data that includes a feature indicating whether the patient has diabetes. The provider wants to ensure the model does not discriminate based on this feature. Which technique should be used to detect and mitigate bias related to the diabetes feature?

Accepted Answer

Perform a fairness audit by comparing model performance across groups with and without diabetes.. A fairness audit systematically compares model outcomes across groups defined by the sensitive attribute, revealing disparities. This is the essential first step to detect bias. Once identified, mitigation techniques like reweighting or adversarial debiasing can be applied. Removing the feature or changing metrics does not directly address the need to detect and mitigate bias.

Answer

Use a different evaluation metric such as AUC-ROC instead of accuracy to assess model performance.

Answer

Remove the diabetes feature from the dataset and retrain the model.

Answer

Increase the model's complexity by adding more layers to capture subtle patterns related to diabetes.

Question 5

A logistics company is deploying an AI model that predicts delivery delays. The model will run on edge devices in trucks with intermittent connectivity. The team must ensure the deployment meets latency and reliability requirements. Which TWO implementation practices are MOST appropriate for this edge AI deployment? (Choose two.)

Accepted Answer

Quantize the model to a smaller numeric precision so it fits the device's memory and compute budget.. Edge deployment under intermittent connectivity requires the model to run locally and be small enough for the device. Quantization reduces size and compute, and local inference with store-and-forward caching keeps predictions available offline while queuing results for later sync. Cloud routing, larger models, and disabled monitoring all conflict with the latency, memory, and reliability constraints described.

Answer

Disable model monitoring on the device to reduce CPU overhead and extend battery life.

Answer

Increase the model's parameter count so it can learn more complex delay patterns from historical data.

Answer

Route every prediction request to the cloud so the model always uses the newest weights.

Question 6

A financial services firm is deploying an LLM-based assistant that summarizes internal earnings reports. Compliance requires that the assistant's outputs be auditable and that sensitive financial figures not be sent to an external model provider. Which TWO implementation measures should the team adopt? (Choose two.)

Accepted Answer

Deploy the model in a private environment where inference occurs within the firm's network boundary.. Auditability requires durable records of prompts, context, model versions, and responses, while data-residency requires that sensitive figures never leave the firm's boundary. Running inference in a private environment and logging every interaction together satisfy both requirements. The remaining options either still transmit data externally or do nothing for auditability.

Answer

Enable the model provider's zero-retention API option so prompts are not stored by the vendor.

Answer

Restrict the assistant to answering only yes-or-no questions about the earnings reports.

Answer

Increase the model's temperature to diversify summaries so no single output is treated as authoritative.

Question 7

A financial services company has deployed a credit-risk model that was trained on historical loan data. Regulatory auditors require that the model's decisions be explainable to applicants who are denied credit. The data science team must integrate an explanation capability into the existing production inference pipeline with minimal latency impact. Which approach BEST satisfies the requirement?

Accepted Answer

Apply SHAP (SHapley Additive exPlanations) values to generate per-applicant feature contribution scores at inference time.. Per-applicant explanations require locally faithful attribution methods that can run inside the inference path. SHAP values attribute the prediction to individual features for that specific applicant, producing the kind of decision rationale regulators expect in adverse action notices. The other approaches either replace the model, provide only aggregate insight, or supply raw data without interpretation, none of which meet the per-decision explainability mandate.

Answer

Log the raw input features and the model's numeric score for each applicant and provide the log file to auditors on request.

Answer

Publish the model's global feature importance ranking on the company website so applicants can see which factors matter most overall.

Answer

Replace the production model with a single decision tree so that the full decision path can be shown to each applicant.

Question 8

A logistics company is deploying a computer vision model that reads container identification numbers from photos taken at warehouse gates. The model performs well in testing but struggles in production because lighting, camera angles, and container wear vary widely. The team wants to improve robustness before full rollout. Which TWO actions should they take? (Choose two.)

Accepted Answer

Collect and label a sample of real gate images, then add them to the training or validation set.. Robustness gaps between lab and field are closed primarily with representative data. Augmentation simulates the variability of gate conditions, and real labeled gate images supply the actual distribution the model must handle. Together they improve generalization and provide a truthful validation signal. Larger models, lower thresholds, and resolution filtering do not address the missing data diversity.

Answer

Retrain the model using only the highest-resolution images available in the existing dataset.

Answer

Lower the confidence threshold so the model returns a prediction for every gate image.

Answer

Increase the model's parameter count by switching to a larger backbone architecture.

Question 9

A marketing team wants to deploy a generative AI assistant that writes product descriptions. Before launch, they must ensure the assistant does not produce copyrighted text or brand-inappropriate claims. Which implementation step best addresses this requirement at generation time?

Accepted Answer

Add an output filter that checks generated text for restricted phrases and policy violations before display.. The requirement is to prevent non-compliant text from reaching users, which calls for a runtime control on the generated output. An output filter scans for restricted phrases, copyright matches, and policy violations and blocks or flags them before display. Training data, temperature, and manual review do not provide an automated generation-time check that enforces brand and legal policy.

Answer

Train the assistant only on the company's own historical product descriptions.

Answer

Reduce the model's temperature to zero so it always produces the most likely, safest token sequence.

Answer

Ask users to review each description manually before publishing it.

Question 10

A company is deploying a large language model (LLM) for internal knowledge management. The model will answer employee questions based on a corpus of confidential documents. The security team requires that the model not leak sensitive information and that responses be accurate. Which TWO techniques should be implemented to meet these requirements? (Choose two.)

Accepted Answer

Implement output filtering to detect and redact sensitive information in the model's responses.. RAG with an authorized document vector database restricts the model's knowledge to permissible content, enhancing both security and accuracy. Output filtering provides a safety net to redact any sensitive information that might slip through. Together, they address the requirements robustly. Other techniques like differential privacy or prompt engineering are either insufficient or not directly aimed at preventing leakage in responses.

Answer

Apply differential privacy during fine-tuning of the LLM on the confidential documents.

Answer

Use prompt engineering to instruct the model to refuse answering questions that might reveal sensitive information.

Answer

Deploy the LLM in a sandboxed environment with no internet access and restrict API calls.

Question 11

A logistics company has an AI model that predicts delivery delays. The model performs well in offline evaluation, but after deployment the operations team notices that predictions for a specific region are consistently biased low. The region recently changed its address format in the source system. Which action should the team take to resolve the issue?

Accepted Answer

Inspect and update the feature engineering pipeline so the new address format is parsed and encoded consistently with training data.. A change in the source system's address format alters the features the model receives, creating a mismatch with training data and biased predictions. Correcting the feature engineering pipeline restores consistency and addresses the root cause. Post-processing corrections, blind retraining, and excluding the region either mask the issue or reduce coverage without fixing the data defect.

Answer

Remove the affected region from the model's scope and handle its predictions manually.

Answer

Retrain the model on all historical data, including records with the new address format, without changing the pipeline.

Answer

Add a post-processing correction that multiplies predictions for the affected region by a fixed factor.

Question 12

A hospital is deploying an AI triage assistant that summarizes patient intake notes for emergency department nurses. Before go-live, the clinical informatics team must define a human oversight process that satisfies both safety and regulatory expectations. Which approach is MOST appropriate?

Accepted Answer

Require a licensed clinician to review and approve the AI-generated summary before it is entered into the triage record.. High-stakes clinical use requires a defined human oversight gate where a qualified professional reviews AI output before it influences care. Requiring clinician approval of each summary establishes accountability, creates an audit trail, and enables detection of model errors. The alternatives either bypass review, introduce arbitrary availability rules, or rely on documentation rather than active oversight.

Answer

Disable the AI assistant whenever the emergency department is at or above 80 percent capacity to reduce clinician distraction.

Answer

Allow the AI summary to auto-populate the triage record and rely on nurses to correct errors during their normal chart review.

Answer

Publish the AI assistant's model card on the hospital intranet and instruct nurses to consult it if they have concerns about a summary.

Question 13

A retail company wants to use AI to personalize marketing emails. They have a large dataset of customer purchase history and demographics. The data science team plans to use a collaborative filtering approach. Which data is MOST critical for this approach?

Accepted Answer

Customer purchase history and product ratings.. Collaborative filtering algorithms, such as matrix factorization or nearest neighbors, require user-item interaction data to identify patterns. Purchase history and ratings are the quintessential interaction data, enabling the system to recommend products based on similar users' behavior or similar items' co-occurrence. Other data types are either for content-based filtering or auxiliary.

Answer

Email open rates and click-through rates from previous campaigns.

Answer

Product descriptions and categories.

Answer

Customer demographic information such as age and gender.

Question 14

A financial services firm runs an AI model that scores loan applications. Regulators require the firm to explain any adverse decision to an applicant. The model is a gradient-boosted tree with hundreds of features. Which implementation approach best satisfies the explainability requirement without replacing the model?

Accepted Answer

Generate per-applicant explanations using SHAP values that attribute the decision to the most influential features.. Adverse action explanations must be specific to the individual applicant, and SHAP values provide locally accurate attributions for each prediction. This preserves the gradient-boosted tree's performance while producing reasons that can be communicated and audited. Global importance describes the population, logistic regression replaces the model, and raw logs record inputs without explaining the decision.

Answer

Replace the gradient-boosted tree with a logistic regression so coefficients are directly interpretable.

Answer

Publish the model's global feature importance ranking so applicants can see which factors matter most overall.

Answer

Log the model's raw input features and output score for each application so auditors can review the data.

Question 15

An organization runs a customer-support LLM that calls internal tools to look up order status and issue refunds. Security testing reveals that a user can paste text into the chat that causes the model to invoke the refund tool with an attacker-controlled amount. The team wants to reduce this prompt-injection risk without removing tool functionality. Which control is MOST effective?

Accepted Answer

Enforce authorization and parameter validation in the tool backend so refund requests are validated against the authenticated user's entitlements and business limits.. Prompt injection cannot be fully solved at the model layer, so the durable control is to enforce authorization and business rules in the tool backend where the model cannot influence them. Validating the authenticated user's entitlements and refund limits means a manipulated model still cannot perform unauthorized actions. Prompt instructions, temperature changes, and fine-tuning all rely on model compliance and fail as security boundaries.

Answer

Fine-tune the model on a curated dataset of injection attempts so it learns to recognize and refuse malicious prompts.

Answer

Increase the model's temperature to zero so that responses become deterministic and injection attempts produce consistent refusals.

Answer

Add a system prompt instruction telling the model to ignore any user instructions that attempt to change its tool-use policy.