AI0-001 Implementing AI Solutions Practice Test 11 — 15 Questions

Question 1

A financial services firm is deploying a credit-scoring model built with Amazon SageMaker. Compliance requires that every prediction be explainable to a loan officer and to regulators. The model uses gradient boosting on 120 features. Which approach BEST satisfies the explainability requirement while keeping the production model unchanged?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Use SageMaker Clarify to generate SHAP-based feature attributions for each inference request through the Clarify explainer endpoint.. Explainability for regulated decisions requires per-prediction attributions tied to the actual model. SageMaker Clarify's SHAP explainer endpoint returns feature-level contributions for each request while the gradient boosting model remains in production, satisfying both accuracy and compliance. Monitoring tools track aggregate drift, simpler models change behavior, and manual reconstruction is not auditable, so only the Clarify-based approach meets the constraint of leaving the production model unchanged.

Answer

Log the raw feature vector for every request and have analysts manually reconstruct the decision using spreadsheet formulas.

Answer

Enable SageMaker Model Monitor with a data quality baseline and publish the monitoring reports to the loan officers.

Answer

Replace the gradient boosting model with a single decision tree so that every prediction follows a human-readable path.

Question 2

A media company is deploying an AI service that transcribes customer support calls and then summarizes them for agents. The transcription model runs on-premises and produces text, but the summarization LLM is hosted in a public cloud. Compliance requires that no raw call audio or verbatim transcript ever leaves the company network. Which deployment pattern best satisfies this requirement while still using the cloud LLM?

Accepted Answer

Run the transcription on-premises, redact or abstract the transcript locally, and send only the redacted, non-verbatim text to the cloud LLM for summarization.. The requirement is a data-egress boundary: raw audio and verbatim transcripts must stay on-premises. The only pattern that respects that boundary while still using a cloud LLM is to perform transcription locally, then redact or abstract the text before sending only sanitized content to the hosted model. Encryption, private endpoints, and prompt instructions do not change where the sensitive data is processed, so they cannot satisfy the constraint.

Answer

Transcribe in the cloud and store the raw audio in a cloud object store, but encrypt the bucket with a customer-managed key.

Answer

Use a cloud-hosted transcription model and a cloud-hosted summarization model, and configure a private VPC endpoint between them.

Answer

Send the raw audio to the cloud LLM and instruct the model via the system prompt to ignore the audio and only produce a summary.

Question 3

A retail company wants to forecast weekly demand for thousands of SKUs across stores. The data includes strong seasonal patterns, promotional calendars, and intermittent demand for slow-moving items. The team has limited time and wants a baseline before investing in custom deep learning. Which approach is BEST as the initial production model?

Accepted Answer

Use a classical time-series method such as exponential smoothing or ARIMA applied per SKU-store series with seasonal and promotional regressors.. A fast, reliable baseline for seasonal and intermittent demand is a classical time-series method applied per SKU-store series with promotional regressors. These methods are well understood, quick to deploy, and produce explainable per-series forecasts that support monitoring. Deep learning, LLM prompting, and clustering either require disproportionate investment or do not yield actionable SKU-level forecasts.

Answer

Apply a clustering algorithm to group SKUs by sales similarity and forecast only the cluster centroids.

Answer

Train a single global deep neural network on all SKUs and stores with embeddings for product and location.

Answer

Deploy a large language model to generate demand forecasts by prompting it with recent sales figures and promotion descriptions.

Question 4

A financial services firm is implementing an AI solution that scores loan applications. The model must be auditable, and regulators require the firm to explain why any individual application received a particular decision. The data science team trained a gradient-boosted tree model with high accuracy. Which approach best meets the explainability requirement for individual decisions?

Accepted Answer

Use SHAP values computed for each individual application to attribute the model's output to its input features, and present those attributions as the explanation.. Regulatory explainability for individual decisions requires a per-instance attribution method, not a global summary or a raw score. SHAP values attribute the model output for a single application to its input features, preserving the accuracy of the gradient-boosted tree while producing a defensible, decision-specific explanation. Global importance, model replacement, and raw disclosure all fail to explain the specific decision under review.

Answer

Replace the gradient-boosted tree with a logistic regression model and report the model coefficients as the explanation for every decision.

Answer

Provide the raw input features and the final score to the regulator and let them interpret the decision themselves.

Answer

Report the model's global feature importance ranking from the training run as the explanation for each decision.

Question 5

A retail bank has deployed a credit-risk scoring model as a REST endpoint behind an API gateway. The model was trained on data from 2019–2023. Compliance now requires the bank to detect when input feature distributions drift away from the training baseline and to trigger retraining before approval rates degrade. Which approach should the bank implement FIRST?

Accepted Answer

Enable population stability index (PSI) monitoring on each input feature against the stored training distribution and alert when PSI exceeds a set threshold.. Covariate drift is detected by comparing live inference feature distributions with the training baseline, and population stability index is the established metric for tabular models. It operates without ground-truth labels, so it fires early, before approval-rate decay confirms the problem. Fine-tuning on unlabeled traffic, autoscaling, or threshold manipulation all fail to measure distributional change and therefore cannot satisfy the compliance requirement to trigger retraining.

Answer

Lower the classification threshold from 0.50 to 0.40 so more applicants are approved and the approval rate stays stable.

Answer

Continuously fine-tune the deployed model on every new loan application that arrives at the endpoint.

Answer

Increase the API gateway rate limit and add horizontal replicas so the endpoint can absorb higher application volume.

Question 6

A media company is deploying an AI system that generates short news summaries from full articles. Before launch, the responsible AI review board asks the team to define monitoring that will detect harmful or degraded behavior in production. Which TWO monitoring practices should the team implement? (Choose two.)

Accepted Answer

Track hallucination and factual-consistency rates by automatically comparing generated summaries against source articles using a grounded entailment check.. Responsible deployment of a generative summarization system requires monitoring both automated factual grounding and structured human review. Grounding checks quantify hallucinations against source articles, while rubric-based human sampling catches bias, tone, and framing issues that metrics miss. Together they provide the safety and quality signals the review board needs. Infrastructure and length metrics do not measure harmful or degraded content behavior.

Answer

Record the GPU utilization of the inference cluster to confirm the model is running within expected compute bounds.

Answer

Monitor the average token length of generated summaries to ensure outputs stay within the expected range.

Answer

Track the number of API calls per minute to detect traffic spikes that could indicate abuse or system overload.

Question 7

A small marketing team has built an internal AI assistant that answers questions about their product catalog. They want to deploy it quickly with minimal infrastructure management and pay only for what they use. The team has no Kubernetes expertise and wants the provider to handle scaling, patching, and availability. Which deployment option best matches these constraints?

Accepted Answer

Use a managed AI platform endpoint that hosts the model, handles scaling and patching, and bills per request or per token.. The team's constraints are minimal infrastructure management, no Kubernetes expertise, and consumption-based billing. A managed AI platform endpoint is designed for exactly this situation: the provider owns scaling, patching, and availability, and the team pays per request or token. Kubernetes, serverless functions with per-invocation model loading, and self-managed virtual machines each impose operational or performance costs that conflict with the stated requirements.

Answer

Use a serverless function that loads the model on each invocation and returns a response.

Answer

Provision a Kubernetes cluster, deploy the model behind an inference server, and configure a horizontal pod autoscaler.

Answer

Run the model on a dedicated virtual machine that the team patches and scales manually.

Question 8

A hospital's AI triage assistant was validated on data from its own emergency department. Before rolling it out to three affiliated hospitals with different patient demographics, imaging equipment, and documentation habits, the governance committee requires evidence that the model will not silently underperform at the new sites. Which activity BEST provides that evidence?

Accepted Answer

Run an external validation using held-out data from each receiving hospital and compare subgroup performance against the original site.. Generalization to new sites can only be demonstrated with data the model has never seen from those sites. External validation on each hospital's held-out records, broken down by subgroup, reveals demographic, equipment, and workflow-related performance gaps before patients are exposed. Reusing the internal test set, tuning thresholds, or fine-tuning prematurely all fail to produce that evidence and would leave the committee without a defensible basis for approval.

Answer

Fine-tune the model on a sample of records from the three new hospitals before any prospective evaluation.

Answer

Increase the model's confidence threshold at the new sites until the override rate matches the original hospital's rate.

Answer

Re-run the original internal test set and confirm that the AUC is unchanged from the validation report.

Question 9

A hospital is implementing an AI triage assistant that suggests urgency levels for emergency department patients. The clinical leadership wants to ensure the system does not systematically undertriage patients from a particular demographic group. Which practice best addresses this requirement during implementation?

Accepted Answer

Evaluate the model's performance separately for each demographic subgroup using metrics such as sensitivity and false negative rate, and remediate disparities before go-live.. Detecting systematic undertriage requires measuring model performance within each demographic subgroup, especially false negative rates and sensitivity, because aggregate accuracy can conceal group-level harm. Removing demographic features does not remove proxy effects, and override rates reflect clinician behavior rather than model fairness. Subgroup evaluation with remediation before go-live is the practice that directly addresses the clinical leadership's concern.

Answer

Report only the overall accuracy of the model across the entire patient population and confirm that it exceeds a pre-agreed target.

Answer

Remove all demographic features from the training data and assume the resulting model is fair.

Answer

Require clinicians to override the AI recommendation whenever they disagree, and track the override rate as the fairness measure.

Question 10

A media company is deploying a generative AI assistant that drafts marketing copy for regional campaigns. Legal requires that no customer personal data, unreleased product names, or internal pricing appear in generated output, and that every draft be attributable to a source. The team plans to use retrieval-augmented generation over an approved content repository. Which TWO controls should be implemented to satisfy these requirements? (Choose two.)

Accepted Answer

Apply document-level access control and metadata filtering in the retrieval index so the assistant can only retrieve content the requesting user is authorized to see.. Both requirements are met at the retrieval layer. Permission-aware retrieval with metadata filtering stops sensitive documents from entering the prompt at all, which is the strongest form of prevention. Inline citations then make every generated claim traceable to an approved source chunk, enabling review and exposing hallucinations. Raising temperature, storing raw prompt logs insecurely, or fine-tuning on the whole corpus each either increases leakage risk or removes the ability to control and attribute content.

Answer

Fine-tune the base model on the entire approved content repository so it memorizes the brand voice and product catalog.

Answer

Raise the model's temperature setting so the assistant produces more varied and creative marketing phrasing.

Answer

Store the full prompt and completion pairs in an unencrypted analytics bucket so the marketing team can review trends.

Question 11

A media company fine-tunes a large language model on Azure Machine Learning to generate sports recaps. After deployment, the model occasionally emits statistics that were never in the source game data. The team wants a systematic way to reduce these unsupported claims without retraining the base model. Which approach BEST addresses this?

Accepted Answer

Implement a retrieval-augmented generation pipeline that retrieves verified game statistics and constrains the model to cite retrieved passages.. Unsupported claims in generated text are best mitigated by grounding generation in a verifiable source. A retrieval-augmented generation pipeline supplies authoritative game statistics at inference time and instructs the model to rely on them, which reduces fabrication without altering the base model's weights. Deterministic decoding, more fine-tuning data, and regex filtering either miss the root cause or violate the no-retraining constraint.

Answer

Increase the fine-tuning dataset size by adding more sports articles and repeat the fine-tuning job.

Answer

Lower the temperature parameter to 0 and rely on greedy decoding to eliminate fabricated statistics.

Answer

Apply a post-processing regex filter that removes any numeric token not present in the prompt.

Question 12

A logistics company is deploying an AI model that predicts delivery delays. The model is served through an API used by dispatch software. The operations team wants to detect when the model's input data distribution shifts so they can trigger retraining. Which TWO implementation practices best support ongoing detection of data drift in production? (Choose two.)

Accepted Answer

Log the model's input feature values and predictions for each request, with timestamps, so the production distribution can be compared against the training baseline.. Detecting data drift in production requires capturing the actual inputs the model receives and periodically comparing their distribution to the training baseline. Logging inputs and predictions with timestamps makes the comparison possible, and a scheduled statistical metric such as population stability index or KL divergence turns that data into an alert. Retraining, latency monitoring, and operator reports are either remediation actions or indirect signals that do not directly measure input distribution change.

Answer

Retrain the model every night on the most recent day of data and automatically promote the new model if its training loss is lower.

Answer

Ask dispatch operators to report whenever they believe a predicted delay is wrong, and treat a spike in reports as the drift signal.

Answer

Monitor only the API's average response latency and error rate, and alert when either exceeds a threshold.

Question 13

A city transit agency wants an AI system to predict bus arrival times. The agency has three years of historical GPS traces, schedule data, and weather records, but no team experienced in building machine learning models. Leadership asks which engagement model will get a working predictor into operations fastest without permanently expanding headcount. Which approach BEST fits?

Accepted Answer

Use a managed AI platform service that ingests the historical data, trains a forecasting model, and exposes a prediction endpoint the agency can call.. The agency's real constraints are speed to production and avoiding permanent headcount growth, not building proprietary modeling capability. A managed AI platform absorbs the training, tuning, and hosting work, turning existing historical data into a callable prediction endpoint. Building an internal team is slow and permanent, crowdsourcing has no delivery guarantee, and spreadsheet templates cannot handle the data volume or update frequency the service requires.

Answer

Publish the raw GPS and weather datasets as open data and rely on external volunteers to build the predictor.

Answer

Hire a full in-house machine learning team and build a custom training pipeline from scratch on agency servers.

Answer

Deploy an off-the-shelf spreadsheet forecasting template and have dispatchers manually enter recent arrival times each morning.

Question 14

A logistics company is deploying a computer vision model on Azure to detect damaged packages on a conveyor belt. The model runs on Azure IoT Edge devices at each warehouse and must operate during network outages. The team needs to ensure the deployment behaves correctly under intermittent connectivity. (Choose two.)

Accepted Answer

Enable Azure IoT Edge offline capabilities by setting the edgeHub module to store and forward telemetry and by using the device's local message queue for inference results.. Operating during network outages requires local compute and local buffering. Azure IoT Edge modules run inference on the device itself, and the edgeHub module's store-and-forward behavior preserves telemetry and results until connectivity is restored. Cloud-hosted endpoints, higher IoT Hub tiers, and Azure Kubernetes Service all depend on the network being available, so they cannot satisfy the offline requirement for conveyor-belt damage detection.

Answer

Increase the IoT Hub tier to S3 and enable message routing to a Service Bus queue to guarantee delivery during outages.

Answer

Deploy the model to an Azure Kubernetes Service cluster in the cloud and expose it through a private endpoint to each warehouse.

Answer

Configure the model to call the Azure Machine Learning online endpoint for every frame and cache the responses on the device.

Question 15

A logistics company runs a vision model on edge devices in warehouses to detect damaged packages on conveyor belts. The model must classify each package within 40 milliseconds, and network connectivity to the cloud is unreliable. During a pilot, engineers notice that accuracy on the edge devices is several points lower than the accuracy measured during cloud-based evaluation on the same test images. Which cause is MOST likely?

Accepted Answer

Quantization applied to compress the model for the edge device reduced numerical precision in the weights and activations.. When the same test images yield lower accuracy on the edge than in the cloud, the difference must come from something that changes the computation itself. Quantization to a lower-precision numeric format alters weights and activations, which is the standard cause of a small accuracy regression in compressed edge models. Camera mismatch would affect both environments equally, and hardware speed or batch size do not change the mathematical output for a given image.

Answer

The edge devices have less RAM and slower CPUs than the cloud inference servers used during evaluation.

Answer

The test images were captured with a different camera model than the ones mounted on the conveyor belts.

Answer

The cloud evaluation used a batch size of 32 while the edge device processes one image at a time.