AI0-001 Practice Test 34 — 15 Questions

Question 1

A retail bank runs a batch credit-limit model that scores the entire customer base nightly. The model consumes 40 features, several of which are aggregates computed from transaction history. Downstream systems report that scores for some customers change dramatically between consecutive nights even though nothing about those customers changed. The team needs to make the nightly pipeline reproducible and explainable. Which action should the team take FIRST?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Capture the exact feature values and pipeline code version used for each nightly scoring run so any score can be reproduced and compared.. Score changes with no corresponding customer change indicate the feature pipeline is producing different values on different nights. Capturing a per-run feature snapshot alongside the pipeline code version makes each score reproducible, which is the only way to identify the unstable aggregate and satisfy explainability obligations before attempting any fix.

Answer

Increase the batch window so the nightly job has more time to compute the aggregate features.

Answer

Add a post-processing step that clamps each customer's score change to a fixed maximum per night.

Answer

Replace the aggregated transaction features with raw transaction counts to eliminate the variability.

Question 2

Which TWO are evaluation metrics for classification problems? (Choose two.)

Accepted Answer

Precision. Precision is a classification metric that measures the proportion of true positive predictions among all positive predictions made by the model. It is calculated as TP / (TP + FP) and is critical when the cost of false positives is high, such as in spam detection or fraud alert systems.

Answer

Mean Absolute Error

Answer

R-squared

Answer

Mean Squared Error

Question 3

A hospital is implementing an AI triage assistant that suggests urgency levels for emergency department patients. The clinical leadership wants to ensure the system does not systematically undertriage patients from a particular demographic group. Which practice best addresses this requirement during implementation?

Accepted Answer

Evaluate the model's performance separately for each demographic subgroup using metrics such as sensitivity and false negative rate, and remediate disparities before go-live.. Detecting systematic undertriage requires measuring model performance within each demographic subgroup, especially false negative rates and sensitivity, because aggregate accuracy can conceal group-level harm. Removing demographic features does not remove proxy effects, and override rates reflect clinician behavior rather than model fairness. Subgroup evaluation with remediation before go-live is the practice that directly addresses the clinical leadership's concern.

Answer

Report only the overall accuracy of the model across the entire patient population and confirm that it exceeds a pre-agreed target.

Answer

Remove all demographic features from the training data and assume the resulting model is fair.

Answer

Require clinicians to override the AI recommendation whenever they disagree, and track the override rate as the fairness measure.

Question 4

A media company serves personalized article recommendations through a model hosted on a cloud inference service. During a major news event, request volume spikes tenfold and p95 latency rises from 120 ms to over 2 seconds, causing timeouts on the web front end. The model itself is unchanged and the endpoint is healthy. The team wants to keep serving personalized results during spikes without degrading the user experience. Which action should the team take first?

Accepted Answer

Cache or precompute recommendations for high-traffic article and user segments and serve those cached results during the spike.. The latency spike is caused by a tenfold surge in request volume against a fixed-capacity inference path, not by a model defect. Caching or precomputing recommendations for high-traffic segments removes redundant inference work from the request path, cutting p95 latency immediately while preserving personalization. Retraining, threshold tuning, and static fallbacks either do not reduce per-request compute or sacrifice the personalization the team must retain.

Answer

Retrain the recommendation model on a larger dataset so it produces results faster under load.

Answer

Switch the front end to a static, non-personalized article list whenever request volume exceeds the autoscaling limit.

Answer

Lower the model's prediction confidence threshold so fewer candidates are scored per request.

Question 5

A hospital's AI triage assistant was validated on data from its own emergency department. Before rolling it out to three affiliated hospitals with different patient demographics, imaging equipment, and documentation habits, the governance committee requires evidence that the model will not silently underperform at the new sites. Which activity BEST provides that evidence?

Accepted Answer

Run an external validation using held-out data from each receiving hospital and compare subgroup performance against the original site.. Generalization to new sites can only be demonstrated with data the model has never seen from those sites. External validation on each hospital's held-out records, broken down by subgroup, reveals demographic, equipment, and workflow-related performance gaps before patients are exposed. Reusing the internal test set, tuning thresholds, or fine-tuning prematurely all fail to produce that evidence and would leave the committee without a defensible basis for approval.

Answer

Fine-tune the model on a sample of records from the three new hospitals before any prospective evaluation.

Answer

Increase the model's confidence threshold at the new sites until the override rate matches the original hospital's rate.

Answer

Re-run the original internal test set and confirm that the AUC is unchanged from the validation report.

Question 6

An e-commerce company operates an AI recommendation service. After a marketing campaign, the operations team notices that inference costs have tripled while request volume has only doubled. They need to reduce cost per inference without degrading recommendation quality. Which two actions should the team take? (Choose two.)

Accepted Answer

Apply model quantization or a distilled smaller model for the recommendation ranking stage, validating quality against offline metrics.. Cost per inference falls when each execution does more useful work or requires fewer resources. Dynamic batching amortizes execution overhead across concurrent requests, and quantization or distillation reduces the compute needed per prediction. Adding replicas, disabling caching, or upgrading instance size raises capacity or work without improving efficiency, so they do not meet the goal.

Answer

Disable caching of recommendation results so every request is computed fresh from the model.

Answer

Move the recommendation service to a larger GPU instance type with more memory.

Answer

Increase the number of replicas behind the load balancer so each instance handles fewer requests.

Question 7

A media company is deploying a generative AI assistant that drafts marketing copy for regional campaigns. Legal requires that no customer personal data, unreleased product names, or internal pricing appear in generated output, and that every draft be attributable to a source. The team plans to use retrieval-augmented generation over an approved content repository. Which TWO controls should be implemented to satisfy these requirements? (Choose two.)

Accepted Answer

Apply document-level access control and metadata filtering in the retrieval index so the assistant can only retrieve content the requesting user is authorized to see.. Both requirements are met at the retrieval layer. Permission-aware retrieval with metadata filtering stops sensitive documents from entering the prompt at all, which is the strongest form of prevention. Inline citations then make every generated claim traceable to an approved source chunk, enabling review and exposing hallucinations. Raising temperature, storing raw prompt logs insecurely, or fine-tuning on the whole corpus each either increases leakage risk or removes the ability to control and attribute content.

Answer

Fine-tune the base model on the entire approved content repository so it memorizes the brand voice and product catalog.

Answer

Raise the model's temperature setting so the assistant produces more varied and creative marketing phrasing.

Answer

Store the full prompt and completion pairs in an unencrypted analytics bucket so the marketing team can review trends.

Question 8

A bank operates a credit-scoring model in production. Auditors require the team to reproduce the exact score a specific applicant received six months ago, including the model version, the feature values, and the code path used. Which capability must the team have in place to satisfy this requirement?

Accepted Answer

Full lineage logging that captures the model artifact version, the raw input record, the engineered feature values, and the inference request metadata for every prediction.. Auditability of an individual prediction demands that the model version, the post-engineering feature values, and the request context all be captured at the moment of inference. Only comprehensive lineage logging binds those elements to a specific decision so it can be replayed later. Registries, aggregate dashboards, and shadow deployments each cover a different concern and none retains the record-level detail an auditor needs to reconstruct one score.

Answer

A model registry that stores every trained model version with its performance metrics and promotion status.

Answer

Periodic shadow deployment of the current model against the previous version to compare scoring behavior.

Answer

A dashboard that tracks aggregate approval rates and score distributions over time to demonstrate stable model behavior.

Question 9

A health system wants to deploy an AI triage tool that analyzes patient symptoms and vital signs to prioritize emergency department patients. Before deployment, the governance committee must determine whether the tool qualifies as a high-risk AI system under the EU AI Act. Which factor is MOST determinative of that classification?

Accepted Answer

Whether the AI tool is used to make decisions that could significantly affect a patient's health, safety, or fundamental rights. High-risk classification under the EU AI Act hinges on the intended purpose and the severity of potential impact on health, safety, or fundamental rights. A triage tool that influences emergency care decisions can directly affect patient health, so it falls into the high-risk category regardless of data size, architecture, or deployment model.

Answer

Whether the tool is deployed on-premises or through a cloud service

Answer

Whether the AI model was trained on a dataset containing more than 100,000 patient records

Answer

Whether the AI tool uses a deep learning architecture rather than a rules-based system

Question 10

A logistics company is deploying a computer vision model on Azure to detect damaged packages on a conveyor belt. The model runs on Azure IoT Edge devices at each warehouse and must operate during network outages. The team needs to ensure the deployment behaves correctly under intermittent connectivity. (Choose two.)

Accepted Answer

Enable Azure IoT Edge offline capabilities by setting the edgeHub module to store and forward telemetry and by using the device's local message queue for inference results.. Operating during network outages requires local compute and local buffering. Azure IoT Edge modules run inference on the device itself, and the edgeHub module's store-and-forward behavior preserves telemetry and results until connectivity is restored. Cloud-hosted endpoints, higher IoT Hub tiers, and Azure Kubernetes Service all depend on the network being available, so they cannot satisfy the offline requirement for conveyor-belt damage detection.

Answer

Increase the IoT Hub tier to S3 and enable message routing to a Service Bus queue to guarantee delivery during outages.

Answer

Deploy the model to an Azure Kubernetes Service cluster in the cloud and expose it through a private endpoint to each warehouse.

Answer

Configure the model to call the Azure Machine Learning online endpoint for every frame and cache the responses on the device.

Question 11

A city transit agency wants an AI system to predict bus arrival times. The agency has three years of historical GPS traces, schedule data, and weather records, but no team experienced in building machine learning models. Leadership asks which engagement model will get a working predictor into operations fastest without permanently expanding headcount. Which approach BEST fits?

Accepted Answer

Use a managed AI platform service that ingests the historical data, trains a forecasting model, and exposes a prediction endpoint the agency can call.. The agency's real constraints are speed to production and avoiding permanent headcount growth, not building proprietary modeling capability. A managed AI platform absorbs the training, tuning, and hosting work, turning existing historical data into a callable prediction endpoint. Building an internal team is slow and permanent, crowdsourcing has no delivery guarantee, and spreadsheet templates cannot handle the data volume or update frequency the service requires.

Answer

Publish the raw GPS and weather datasets as open data and rely on external volunteers to build the predictor.

Answer

Hire a full in-house machine learning team and build a custom training pipeline from scratch on agency servers.

Answer

Deploy an off-the-shelf spreadsheet forecasting template and have dispatchers manually enter recent arrival times each morning.

Question 12

A media company serves personalized article recommendations through a model that is retrained weekly. After a major news event, engagement metrics show that recommendations became stale within hours because the model had not yet seen the new topic. The engineering team wants recommendations to reflect breaking topics within minutes without retraining the whole model. Which approach should the team implement?

Accepted Answer

Add a real-time retrieval layer that surfaces recently published articles by semantic similarity to the user's current session, and blend those candidates with the model's ranked output.. The gap is that breaking articles never enter the candidate set until the next weekly training cycle, so no amount of reweighting or diversity tuning can surface them. A real-time retrieval layer that matches fresh articles to the live session and blends them into the ranking closes that gap within minutes while preserving existing personalization.

Answer

Shorten the retraining cadence from weekly to hourly so the model learns the new topic sooner.

Answer

Increase the weight of the recency feature in the existing ranking model and redeploy the updated weights.

Answer

Lower the diversity threshold so the recommender is allowed to show a wider spread of topics to each user.

Question 13

A global bank deploys a generative AI assistant that summarizes internal policy documents for loan officers across the European Union and the United States. The compliance team must ensure the system respects regional AI regulations. Which of the following actions is MOST appropriate for aligning the deployment with these requirements?

Accepted Answer

Classify the assistant's risk level per jurisdiction, document the conformity assessment, and maintain human oversight and logging for its outputs.. Cross-border AI deployments must be governed per jurisdiction rather than by a single global policy. A risk classification, documented assessment, and operational controls such as human oversight and logging create an auditable compliance posture. Vendor documentation alone cannot substitute for deployer obligations, and neither data minimization nor language restriction addresses the core regulatory duties for a credit-adjacent generative tool.

Answer

Restrict the assistant to English-language documents only, because language localization is the primary regulatory differentiator across regions.

Answer

Rely on the foundation model provider's terms of service and published model card as sufficient evidence of regulatory compliance.

Answer

Disable all output logging to minimize the personal data stored, since data minimization is the only regulatory requirement that applies.

Question 14

A hospital wants to deploy an AI triage model that recommends which emergency department patients should be seen first. The clinical governance committee is defining controls to ensure the system remains accountable and safe after go-live. Which TWO controls BEST support ongoing accountability for this AI system? (Choose two.)

Accepted Answer

Establish a scheduled monitoring process that tracks model performance and subgroup error rates, with defined thresholds that trigger review.. Ongoing accountability depends on being able to reconstruct what happened and detect when behavior changes. Audit logging preserves the decision trail including clinician overrides, while scheduled performance and subgroup monitoring with defined thresholds turns observation into action. Together they create a feedback loop that supports incident investigation, fairness oversight, and timely intervention, which pure transparency or forced compliance cannot provide.

Answer

Retrain the model on the entire production dataset every night to keep it current with the latest patient cases.

Answer

Require clinicians to accept every model recommendation without modification to keep the workflow consistent.

Answer

Publish the model's full source code and training weights publicly so external researchers can verify its behavior.

Question 15

A retail bank is rolling out an AI assistant built on Azure AI Foundry to answer customer questions about account policies. The compliance team requires that any response containing financial advice be routed to a human agent and that all interactions be logged for audit. Which combination of capabilities should the developer implement to meet these requirements?

Accepted Answer

Implement a custom intent classifier that flags advice-related queries, route flagged sessions to a human agent, and write all turns to Azure Monitor Logs with a retention policy.. Meeting both requirements demands a detection mechanism for advice-related content and a durable record of every interaction. A custom intent classifier can flag advice requests and trigger a human handoff, while writing conversation turns to Azure Monitor Logs with a retention policy produces an auditable history. Content filtering, temperature changes, and performance metrics do not provide the routing logic or the compliance-grade logging the bank needs.

Answer

Raise the model's temperature so responses are more varied and enable Azure Policy to restrict which users can query the assistant.

Answer

Use Azure AI Content Safety to filter harmful content and enable diagnostic logging on the Foundry project.

Answer

Rely on the model's built-in safety system message to refuse advice questions and enable Application Insights for performance metrics.