AI0-001 Practice Test 33 — 15 Questions

Question 1

A logistics company is deploying a computer vision model that reads container identification numbers from photos taken at warehouse gates. The model performs well in testing but struggles in production because lighting, camera angles, and container wear vary widely. The team wants to improve robustness before full rollout. Which TWO actions should they take? (Choose two.)

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Collect and label a sample of real gate images, then add them to the training or validation set.. Robustness gaps between lab and field are closed primarily with representative data. Augmentation simulates the variability of gate conditions, and real labeled gate images supply the actual distribution the model must handle. Together they improve generalization and provide a truthful validation signal. Larger models, lower thresholds, and resolution filtering do not address the missing data diversity.

Answer

Retrain the model using only the highest-resolution images available in the existing dataset.

Answer

Lower the confidence threshold so the model returns a prediction for every gate image.

Answer

Increase the model's parameter count by switching to a larger backbone architecture.

Question 2

A financial services company has deployed a credit-risk model that was trained on historical loan data. Regulatory auditors require that the model's decisions be explainable to applicants who are denied credit. The data science team must integrate an explanation capability into the existing production inference pipeline with minimal latency impact. Which approach BEST satisfies the requirement?

Accepted Answer

Apply SHAP (SHapley Additive exPlanations) values to generate per-applicant feature contribution scores at inference time.. Per-applicant explanations require locally faithful attribution methods that can run inside the inference path. SHAP values attribute the prediction to individual features for that specific applicant, producing the kind of decision rationale regulators expect in adverse action notices. The other approaches either replace the model, provide only aggregate insight, or supply raw data without interpretation, none of which meet the per-decision explainability mandate.

Answer

Log the raw input features and the model's numeric score for each applicant and provide the log file to auditors on request.

Answer

Publish the model's global feature importance ranking on the company website so applicants can see which factors matter most overall.

Answer

Replace the production model with a single decision tree so that the full decision path can be shown to each applicant.

Question 3

Which machine learning paradigm is best suited for training a model to play a game by learning from its own actions and rewards, without labeled data?

Accepted Answer

Reinforcement learning. Reinforcement learning is designed for agents that learn by interacting with an environment and receiving rewards or penalties, with no labeled dataset required. The model improves its policy through trial and error, maximizing cumulative reward over time — exactly the paradigm for game-playing agents like AlphaGo and DQN.

Answer

Unsupervised learning

Answer

Semi-supervised learning

Answer

Supervised learning

Question 4

A financial services firm is deploying an LLM-based assistant that summarizes internal earnings reports. Compliance requires that the assistant's outputs be auditable and that sensitive financial figures not be sent to an external model provider. Which TWO implementation measures should the team adopt? (Choose two.)

Accepted Answer

Deploy the model in a private environment where inference occurs within the firm's network boundary.. Auditability requires durable records of prompts, context, model versions, and responses, while data-residency requires that sensitive figures never leave the firm's boundary. Running inference in a private environment and logging every interaction together satisfy both requirements. The remaining options either still transmit data externally or do nothing for auditability.

Answer

Enable the model provider's zero-retention API option so prompts are not stored by the vendor.

Answer

Restrict the assistant to answering only yes-or-no questions about the earnings reports.

Answer

Increase the model's temperature to diversify summaries so no single output is treated as authoritative.

Question 5

A logistics company has an AI model that predicts delivery delays. The model performs well in offline evaluation, but after deployment the operations team notices that predictions for a specific region are consistently biased low. The region recently changed its address format in the source system. Which action should the team take to resolve the issue?

Accepted Answer

Inspect and update the feature engineering pipeline so the new address format is parsed and encoded consistently with training data.. A change in the source system's address format alters the features the model receives, creating a mismatch with training data and biased predictions. Correcting the feature engineering pipeline restores consistency and addresses the root cause. Post-processing corrections, blind retraining, and excluding the region either mask the issue or reduce coverage without fixing the data defect.

Answer

Remove the affected region from the model's scope and handle its predictions manually.

Answer

Retrain the model on all historical data, including records with the new address format, without changing the pipeline.

Answer

Add a post-processing correction that multiplies predictions for the affected region by a fixed factor.

Question 6

A company is deploying a large language model (LLM) for internal knowledge management. The model will answer employee questions based on a corpus of confidential documents. The security team requires that the model not leak sensitive information and that responses be accurate. Which TWO techniques should be implemented to meet these requirements? (Choose two.)

Accepted Answer

Implement output filtering to detect and redact sensitive information in the model's responses.. RAG with an authorized document vector database restricts the model's knowledge to permissible content, enhancing both security and accuracy. Output filtering provides a safety net to redact any sensitive information that might slip through. Together, they address the requirements robustly. Other techniques like differential privacy or prompt engineering are either insufficient or not directly aimed at preventing leakage in responses.

Answer

Apply differential privacy during fine-tuning of the LLM on the confidential documents.

Answer

Use prompt engineering to instruct the model to refuse answering questions that might reveal sensitive information.

Answer

Deploy the LLM in a sandboxed environment with no internet access and restrict API calls.

Question 7

A hospital is deploying an AI triage assistant that summarizes patient intake notes for emergency department nurses. Before go-live, the clinical informatics team must define a human oversight process that satisfies both safety and regulatory expectations. Which approach is MOST appropriate?

Accepted Answer

Require a licensed clinician to review and approve the AI-generated summary before it is entered into the triage record.. High-stakes clinical use requires a defined human oversight gate where a qualified professional reviews AI output before it influences care. Requiring clinician approval of each summary establishes accountability, creates an audit trail, and enables detection of model errors. The alternatives either bypass review, introduce arbitrary availability rules, or rely on documentation rather than active oversight.

Answer

Disable the AI assistant whenever the emergency department is at or above 80 percent capacity to reduce clinician distraction.

Answer

Allow the AI summary to auto-populate the triage record and rely on nurses to correct errors during their normal chart review.

Answer

Publish the AI assistant's model card on the hospital intranet and instruct nurses to consult it if they have concerns about a summary.

Question 8

A retail company wants to use AI to personalize marketing emails. They have a large dataset of customer purchase history and demographics. The data science team plans to use a collaborative filtering approach. Which data is MOST critical for this approach?

Accepted Answer

Customer purchase history and product ratings.. Collaborative filtering algorithms, such as matrix factorization or nearest neighbors, require user-item interaction data to identify patterns. Purchase history and ratings are the quintessential interaction data, enabling the system to recommend products based on similar users' behavior or similar items' co-occurrence. Other data types are either for content-based filtering or auxiliary.

Answer

Email open rates and click-through rates from previous campaigns.

Answer

Product descriptions and categories.

Answer

Customer demographic information such as age and gender.

Question 9

An operations team runs a real-time fraud-scoring model behind a REST endpoint. Latency is acceptable, but over three weeks the model's predicted positive rate has drifted upward even though the model binary and the feature-extraction code have not changed. The team wants to detect and localize this drift before it degrades business outcomes. Which approach should the team implement?

Accepted Answer

Configure statistical drift monitoring on the model's input features and on the distribution of predicted scores, with alerting thresholds tied to the training baseline.. The model binary and feature code are stable, so the rising positive rate points to a change in the data reaching the endpoint. Monitoring input-feature distributions and the distribution of predicted scores against the training baseline is the standard way to detect, quantify, and localize that kind of drift, and it gives operations an alerting signal that precedes business impact.

Answer

Retrain the model on the most recent 30 days of labeled data and redeploy it behind the existing endpoint.

Answer

Increase the inference service's replica count and enable request batching to smooth out traffic spikes.

Answer

Add a canary deployment that routes a small percentage of live traffic to a shadow model for comparison.

Question 10

An AI ethics board is reviewing a model that recommends criminal sentencing lengths. They want to ensure that the model's false positive rates for different demographic groups are equal. Which fairness metric should they use?

Accepted Answer

Equalized odds. Equalized odds requires that the model's true positive rates and false positive rates are equal across groups. Demographic parity only requires equal selection rates. Individual fairness ensures similar individuals are treated similarly but does not define group rates. Calibration ensures predicted probabilities match actual outcomes for each group but does not enforce equal error rates.

Answer

Calibration

Answer

Individual fairness

Answer

Demographic parity

Question 11

A financial services firm is implementing an AI solution that scores loan applications. The model must be auditable, and regulators require the firm to explain why any individual application received a particular decision. The data science team trained a gradient-boosted tree model with high accuracy. Which approach best meets the explainability requirement for individual decisions?

Accepted Answer

Use SHAP values computed for each individual application to attribute the model's output to its input features, and present those attributions as the explanation.. Regulatory explainability for individual decisions requires a per-instance attribution method, not a global summary or a raw score. SHAP values attribute the model output for a single application to its input features, preserving the accuracy of the gradient-boosted tree while producing a defensible, decision-specific explanation. Global importance, model replacement, and raw disclosure all fail to explain the specific decision under review.

Answer

Replace the gradient-boosted tree with a logistic regression model and report the model coefficients as the explanation for every decision.

Answer

Provide the raw input features and the final score to the regulator and let them interpret the decision themselves.

Answer

Report the model's global feature importance ranking from the training run as the explanation for each decision.

Question 12

A data scientist is evaluating a binary classifier for a hiring tool. They compute demographic parity and find that the selection rate for Group A is 0.2 and for Group B is 0.4. Which action would MOST directly address this disparity?

Accepted Answer

Retrain the model with a fairness constraint that enforces demographic parity. Demographic parity requires that the selection rate be equal across groups. Since Group A has 0.2 and Group B has 0.4, the model violates demographic parity. Retraining with a fairness constraint that enforces demographic parity directly optimizes for this metric, making it the most direct action to address the disparity.

Answer

Use a different evaluation metric such as equalized odds

Answer

Remove the sensitive attribute from the training data

Answer

Collect more data for Group A to increase its representation

Question 13

An operations team runs a demand-forecasting model on a cloud MLOps platform. The model retrains nightly, and after several weeks the live prediction distribution has drifted away from the distribution captured at training time. The team wants an automated signal that fires before prediction quality visibly degrades. Which practice should they implement?

Accepted Answer

Configure drift detection on the model's input feature distributions and on the output prediction distribution, with alert thresholds tied to the training baseline.. The scenario calls for detecting a change in the relationship between live data and the training baseline before users notice worse predictions. Comparing current feature and prediction distributions against the stored training distributions, with thresholds that trigger alerts, gives that early warning. Retraining cadence, endpoint scaling, and periodic validation runs do not observe live distributional shift, so they cannot fire the needed signal.

Answer

Retrain the model on the full historical dataset each night and compare its validation accuracy to the previous release.

Answer

Increase the nightly retraining frequency to every hour so the model always reflects the newest data.

Answer

Enable autoscaling of the inference endpoint so latency stays constant as request volume grows.

Question 14

An organization is building a recommendation system that requires low-latency vector similarity search. They need to store and query millions of embeddings. Which THREE technologies are appropriate for this task?

Accepted Answer

Weaviate. Weaviate (C) is a purpose-built vector database that indexes embeddings and supports low-latency approximate nearest neighbor (ANN) similarity search over millions of vectors, making it ideal for recommendation systems. pgvector (D) extends PostgreSQL with vector data types and ANN indexes (e.g., HNSW, IVFFlat) so embeddings can be stored and queried with low latency alongside relational data. Pinecone (E) is a fully managed vector database designed specifically for high-performance similarity search at scale, directly matching the low-latency embedding query requirement. Snowflake (A) is a cloud data warehouse optimized for analytical SQL workloads, not sub-second vector similarity search, and Amazon S3 (B) is object storage that can hold embedding files but provides no native vector indexing or similarity query capability.

Answer

Snowflake

Answer

Amazon S3

Question 15

A small marketing team has built an internal AI assistant that answers questions about their product catalog. They want to deploy it quickly with minimal infrastructure management and pay only for what they use. The team has no Kubernetes expertise and wants the provider to handle scaling, patching, and availability. Which deployment option best matches these constraints?

Accepted Answer

Use a managed AI platform endpoint that hosts the model, handles scaling and patching, and bills per request or per token.. The team's constraints are minimal infrastructure management, no Kubernetes expertise, and consumption-based billing. A managed AI platform endpoint is designed for exactly this situation: the provider owns scaling, patching, and availability, and the team pays per request or token. Kubernetes, serverless functions with per-invocation model loading, and self-managed virtual machines each impose operational or performance costs that conflict with the stated requirements.

Answer

Use a serverless function that loads the model on each invocation and returns a response.

Answer

Provision a Kubernetes cluster, deploy the model behind an inference server, and configure a horizontal pod autoscaler.

Answer

Run the model on a dedicated virtual machine that the team patches and scales manually.