Knowledge + Practice

CCNA AI Implementation and Operations Questions

75 of 106 questions · Page 1/2 · AI Implementation and Operations · Answers revealed

Practice these questions Domain overview All questions

1

Multi-Selectmedium

An e-commerce company operates an AI recommendation service. After a marketing campaign, the operations team notices that inference costs have tripled while request volume has only doubled. They need to reduce cost per inference without degrading recommendation quality. Which two actions should the team take? (Choose two.)

Select 2 answers

A.Disable caching of recommendation results so every request is computed fresh from the model.

B.Move the recommendation service to a larger GPU instance type with more memory.

C.Apply model quantization or a distilled smaller model for the recommendation ranking stage, validating quality against offline metrics.

D.Enable dynamic batching at the inference server so concurrent requests are grouped into a single model execution.

E.Increase the number of replicas behind the load balancer so each instance handles fewer requests.

AnswersC, D

Quantization or distillation reduces compute and memory per inference, directly lowering cost. Validating against offline metrics such as recall at k or NDCG ensures quality stays within acceptable bounds. This is a standard optimization when cost grows faster than traffic, and it complements batching by reducing the work per execution.

Why this answer

Cost per inference falls when each execution does more useful work or requires fewer resources. Dynamic batching amortizes execution overhead across concurrent requests, and quantization or distillation reduces the compute needed per prediction. Adding replicas, disabling caching, or upgrading instance size raises capacity or work without improving efficiency, so they do not meet the goal.

Exam trap

The trap here is equating more capacity with lower cost, when the objective is specifically cost per inference rather than raw throughput.

Practice this question →

2

Multi-Selectmedium

A hospital has deployed an AI triage assistant that summarizes patient intake notes and suggests an acuity level for the emergency department. Clinicians report that the assistant sometimes produces confident but unsupported acuity suggestions. The operations team must add safeguards appropriate for a high-stakes clinical deployment. (Choose two.)

Select 2 answers

A.Display the source note spans that the model used for each acuity suggestion so clinicians can verify the evidence before accepting it.

B.Retrain the assistant on the hospital's historical triage outcomes and redeploy it as the primary acuity assigner.

C.Lower the model's temperature and top-p sampling values so its generated summaries are more deterministic.

D.Increase the model's context window so it can ingest the patient's entire longitudinal chart in one request.

E.Require a clinician to explicitly confirm or override every suggested acuity level before it is written to the patient record.

AnswersA, E

Grounding each suggestion in the specific note spans it used gives the clinician a fast way to confirm or reject the recommendation. In a high-stakes setting this turns an opaque output into an auditable claim, and it lets the reviewer notice when the model leaned on an irrelevant or misread passage, which is exactly the failure mode described.

Why this answer

The reported failure is confident but unsupported suggestions, so the safeguards must both expose the evidence behind each suggestion and keep a clinician as the accountable decision-maker. Attribution to source note spans makes the claim checkable, and mandatory confirmation or override prevents an unverified acuity level from entering the patient record.

Exam trap

The trap here is treating a high-stakes clinical hallucination problem as a prompt-tuning or model-size problem, when the effective controls are evidence attribution and a human decision checkpoint.

Practice this question →

3

MCQmedium

Refer to the exhibit. A machine learning pipeline configuration is shown. During a deployment, the model evaluation passes with accuracy 0.86 and precision 0.79. However, the pipeline proceeds to deploy. What is the most likely reason for this behavior?

A.The precision metric is not included in the evaluation script

B.The deployment only checks the accuracy threshold for rollback condition

C.The deployment target is set to staging instead of production

D.The operator manually overrode the threshold

AnswerB

The pipeline gates deployment solely on the accuracy threshold, so a 0.86 accuracy score passes even though precision of 0.79 falls below its own gate. The rollback condition never evaluates precision, allowing deployment despite the weaker metric.

Why this answer

The pipeline configuration shows a rollback condition that only checks the accuracy metric (accuracy < 0.85). Since the model achieved accuracy 0.86, which is above the threshold, the condition is not triggered, and the pipeline proceeds to deploy regardless of the precision value. The precision metric is not part of the rollback evaluation logic in this configuration.

Exam trap

CompTIA often tests the misconception that all evaluation metrics automatically trigger rollback conditions, when in fact only metrics explicitly listed in the condition logic are checked.

How to eliminate wrong answers

Option A is wrong because the evaluation script clearly outputs precision (0.79), and the exhibit shows precision is being calculated; the issue is that the rollback condition does not reference precision. Option C is wrong because the deployment target (staging vs. production) does not affect whether a rollback condition is evaluated; the pipeline proceeds based on the condition logic, not the environment name. Option D is wrong because there is no evidence or indication in the exhibit or scenario that an operator manually overrode the threshold; the behavior is fully explained by the configured rollback condition.

Practice this question →

4

Multi-Selecthard

An insurance company operates an AI claims-triage model that flags suspicious claims for human review. After six months in production, the operations team observes that the model's precision has fallen steadily while recall has stayed roughly constant, and the volume of false-positive flags has grown. The data science team suspects the input data pipeline is the cause rather than the model weights. Which TWO operational checks should the team perform first to diagnose the problem? (Choose two.)

Select 2 answers

A.Increase the model's decision threshold so fewer claims are flagged as suspicious.

B.Audit the feature engineering and ETL pipeline for silent failures such as nulls, default values, or unit changes that alter feature semantics.

C.Compare the distribution of each production input feature against the training baseline to detect upstream data drift or schema changes.

D.Retrain the model immediately on the last six months of production data to restore precision.

E.Expand the human review team so more flagged claims can be examined manually while the model remains unchanged.

AnswersB, C

A pipeline defect that substitutes nulls, defaults, or differently scaled values changes the meaning of features without changing the model, which degrades precision while recall holds. Auditing the ETL and feature engineering stages for silent failures directly tests the team's hypothesis that the input data pipeline, not the model weights, is the root cause.

Why this answer

Stable recall with falling precision points to inputs that no longer match training conditions rather than to the model weights. Comparing production feature distributions against the training baseline detects drift or schema changes, and auditing the ETL and feature engineering stages uncovers silent failures such as nulls, defaults, or unit changes. Retraining, threshold changes, or more reviewers treat symptoms without identifying the pipeline defect.

Exam trap

The trap here is responding to a precision drop by retraining or thresholding the model, when the evidence points to upstream data corruption that must be diagnosed before any model change.

Practice this question →

5

MCQhard

A company uses a large language model (LLM) to generate customer support responses. They notice the model sometimes produces harmful outputs. Which implementation strategy best reduces this risk while maintaining performance?

A.Implement a keyword-based output filter

B.Use a smaller, less capable model

C.Add system prompts instructing the model to be safe

D.Fine-tune the model using reinforcement learning from human feedback

AnswerD

Reinforcement learning from human feedback trains a reward model on human preference rankings, then optimises the LLM against it, directly suppressing harmful generations while preserving fluency and task performance. This targets the harmful-output risk at the alignment layer rather than filtering responses after generation.

Why this answer

Reinforcement learning from human feedback (RLHF) directly trains the model to align its outputs with human preferences for safety and helpfulness, reducing harmful outputs while preserving performance. Unlike superficial filters or prompts, RLHF adjusts the model's internal behavior through reward modeling and policy optimization, making it the most effective strategy for sustained safety improvements.

Exam trap

CompTIA often tests the misconception that simple output filtering or prompt engineering is sufficient for safety, when in fact only training-based alignment methods like RLHF can meaningfully change model behavior without sacrificing performance.

How to eliminate wrong answers

Option A is wrong because keyword-based output filters are brittle and can be bypassed by paraphrasing or context-dependent harmful content, while also risking false positives that degrade performance by blocking legitimate responses. Option B is wrong because using a smaller, less capable model reduces overall performance and may still produce harmful outputs if not specifically trained for safety, as capability and safety are not directly correlated. Option C is wrong because system prompts are easily overridden by the model's training distribution and do not provide robust, consistent safety alignment, especially against adversarial or nuanced harmful inputs.

Practice this question →

6

MCQeasy

A company deploys a computer vision model for quality inspection on a manufacturing line. After deployment, the model's accuracy drops from 95% to 80% over two weeks. Which action is most likely to address this issue?

A.Retrain the model using recently collected production data.

B.Increase the confidence threshold for predictions.

C.Decrease the learning rate of the training algorithm.

D.Deploy an additional ensemble of models for redundancy.

AnswerA

A gradual accuracy decline over two weeks on a production line indicates data drift, such as new lighting, camera angles or component variants. Retraining on recently collected production data aligns the model with the current input distribution, directly restoring the lost accuracy.

Why this answer

The accuracy drop over two weeks indicates data drift or concept drift, where the production data distribution changes over time. Retraining the model with recently collected production data realigns it with the current data distribution, directly addressing the drift. Option B (increasing confidence threshold) may reduce false positives but does not fix the underlying drift and could lower recall.

Option C (decreasing learning rate) is irrelevant for inference; it only affects training and cannot be applied post-deployment to fix drift. Option D (deploying an ensemble) adds computational overhead and does not resolve drift; it might even mask the issue without correcting it.

Practice this question →

7

MCQeasy

An AI system for fraud detection shows a gradual decline in precision over several weeks, though recall remains stable. Which type of model drift is most likely occurring?

A.Data drift

B.Covariate shift

C.Label drift

D.Concept drift

AnswerD

Precision falling while recall stays stable indicates the relationship between input features and the fraud label has shifted, so previously correct positive predictions increasingly become false positives. That change in the underlying target concept, rather than input distribution, is concept drift.

Why this answer

Concept drift occurs when the statistical relationship between input features and the target variable changes over time, causing the model's decision boundary to become less accurate. In this scenario, precision is declining while recall remains stable, indicating that the model is producing more false positives even though it still catches the same proportion of true positives. This is a classic sign of concept drift, where the underlying definition of fraud has shifted, not the data distribution itself.

Exam trap

The CompTIA AI exam often tests the distinction between data drift and concept drift by presenting a scenario where only one performance metric changes, tempting candidates to incorrectly choose data drift because they associate any performance decline with input data changes, rather than recognizing that a stable recall with dropping precision points to a shift in the underlying concept.

How to eliminate wrong answers

Option A is wrong because data drift refers to changes in the distribution of input features, which would typically affect both precision and recall or cause a shift in all performance metrics, not a selective decline in precision alone. Option B is wrong because covariate shift is a specific type of data drift where the distribution of input features changes while the conditional distribution P(y|x) remains the same; here, the conditional relationship is changing, as evidenced by the precision drop. Option C is wrong because label drift involves changes in the distribution of the target labels (e.g., the overall fraud rate), which would affect recall and precision together, not precision in isolation with stable recall.

Practice this question →

8

MCQhard

A media company serves personalized article recommendations through a model hosted on a cloud inference service. During a major news event, request volume spikes tenfold and p95 latency rises from 120 ms to over 2 seconds, causing timeouts on the web front end. The model itself is unchanged and the endpoint is healthy. The team wants to keep serving personalized results during spikes without degrading the user experience. Which action should the team take first?

A.Retrain the recommendation model on a larger dataset so it produces results faster under load.

B.Switch the front end to a static, non-personalized article list whenever request volume exceeds the autoscaling limit.

C.Lower the model's prediction confidence threshold so fewer candidates are scored per request.

D.Cache or precompute recommendations for high-traffic article and user segments and serve those cached results during the spike.

AnswerD

Serving precomputed or cached recommendations for the hottest segments removes most inference calls from the critical path during the spike, directly reducing p95 latency and preventing front-end timeouts. This is the fastest operational lever because it requires no model change and can be enabled immediately, preserving personalization quality for the segments that matter most during the event.

Why this answer

The latency spike is caused by a tenfold surge in request volume against a fixed-capacity inference path, not by a model defect. Caching or precomputing recommendations for high-traffic segments removes redundant inference work from the request path, cutting p95 latency immediately while preserving personalization. Retraining, threshold tuning, and static fallbacks either do not reduce per-request compute or sacrifice the personalization the team must retain.

Exam trap

The trap here is treating a capacity and serving-path problem as a model-quality problem, which leads to retraining or threshold changes that cannot reduce inference latency.

Practice this question →

9

MCQhard

The exhibit shows the output of a drift monitoring command for a fraud detection model. The team has an automated pipeline that triggers retraining when the overall average drift score exceeds 0.10. Based on the exhibit, what should the operations team do next?

A.Force retraining on all features to ensure the model adapts to the new data distribution.

B.Manually analyze the drift in 'amount' and 'location' and investigate potential causes.

C.No action is needed because the model is performing within acceptable drift limits.

D.Initiate the automated retraining pipeline since the average drift exceeds 0.05.

AnswerB

The exhibit shows per-feature drift exceeding the threshold on 'amount' and 'location' while the overall average stays below 0.10, so the automated retraining trigger never fires. Manual investigation of those two features is required to determine whether the drift is genuine and warrants intervention.

Why this answer

The exhibit shows that the overall average drift score is below 0.10, so the automated retraining pipeline should not trigger. However, individual features like 'amount' and 'location' show elevated drift values that warrant manual investigation to understand root causes before any retraining decision. The team should analyze these specific features to determine if the drift is due to genuine data distribution changes or data quality issues.

Exam trap

CompTIA AI often tests the distinction between aggregate drift thresholds and per-feature drift analysis, trapping candidates who assume that a low overall average drift means no action is needed, ignoring that individual features may still require investigation.

How to eliminate wrong answers

Option A is wrong because force retraining on all features is an overreaction and could introduce model instability; retraining should be targeted or based on the overall drift threshold, not forced indiscriminately. Option C is wrong because while the overall average drift is below 0.10, the elevated drift in 'amount' and 'location' indicates that action is needed to investigate potential causes, so 'no action' is not appropriate. Option D is wrong because the automated retraining pipeline triggers when the overall average drift score exceeds 0.10, not 0.05; the exhibit shows the average drift is below 0.10, so the pipeline should not be initiated.

Practice this question →

10

MCQeasy

A data scientist is deploying a machine learning model to production. The model was trained on an imbalanced dataset. Which technique should be used during deployment to mitigate bias without retraining the model?

A.Apply post-processing calibration to adjust decision thresholds

B.Use an ensemble of models trained on balanced subsets

C.Rebalance the dataset using SMOTE before inference

D.Remove sensitive features from the input data

AnswerA

Post-processing calibration adjusts decision thresholds after inference, shifting the operating point to equalise outcomes across groups. Because it modifies predictions rather than learned weights, it mitigates bias from the imbalanced training set without retraining the model.

Why this answer

Post-processing calibration adjusts the decision threshold of the model to account for the class imbalance present in the training data. This technique modifies the output probabilities or classification boundary without requiring access to the original training data or retraining the model, making it suitable for deployment scenarios where the model is already fixed.

Exam trap

CompTIA often tests the distinction between techniques applied during training versus deployment, and the trap here is that candidates mistakenly choose SMOTE or ensemble methods, which require retraining, instead of recognizing that threshold adjustment is a valid post-deployment bias mitigation strategy.

How to eliminate wrong answers

Option B is wrong because using an ensemble of models trained on balanced subsets requires retraining or modifying the model architecture, which violates the constraint of not retraining the model. Option C is wrong because SMOTE (Synthetic Minority Over-sampling Technique) is a data preprocessing method applied before training to balance the dataset, not during inference; applying it at inference time would require access to the original training data and would alter the input distribution, which is not feasible or correct. Option D is wrong because simply removing sensitive features does not mitigate bias caused by imbalanced data; bias can still propagate through correlated features, and this approach does not address the class imbalance issue directly.

Practice this question →

11

MCQhard

A media company serves personalized article recommendations through a model that is retrained weekly. After a major news event, engagement metrics show that recommendations became stale within hours because the model had not yet seen the new topic. The engineering team wants recommendations to reflect breaking topics within minutes without retraining the whole model. Which approach should the team implement?

A.Add a real-time retrieval layer that surfaces recently published articles by semantic similarity to the user's current session, and blend those candidates with the model's ranked output.

B.Shorten the retraining cadence from weekly to hourly so the model learns the new topic sooner.

C.Increase the weight of the recency feature in the existing ranking model and redeploy the updated weights.

D.Lower the diversity threshold so the recommender is allowed to show a wider spread of topics to each user.

AnswerA

Real-time retrieval injects brand-new articles into the candidate set immediately, independent of the weekly training cycle, and semantic similarity keeps them relevant to the user's live session. Blending retrieved candidates with the model's ranking preserves personalization quality while closing the freshness gap that pure batch retraining cannot address within minutes.

Why this answer

The gap is that breaking articles never enter the candidate set until the next weekly training cycle, so no amount of reweighting or diversity tuning can surface them. A real-time retrieval layer that matches fresh articles to the live session and blends them into the ranking closes that gap within minutes while preserving existing personalization.

Exam trap

The trap here is trying to solve a candidate-generation freshness problem with ranking-side changes such as feature weights or diversity thresholds, which only reorder items that were already retrieved.

Practice this question →

12

MCQhard

A financial services firm deploys a credit-scoring model that must produce explanations for adverse action notices. The compliance team requires that each decision be traceable to the exact model version, input features, and the explanation method used at inference time. The data science team currently logs only predictions and timestamps. Which approach best satisfies the traceability requirement?

A.Enable verbose application logging that records request IDs and HTTP status codes for all inference calls.

B.Log the prediction, the model version identifier, a hash of the input feature vector, and the explanation output for every inference request in an immutable audit store.

C.Retrain the model monthly and store the training dataset alongside the production model artifact.

D.Use a model registry to promote models to production and tag each release with a semantic version.

AnswerB

This captures the model version, the exact inputs, and the explanation produced at decision time, which is what the compliance team requires. Storing them immutably supports audits and reproducibility. A feature-vector hash allows verification without retaining raw sensitive data, and the explanation output ties the notice to the actual method used.

Why this answer

Traceability for adverse action notices requires linking each decision to the model version, the exact inputs, and the explanation method. Logging those elements together in an immutable store creates an auditable record. Registry tags, training data retention, and generic request logs each capture only part of the picture and cannot reconstruct an individual decision.

Exam trap

The trap here is confusing model governance artifacts, such as a registry or training data, with per-decision audit records that explain a specific outcome.

Practice this question →

13

MCQmedium

Based on the exhibit, what is the most likely cause of the pod failure and its solution?

A.The node has insufficient CPU; add more CPU.

B.The pod is configured with wrong GPU drivers; update drivers.

C.The model is too large; use a smaller model.

D.The container memory limit is too low; increase the memory limit in the pod spec.

AnswerD

The container exceeded its configured memory limit, so the kernel terminated it with an OOMKilled status. Raising the memory limit in the pod spec allows the workload to complete, satisfying the resource constraint the exhibit shows the container breaching.

Why this answer

The pod failure is caused by an OOMKilled (Out of Memory) error, as indicated by the pod status in the exhibit. When a container exceeds its memory limit, Kubernetes terminates it with an OOMKilled exit code. Increasing the memory limit in the pod spec allows the container to allocate more memory, resolving the failure.

Exam trap

CompTIA often tests the distinction between resource exhaustion errors (OOMKilled vs. CPU throttling) and configuration errors (driver issues), leading candidates to incorrectly attribute a memory limit issue to a hardware or driver problem.

How to eliminate wrong answers

Option A is wrong because the exhibit shows no CPU-related errors or resource pressure; the failure is due to memory exhaustion, not insufficient CPU. Option B is wrong because GPU driver issues would manifest as device plugin errors or initialization failures, not an OOMKilled status. Option C is wrong because the model size is not directly indicated as the cause; the pod is failing due to memory limits, and using a smaller model might reduce memory usage but does not address the misconfigured resource limit.

Practice this question →

14

MCQmedium

A retail company's ML platform team notices that one of their production models has begun returning predictions with a drastically different distribution than during training. The monitoring dashboard shows the input feature distributions have shifted but no code or model artifacts have changed. The team wants to automatically trigger a retraining pipeline when this condition is detected. Which approach should they implement?

A.Configure a data drift monitor that computes statistical distance between live inference inputs and the training baseline, and wire its alert to the retraining pipeline trigger.

B.Enable concept drift detection by comparing the relationship between features and labels over time and trigger retraining when the mapping changes.

C.Implement a model versioning system that records the exact training data hash and triggers retraining whenever the hash of the incoming data differs from the stored hash.

D.Set up a model performance monitor that tracks prediction accuracy against ground truth labels and triggers retraining when accuracy drops below a threshold.

AnswerA

This is correct because the scenario describes a change in input feature distributions with no change to model code or artifacts, which is data drift. A drift monitor comparing live inputs to the training baseline detects this and can trigger retraining automatically.

Why this answer

The scenario describes data drift: input feature distributions have changed while the model and code remain the same. A data drift monitor that compares live inputs to the training baseline is the correct tool to detect this and can be integrated with the retraining pipeline. Other monitoring types either require labels, focus on label relationships, or are overly sensitive.

Exam trap

The trap here is confusing data drift with concept drift or model performance degradation, leading to selection of a monitor that does not directly detect input distribution changes.

Practice this question →

15

MCQmedium

An AI system used for hiring has been found to exhibit racial bias against certain candidates. Which step should the organization take to mitigate this?

A.Remove all demographic features from the model.

B.Use a different algorithm that is inherently unbiased.

C.Regularly audit model predictions across demographic groups and retrain with fairness constraints.

D.Hire more diverse data scientists.

AnswerC

Auditing predictions across demographic groups exposes disparate impact that aggregate accuracy hides, satisfying the need to detect racial bias. Retraining with fairness constraints then adjusts the model's decision boundary to reduce that measured disparity, rather than merely documenting it. This directly targets the biased hiring outcomes described.

Why this answer

Bias in AI systems is often embedded in training data or model behavior, not just in feature selection. Regularly auditing predictions across demographic groups and retraining with fairness constraints (e.g., demographic parity or equalized odds) allows the organization to detect and correct disparate impact without sacrificing model performance. This aligns with the AI0-001 focus on continuous monitoring and iterative improvement in AI operations.

Exam trap

CompTIA often tests the misconception that removing sensitive attributes (like race or gender) automatically makes a model fair, when in reality proxy features and biased training data can perpetuate discrimination.

How to eliminate wrong answers

Option A is wrong because simply removing demographic features does not eliminate bias; proxy features (e.g., zip code, education level) can still encode the same discriminatory patterns, and the model may learn biased correlations from the remaining data. Option B is wrong because no algorithm is inherently unbiased; bias arises from data, labeling, and deployment context, so switching algorithms without addressing root causes will not guarantee fairness. Option D is wrong because hiring more diverse data scientists, while beneficial for broader perspectives, does not directly mitigate existing model bias; technical interventions like auditing and retraining with fairness constraints are required.

Practice this question →

16

Multi-Selecthard

An organization is implementing an AI governance framework. Which THREE components are essential for compliance with ethical AI standards?

Select 3 answers

A.Data privacy protection measures (e.g., differential privacy).

B.Open-source licensing of all models.

C.Maximizing model accuracy to increase revenue.

D.Model explainability and interpretability mechanisms.

E.Regular bias auditing of models.

AnswersA, D, E

Differential privacy adds calibrated noise so individual records cannot be re-identified from model outputs or training data, directly satisfying the ethical standard's data privacy protection requirement. It is a technical control, not merely a policy statement, making it essential within an enforceable AI governance framework.

Why this answer

Option A (data privacy protection measures such as differential privacy) is essential because ethical AI standards require safeguarding personal data, and techniques like differential privacy provide formal, quantifiable guarantees that individual records cannot be inferred from model outputs, supporting regulations like GDPR. Option D (model explainability and interpretability mechanisms) is essential because stakeholders must understand how decisions are reached; methods such as SHAP, LIME, or inherently interpretable models enable accountability and contestability required by ethical frameworks. Option E (regular bias auditing of models) is essential because systematic auditing detects disparate impact across protected groups, using metrics like demographic parity or equalized odds, ensuring fairness is continuously monitored rather than assumed.

Option B is not required because ethical compliance concerns how models are governed and used, not whether they are open-sourced; proprietary models can be fully ethical. Option C is incorrect because maximizing accuracy for revenue is a business objective, not an ethical compliance requirement, and can even conflict with fairness and privacy goals.

Exam trap

The AI0-001 exam often tests the misconception that open-source licensing or maximizing accuracy are ethical imperatives, when in fact they are operational or business choices that do not directly satisfy the core pillars of ethical AI (privacy, fairness, transparency, accountability).

Practice this question →

17

MCQhard

A global retailer uses an AI model to forecast demand across thousands of stores. After deployment, the model's predictions become less accurate during holiday seasons. The training data included two years of holiday periods. What is the most effective operational strategy to handle this recurring seasonal drift?

A.Deploy an anomaly detection system to flag holiday prediction outliers

B.Implement a scheduled retraining cycle just before each holiday period

C.Use an ensemble of models trained on different time periods

D.Increase the volume of training data by including five years of history

AnswerB

Scheduled retraining immediately before each holiday period refreshes the model with the most recent seasonal patterns, directly countering the recurring drift the stem describes. Because the drift is predictable and calendar-bound, a timed cycle restores accuracy before peak demand, unlike reactive monitoring or static thresholds.

Why this answer

Scheduled retraining just before each holiday season directly addresses the recurring seasonal drift by updating the model with the most recent holiday data patterns. This is the most effective operational strategy because it proactively aligns the model with the known, periodic shift in demand behavior, rather than reacting to errors or relying on static historical data.

Exam trap

CompTIA often tests the misconception that more data or anomaly detection is the universal solution to drift, but the trap here is that candidates overlook the need for proactive, scheduled updates tailored to known recurring patterns rather than reactive or static fixes.

How to eliminate wrong answers

Option A is wrong because anomaly detection only flags outliers after predictions are made, it does not correct the underlying model drift or improve forecast accuracy during the holiday period. Option C is wrong because an ensemble of models trained on different time periods may reduce variance but does not specifically target the recurring seasonal pattern; it could still suffer from drift if none of the models are updated for the current holiday context. Option D is wrong because simply adding more historical data (five years) does not guarantee the model will adapt to the most recent seasonal shifts; older data may even introduce outdated patterns that dilute the relevance of recent holiday trends.

Practice this question →

18

MCQmedium

A retail company's demand-forecasting model was trained on three years of sales data. After a major competitor closes, regional purchasing patterns shift sharply within two weeks, and forecast error spikes. The operations team wants to detect this kind of abrupt change quickly and trigger a review. Which practice best addresses this requirement?

A.Schedule a full model retraining job to run automatically every quarter

B.Increase the model's training data volume by adding more historical years

C.Monitor input feature distributions and prediction error against a rolling baseline with alerting thresholds

D.Reduce the model's complexity by switching to a simpler linear regression algorithm

AnswerC

Tracking feature distributions and error metrics against a rolling baseline lets the team detect abrupt shifts within days rather than waiting for a periodic retraining cycle. Alerting thresholds on drift and error spikes trigger human review precisely when purchasing patterns change, which is the stated requirement. This is the standard operational approach for concept and data drift detection.

Why this answer

Monitoring both input feature distributions and prediction error against a rolling baseline provides early warning of abrupt distributional shifts. Alerting thresholds convert that signal into a timely review trigger, which matches the two-week detection window. The other options either change the model or rely on slow retraining cycles, none of which detect sudden change quickly.

Exam trap

The trap here is equating more data or periodic retraining with drift detection, when timely alerting requires continuous monitoring against a baseline.

Practice this question →

19

MCQhard

A large e-commerce company has deployed a real-time product recommendation system using a neural collaborative filtering model. The model was trained on six months of user click and purchase data. For the first three months after deployment, the click-through rate (CTR) improved by 15%. However, starting in the fourth month, CTR began decreasing steadily despite no changes to the system infrastructure or data pipeline. The product manager suspects model decay but the engineering team insists the model is static and should not degrade. The data science lead suggests investigating further. They have access to production logs, A/B testing framework, and historical model versions. What is the BEST course of action to diagnose and address the issue?

A.Re-deploy the model with additional features such as time of day and user device.

B.Increase the frequency of batch inference from hourly to every 10 minutes to improve responsiveness.

C.Set up an A/B test comparing the current model against the original baseline model using recent traffic.

D.Retrain the model on only the most recent 30 days of data and replace the current model.

AnswerC

Running an A/B test against the original baseline on recent traffic isolates whether the current model has decayed relative to its starting performance, separating genuine model drift from shifting user behaviour. This satisfies the stem's diagnostic need using the available framework and historical versions.

Why this answer

Setting up an A/B test comparing the current model against the original baseline model using recent traffic directly isolates whether the model's predictive performance has degraded due to concept drift (changes in user behavior over time). Since the model is static but the data distribution has shifted, the A/B test provides empirical evidence of decay by measuring CTR differences under identical conditions, which is the standard diagnostic step before any retraining or feature engineering.

Exam trap

CompTIA often tests the principle that diagnosing model decay requires a controlled comparison (A/B test) rather than immediately retraining or adding features, and the trap here is assuming that a static model cannot degrade when the underlying data distribution changes.

How to eliminate wrong answers

Option A is wrong because adding features like time of day or user device without first diagnosing the root cause of CTR decline may introduce noise or overfitting, and does not address the likely concept drift. Option B is wrong because increasing batch inference frequency improves latency but does not affect model accuracy or counteract data distribution shifts; the model's predictions remain unchanged regardless of inference cadence. Option D is wrong because retraining on only the most recent 30 days of data could discard valuable long-term patterns and may cause catastrophic forgetting, and it bypasses the necessary diagnostic step of confirming that model decay is indeed the issue.

Practice this question →

20

MCQmedium

A batch inference pipeline fails intermittently with out-of-memory errors when processing large datasets. The pipeline uses pandas DataFrames and feeds a pre-trained model. Which change would most effectively reduce memory consumption?

A.Increase the instance size of the compute node

B.Use a database instead of CSV files

C.Convert the model to use half-precision

D.Split the data into smaller chunks and process sequentially

AnswerD

Chunked sequential processing bounds peak memory because only one subset of the data is resident at any time, rather than materialising the entire dataset in pandas. This directly addresses the out-of-memory failures during large batch inference without altering the model.

Why this answer

Splitting a large dataset into smaller chunks and processing them sequentially directly addresses the root cause of the out-of-memory error: the entire dataset is loaded into memory at once via pandas DataFrames. By processing data in batches, each chunk fits within the available RAM, preventing memory exhaustion while still allowing the pipeline to complete the full inference workload.

Exam trap

CompTIA often tests the misconception that scaling up hardware (Option A) is the best solution, when in fact architectural changes like chunking (Option D) are more effective and cost-efficient for batch processing workloads.

How to eliminate wrong answers

Option A is wrong because increasing the instance size merely adds more memory, which is a temporary workaround that does not fix the underlying inefficiency and increases cost; the pipeline will still fail if the dataset grows beyond the new limit. Option B is wrong because using a database instead of CSV files changes the storage layer but does not inherently reduce memory consumption during inference—pandas still loads the entire result set into a DataFrame unless chunked queries are explicitly used. Option C is wrong because converting the model to half-precision (FP16) reduces model memory footprint but does not address the primary memory consumer, which is the pandas DataFrame holding the large dataset; the model is typically much smaller than the data.

Practice this question →

21

Multi-Selectmedium

A media company serves a generative AI assistant to customers through an API. After an update to the system prompt, users begin reporting that the assistant produces responses outside the company's approved tone and occasionally reveals parts of its internal instructions. The operations team must add safeguards that reduce these behaviors in production. (Choose two.)

Select 2 answers

A.Raise the maximum token limit for responses so the assistant has more room to explain itself clearly.

B.Add adversarial red-team testing of prompt injection and instruction-extraction attempts, and use the findings to harden the system prompt and input handling.

C.Deploy an output moderation layer that classifies responses for policy violations and blocks or rewrites disallowed content before it reaches the user.

D.Cache frequent prompts and their responses to reduce load on the inference endpoint and improve consistency.

E.Increase the model's temperature setting so responses vary more and are less likely to follow a fixed undesirable pattern.

AnswersB, C

The reported behavior includes attempts that coax the model into revealing its instructions, which is exactly what adversarial testing is designed to expose. Feeding those findings back into prompt design and input sanitization reduces the attack surface. It complements runtime filtering by fixing the weakness rather than only catching its results.

Why this answer

The complaints describe two distinct failure modes: off-policy tone and disclosure of internal instructions. A response moderation layer enforces policy on what actually leaves the system, while adversarial red-team testing hardens the prompt and input handling against extraction attempts. Together they cover both detection and root-cause reduction.

Temperature, token limits, and response caching affect variability, length, and cost, none of which constrain the model's willingness to violate policy or leak its instructions.

Exam trap

The trap here is assuming that tweaking generation parameters like temperature or token limits provides safety, when those settings influence style and length rather than policy compliance.

Practice this question →

22

MCQeasy

A logistics company runs an AI route-optimization service that calls a hosted large language model to interpret free-text driver notes and convert them into structured stop instructions. The service works in testing, but in production many requests fail with rate-limit and timeout errors during the morning dispatch window. The team wants the service to survive these failures without losing driver instructions. Which approach should the team implement?

A.Switch the service to send all of the morning's driver notes in a single batched request to reduce the total call count.

B.Raise the client-side request timeout to ten minutes so slow responses are allowed to complete.

C.Add retry with exponential backoff and jitter, plus an idempotency key so repeated attempts do not create duplicate stop instructions.

D.Cache the model's responses and serve cached structured instructions whenever a similar driver note is submitted.

AnswerC

Rate-limit and timeout errors are transient, so retrying with exponential backoff and jitter spreads the load and avoids synchronized retry storms. The idempotency key ensures a retried request is processed once, preventing duplicate stop instructions. Together they let the dispatch service recover from provider throttling without corrupting the driver's task list.

Why this answer

The failures are transient throttling and timeout conditions, which are exactly what retry with exponential backoff and jitter is designed to absorb. Adding an idempotency key makes those retries safe by guaranteeing that a repeated request produces one set of stop instructions rather than duplicates.

Exam trap

The trap here is treating provider rate limiting as a latency problem and raising timeouts, when the correct response is controlled retry with backoff plus a deduplication safeguard.

Practice this question →

23

MCQmedium

A retail company's demand-forecasting model has been running in production for eight months. Data scientists notice that prediction error has slowly increased, and statistical tests show the distribution of weekly sales figures has shifted relative to the training data, while the model code and pipeline are unchanged. Which phenomenon best describes this situation?

A.Overfitting, because the model memorized the original training set

B.Concept drift, because the relationship between features and the target has changed

C.Data drift (covariate shift) affecting the input feature distribution

D.Model versioning failure, because the deployed artifact does not match the registry

AnswerC

The input distribution of weekly sales has shifted away from what the model learned during training, which is the definition of data drift or covariate shift. Because the pipeline and code are untouched, the degradation stems from the changed real-world data rather than a defect, making retraining on recent data the appropriate operational response.

Why this answer

Gradual error growth with an unchanged pipeline, combined with statistical evidence that the incoming feature distribution no longer matches training data, is the classic signature of data drift. Concept drift would require evidence that the input-to-target relationship changed, overfitting would appear as poor generalization early on, and a versioning failure would typically cause a sudden discontinuity rather than a slow trend.

Exam trap

The trap here is assuming any accuracy decline equals concept drift, when a measured shift in input feature distributions with unchanged code is data drift.

Practice this question →

24

Multi-Selecthard

Which THREE factors are most critical to consider when designing a continuous integration/continuous deployment (CI/CD) pipeline for machine learning?

Select 3 answers

A.Data quality and schema validation

B.A/B testing framework for comparing models

C.Automated model performance benchmarking

D.Automated unit testing of application code

E.Versioning of datasets, models, and training code

AnswersA, C, E

ML pipelines must validate incoming data against expected schemas before training or scoring, since silent schema or distribution changes break models in ways code tests cannot catch. This satisfies the need to gate deployments on data integrity rather than only application code.

Why this answer

Option A (Data quality and schema validation) is critical because ML pipelines depend on input data distributions and formats; without validating schema, ranges, and drift, training and inference can silently break or degrade. Option C (Automated model performance benchmarking) is essential because a CI/CD pipeline for ML must gate deployments on metrics such as accuracy, F1, RMSE, or latency against a baseline, not just on code tests. Option E (Versioning of datasets, models, and training code) is required for reproducibility and rollback, since ML artifacts are non-deterministic and must be traceable across data, code, hyperparameters, and model binaries.

Option B is useful for post-deployment experimentation but is not one of the three most critical pipeline design factors, and Option D, while important for general software CI, is insufficient for ML-specific concerns like data validation, model metrics, and artifact lineage.

Exam trap

CompTIA often tests the distinction between ML-specific pipeline requirements and general DevOps practices, so candidates mistakenly select generic options like unit testing (D) or A/B testing (B) instead of the ML-critical factors of data validation, model benchmarking, and versioning.

Practice this question →

25

MCQmedium

A company wants to roll out a new recommendation model to production. They decide to run an A/B test where 10% of users see the new model and 90% see the old model. After one week, the new model shows a 5% improvement in click-through rate. What is the next best action?

A.Immediately roll out the new model to 100% of users

B.Revert to the old model because the improvement is minimal

C.Run the test for another month to ensure statistical significance

D.Increase the testing percentage gradually while monitoring performance metrics and guardrails

AnswerD

A one-week 5% lift on 10% traffic is promising but not conclusive, so gradually raising exposure while watching guardrail metrics limits blast radius if the model degrades. Immediate full rollout risks undetected regressions; stopping discards a positive signal.

Why this answer

A 5% improvement observed over only one week with a 10% traffic split is insufficient to confirm statistical significance or rule out novelty effects, data drift, or seasonal bias. The recommended best practice in AI deployment is to gradually increase the testing percentage (e.g., 10% → 25% → 50% → 100%) while continuously monitoring performance metrics and guardrails (e.g., click-through rate, conversion rate, latency, and error rates) to ensure the new model generalizes safely across the full user population.

Exam trap

CompTIA often tests the misconception that a short-term observed improvement is automatically statistically significant, tempting candidates to choose immediate full rollout (Option A) or premature reversion (Option B), when the correct answer emphasizes incremental deployment with continuous monitoring.

How to eliminate wrong answers

Option A is wrong because immediately rolling out to 100% of users risks exposing the entire user base to a model that may have only shown a temporary or statistically insignificant improvement, potentially causing negative business impact if the model fails under full load or exhibits unexpected behavior. Option B is wrong because reverting to the old model based on a 'minimal' improvement is premature; a 5% uplift could be meaningful depending on the baseline, and the test should be allowed to run longer to gather sufficient data for a valid statistical conclusion. Option C is wrong because running the test for another month without adjusting the traffic split or monitoring guardrails is inefficient and may still not guarantee statistical significance if the sample size remains too small; the correct approach is to increase the traffic percentage gradually while verifying performance at each step.

Practice this question →

26

Multi-Selecteasy

Which THREE are common pitfalls when operationalizing AI models? (Select THREE.)

Select 3 answers

A.Training-serving skew due to differences in data preprocessing

B.Using simpler models that are easier to debug

C.Lack of monitoring for model performance drift

D.Ignoring infrastructure scalability requirements

E.Automating the model retraining process

AnswersA, C, D

Preprocessing logic applied during training must be replicated identically at inference; divergence in scaling, tokenisation or feature encoding shifts input distributions, degrading predictions. This is the classic training-serving skew pitfall, directly satisfying the stem's operationalisation concern.

Why this answer

Option A is correct because training-serving skew occurs when the preprocessing, feature engineering, or transformations applied during training differ from those applied at inference time, causing the model to receive inputs that do not match its learned distribution and degrading predictions. Option C is correct because deployed models degrade over time due to data drift, concept drift, and changing user behavior, so without monitoring for performance drift (e.g., tracking accuracy, latency, and input distributions) failures go undetected. Option D is correct because operationalizing AI requires serving infrastructure that can handle production traffic, scaling, and latency requirements; ignoring scalability leads to outages or unacceptable response times under load.

Option B is not a pitfall but often a deliberate, sound engineering choice, since simpler models are easier to debug, maintain, and explain. Option E is not a pitfall either; automating retraining is a recommended MLOps practice that helps keep models current, provided it is paired with validation and monitoring.

Exam trap

CompTIA often tests the distinction between operational pitfalls and best practices, so the trap here is that candidates may mistake a recommended practice (like using simpler models or automating retraining) for a pitfall, when in fact the pitfall is the lack of monitoring or ignoring scalability.

Practice this question →

27

MCQmedium

A retail bank operates a real-time AI service that approves or declines card transactions in under 100 ms. During a marketing campaign, transaction volume triples and the inference service's p99 latency rises to 1.4 seconds, causing checkout timeouts. The model is unchanged and CPU utilization on the inference nodes is only 35%. Which action BEST addresses the latency increase while preserving the sub-100 ms requirement?

A.Move the model to a larger instance type with more vCPUs and memory per replica.

B.Increase the inference batch size so the service processes more transactions per request.

C.Enable autoscaling of the inference replicas based on request concurrency or queue depth.

D.Retrain the fraud model on the campaign-period transaction data and redeploy it.

AnswerC

Low CPU utilization combined with high p99 latency indicates requests are queueing rather than computing, so scaling out replicas reduces the queue and restores the sub-100 ms target. Scaling on concurrency or queue depth reacts to the actual saturation signal, unlike CPU-based scaling that would remain idle at 35% and never trigger during the campaign traffic spike.

Why this answer

High p99 latency with low CPU utilization is the classic signature of request queueing, not compute saturation. Scaling the number of inference replicas based on concurrency or queue depth increases parallel capacity so requests are served promptly, restoring the sub-100 ms SLA. Neither retraining, bigger instances, nor batching addresses the queueing root cause, and batching would actually increase per-request latency.

Exam trap

The trap here is assuming that low CPU utilization means the service is healthy and that latency must be a model-quality problem rather than a queueing capacity problem.

Practice this question →

28

MCQeasy

A hospital's AI triage assistant occasionally returns confident but incorrect recommendations when it encounters patient records with missing lab values. The clinical team wants the system to avoid acting on unreliable inputs until a human reviews them. Which operational control best addresses this need?

A.Increase the model's temperature setting to make its outputs more varied and less overconfident.

B.Implement an input validation and confidence threshold gate that routes low-confidence or incomplete records to a human reviewer.

C.Retrain the model on a larger dataset that includes more examples with missing lab values.

D.Add a dashboard that displays model accuracy metrics to the clinical staff in real time.

AnswerB

A validation and confidence gate directly targets the failure mode by detecting incomplete inputs and low-confidence outputs, then escalating them for human review. This preserves safety while allowing the system to handle well-formed cases automatically. It is a standard human-in-the-loop control for high-stakes AI operations.

Why this answer

The safest operational response to confident but incorrect outputs on incomplete inputs is a gate that validates inputs and checks confidence, then escalates uncertain cases to a human. This prevents automated action on unreliable data. Temperature changes, retraining, and dashboards do not block individual unsafe recommendations in real time.

Exam trap

The trap here is treating aggregate monitoring or retraining as if it were a real-time safeguard for individual high-risk decisions.

Practice this question →

29

MCQhard

A financial institution deploys an AI credit scoring model. After six months, the model's performance drops significantly. Analysis shows that the relationship between features and labels has changed. Which term describes this phenomenon?

A.Concept drift

B.Model decay

C.Overfitting

D.Data drift

AnswerA

Concept drift describes the statistical properties of the target variable changing over time, so the relationship between input features and labels no longer matches what the model learned. The six-month performance drop caused by altered feature-label relationships is precisely this phenomenon.

Why this answer

Concept drift occurs when the statistical relationship between input features and the target label changes over time, which is exactly what happened when the credit scoring model's performance dropped due to a shift in the feature-label relationship. This is distinct from data drift, which only involves changes in the input data distribution without affecting the label mapping.

Exam trap

CompTIA often tests the distinction between concept drift and data drift, and the trap here is that candidates confuse a change in input data distribution (data drift) with a change in the underlying relationship between features and labels (concept drift), leading them to incorrectly select data drift.

How to eliminate wrong answers

Option B (Model decay) is wrong because model decay is a general term for performance degradation over time, but it does not specifically describe a change in the feature-label relationship; it could be caused by data drift, concept drift, or other factors. Option C (Overfitting) is wrong because overfitting refers to a model learning noise or specific patterns in the training data that do not generalize, not a post-deployment shift in the underlying relationship. Option D (Data drift) is wrong because data drift only describes changes in the distribution of input features (e.g., customer income shifts), not a change in the mapping from features to the target label (e.g., what constitutes a good credit risk).

Practice this question →

30

Multi-Selecthard

An ML operations team needs to monitor a deployed model's performance. Which TWO metrics are most useful for detecting concept drift in a regression model? (Choose two.)

Select 2 answers

A.Distribution of input features

B.Distribution of residuals between predictions and actuals

C.Classification accuracy

D.Model inference latency

E.Mean absolute error (MAE) over a sliding time window

AnswersB, E

Residual distributions reveal concept drift because changing feature-label relationships alter the error pattern, not merely its magnitude. Tracking how residuals shift over time exposes degradation that aggregate accuracy scores can mask, making it a direct signal of drift in regression models.

Why this answer

Option B is correct because the distribution of residuals between predictions and actuals directly reveals concept drift: if the relationship between inputs and target changes, the residual distribution will shift (e.g., become biased or wider) even when input features look unchanged. Option E is correct because tracking MAE over a sliding time window is a standard regression performance monitor; a sustained increase in MAE relative to a baseline indicates that the model's learned mapping no longer matches the current data-generating process, which is the practical signature of concept drift. Option A is not the best choice here because input feature distribution shifts indicate data drift (covariate shift), not concept drift, and inputs can drift without the input-target relationship changing.

Option C is wrong because classification accuracy applies to classification models, not regression. Option D is wrong because inference latency is an operational/system metric and says nothing about changes in the input-target relationship.

Exam trap

CompTIA often tests the distinction between covariate drift and concept drift, trapping candidates who think monitoring input features is sufficient for detecting all types of model degradation.

Practice this question →

31

Multi-Selecthard

Which THREE components are essential for implementing a successful MLOps pipeline for a continuously deployed AI system?

Select 3 answers

A.Manual approval gates for each deployment

B.Canary deployment strategy

C.Model registry for version control and metadata management

D.Automated testing and validation of models and pipelines

E.Data and model versioning

AnswersC, D, E

A model registry stores versioned model artefacts with metadata, lineage and stage transitions, enabling reproducible promotion and rollback. This satisfies the continuously deployed pipeline's need to track which model version serves production, a requirement distinct from source-code versioning alone.

Why this answer

Option C is correct because a model registry provides centralized version control, lineage tracking, and metadata management (e.g., MLflow Model Registry, SageMaker Model Registry), which are essential for reproducible and auditable continuous deployments. Option D is correct because automated testing and validation of models and pipelines (unit tests, data validation, model performance checks, integration tests) are required to catch regressions before promotion in a CI/CD pipeline. Option E is correct because data and model versioning ensures that each deployed artifact can be traced back to the exact training data and model revision, enabling reproducibility and rollback.

Option A is not essential because manual approval gates contradict the goal of continuous deployment and slow delivery; automation replaces them. Option B is not essential because canary deployment is a useful release technique but not a required component of every MLOps pipeline.

Exam trap

CompTIA often tests the distinction between operational strategies (like canary deployments) and foundational pipeline components (like versioning and registries), leading candidates to confuse deployment tactics with essential infrastructure.

Practice this question →

32

MCQeasy

Based on the exhibit, which action is most likely to resolve the memory issue?

A.Add more training data.

B.Increase the learning rate.

C.Switch to a CPU.

D.Reduce the batch size.

AnswerD

Reducing batch size lowers peak activation memory because fewer samples are held simultaneously during the forward and backward passes. This directly addresses the memory exhaustion constraint shown in the exhibit without altering model architecture or precision.

Why this answer

The exhibit shows an out-of-memory (OOM) error during training. Reducing the batch size decreases the memory footprint per iteration, allowing the model to fit within available GPU memory. This directly resolves the memory issue without altering the model architecture or data.

Exam trap

CompTIA often tests the misconception that memory errors are solved by adding more data or changing hardware, when in fact the simplest and most common fix is adjusting the batch size to fit within available GPU memory.

How to eliminate wrong answers

Option A is wrong because adding more training data increases the dataset size, which does not reduce per-batch memory consumption and may even exacerbate memory pressure during data loading. Option B is wrong because increasing the learning rate affects convergence behavior and gradient magnitudes, not memory usage; it can cause instability or divergence but does not free GPU memory. Option C is wrong because switching to a CPU would typically use system RAM instead of GPU memory, but CPUs are far slower for deep learning training and do not resolve the underlying memory constraint—they just shift the bottleneck, often making training impractically slow.

Practice this question →

33

MCQmedium

A financial institution uses a machine learning model to approve personal loans. The model was trained on historical data that includes applicant age, income, credit score, and loan amount. Compliance officers have received customer complaints suggesting the model may be discriminating against applicants over 60 years old. Initial analysis shows that the approval rate for applicants over 60 is 20 percentage points lower than for younger applicants with similar credit profiles. The data science team has been asked to investigate and remediate any bias. They have access to the training data, model coefficients, and can retrain or modify the model. What is the FIRST step the team should take?

A.Replace the model with a third-party vendor model that claims to be bias-free.

B.Re-sample the training data to have equal numbers of applicants over and under 60.

C.Conduct a fairness audit using appropriate metrics such as disparate impact ratio on the current model.

D.Remove the age feature from the training data and retrain the model.

AnswerC

A fairness audit quantifies the disparity using metrics such as disparate impact ratio before any remediation, establishing whether the 20-point gap constitutes unlawful discrimination and which features drive it. This diagnostic step must precede retraining, since modifying the model without measuring the bias gives no baseline for verifying improvement.

Why this answer

The first step in addressing potential bias is to conduct a fairness audit using established metrics like the disparate impact ratio (e.g., the 80% rule from the US Equal Employment Opportunity Commission). This quantifies whether the model's approval rate for applicants over 60 is less than 80% of the rate for the younger group, providing a legally and technically sound baseline before any remediation. Without this measurement, any subsequent changes (like resampling or removing features) could be misguided or ineffective.

Exam trap

CompTIA often tests the misconception that removing a protected attribute (like age) is sufficient to eliminate bias, when in fact proxy features can perpetuate discrimination, making a fairness audit the mandatory first step.

How to eliminate wrong answers

Option A is wrong because replacing the model with a third-party vendor model that claims to be bias-free does not address the specific bias found in the current system, and it bypasses the necessary diagnostic step of understanding the root cause; vendor claims are not a substitute for empirical validation. Option B is wrong because resampling the training data to have equal numbers of applicants over and under 60 does not guarantee fairness—it can introduce sampling bias, distort the real-world distribution, and may not correct the underlying model behavior that causes disparate impact. Option D is wrong because simply removing the age feature from the training data and retraining the model is a naive approach; age may be correlated with other features (e.g., income, credit score), so the model could still indirectly discriminate through proxy variables, a phenomenon known as 'bias amplification' or 'redundant encoding'.

Practice this question →

34

MCQmedium

A data scientist fine-tunes a large language model for a legal document summarization task. After fine-tuning, the model performs well on test data but produces summaries that include hallucinated legal clauses. Which mitigation strategy is most effective?

A.Use a different tokenizer during fine-tuning.

B.Decrease the temperature parameter to 0.1 during inference.

C.Implement retrieval-augmented generation (RAG) to provide factual context.

D.Set a maximum token limit of 50 for each summary.

AnswerC

Retrieval-augmented generation grounds each summary in retrieved source passages, so the model conditions on actual clause text rather than parametric memory. This directly targets the hallucinated clauses arising after fine-tuning, satisfying the requirement to supply factual context at inference time without retraining the model.

Why this answer

Implement retrieval-augmented generation (RAG) to provide factual context. RAG reduces hallucinations by allowing the model to retrieve relevant, factual information from an external knowledge base during generation, grounding its output in verified data. Option A (different tokenizer) does not address the core issue of factual accuracy.

Option B (decrease temperature) affects randomness but does not prevent the model from fabricating content. Option D (max token limit) truncates output but does not stop the model from including false information within that limit.

Practice this question →

35

MCQeasy

During an AI model deployment, the operations team notices that inference requests are taking longer than expected. Which component is most likely causing the bottleneck?

A.Input data preprocessing pipeline

B.API gateway rate limiting

C.Database connection pool size

D.The machine learning model's size and architecture

AnswerD

Inference latency is dominated by the model itself: larger parameter counts and deeper architectures require more computation per forward pass. Since the stem describes slow inference requests, the model's size and architecture is the component most likely constraining throughput.

Why this answer

The machine learning model's size and architecture directly determine the computational complexity of inference. Larger models with more parameters or deeper architectures require more matrix multiplications and memory bandwidth, which increases latency per request. This is the most common bottleneck in AI deployment because the model itself is the core computation unit, and its inference time scales with its complexity.

Exam trap

CompTIA often tests the misconception that operational components like API gateways or databases are the primary cause of slow inference, when in fact the model's computational demand is the root cause, especially in scenarios where preprocessing and postprocessing are negligible.

How to eliminate wrong answers

Option A is wrong because input data preprocessing typically involves lightweight operations like normalization or tokenization, which are orders of magnitude faster than model inference and rarely the primary bottleneck unless the pipeline is poorly optimized. Option B is wrong because API gateway rate limiting controls the number of requests per second, not the latency of individual inference requests; it would cause throttling errors, not slow responses. Option C is wrong because database connection pool size affects the ability to fetch or store data concurrently, but inference latency is dominated by model computation, not database lookups, unless the model relies on external data retrieval per request.

Practice this question →

36

MCQeasy

An organization is deploying an AI model on edge devices with limited computational resources. Which model optimization technique is most appropriate?

A.Perform additional feature engineering

B.Apply model quantization

C.Use an ensemble of models

D.Increase the training dataset size

AnswerB

Quantization reduces weight and activation precision, typically from FP32 to INT8, shrinking memory footprint and speeding inference on constrained edge hardware. This directly satisfies the limited computational resources constraint, unlike pruning or distillation, which alter architecture or require a teacher model.

Why this answer

Model quantization reduces the precision of the model's weights and activations (e.g., from 32-bit floating point to 8-bit integer), which significantly decreases memory footprint and computational requirements. This makes it ideal for deployment on edge devices with limited resources, as it enables faster inference with minimal accuracy loss.

Exam trap

CompTIA often tests the misconception that improving model performance (e.g., via feature engineering or more data) is equivalent to optimizing for deployment constraints, when in fact techniques like quantization directly address resource limitations.

How to eliminate wrong answers

Option A is wrong because feature engineering improves model input quality but does not reduce the computational load or model size required for inference on edge devices. Option C is wrong because using an ensemble of models increases the total number of parameters and inference time, which is counterproductive for resource-constrained edge devices. Option D is wrong because increasing the training dataset size improves model generalization but does not reduce the model's computational requirements during inference; it may even increase training time and model complexity.

Practice this question →

37

MCQeasy

During model training, the data science team discovers that many input features contain missing values. Which step should be taken to improve data quality?

A.Implement data validation checks to handle missing data appropriately (e.g., imputation).

B.Increase the model complexity to handle missing data.

C.Ignore missing values and train the model.

D.Remove all records with missing values.

AnswerA

Missing values corrupt feature distributions, so validation checks that detect and impute them (mean, median, or model-based) restore dataset completeness before training. This directly satisfies the stem's data-quality constraint, preventing biased or failed model fitting caused by null inputs.

Why this answer

Data validation checks, such as imputation (e.g., mean, median, or KNN imputation), directly address missing values by estimating plausible replacements based on the available data. This improves data quality and prevents bias or loss of information that could degrade model performance. In the context of AI implementation, handling missing data is a fundamental data preprocessing step to ensure robust model training.

Exam trap

CompTIA often tests the misconception that 'ignoring missing data' or 'removing rows' is acceptable, when in fact proper data validation and imputation are required to maintain data integrity and model validity.

How to eliminate wrong answers

Option B is wrong because increasing model complexity (e.g., adding more layers or parameters) does not inherently handle missing data; it may overfit to noise or propagate errors from incomplete features. Option C is wrong because ignoring missing values can cause algorithms (e.g., linear regression, SVM) to fail during training or produce biased coefficients, as many implementations do not natively support NaN inputs. Option D is wrong because removing all records with missing values can lead to significant data loss, reduce sample size, and introduce selection bias, especially when missingness is not completely at random (MCAR).

Practice this question →

38

MCQmedium

A hospital's AI triage assistant produces recommendations that clinicians frequently override. An operations review finds the model was trained on data from a different patient population than the one currently served. Which action most directly addresses the root cause of the low acceptance rate?

A.Increase the model's inference frequency so recommendations refresh more often during a shift

B.Mandate that clinicians document a reason each time they override a recommendation

C.Add a confidence score display so clinicians can see how certain the model is about each recommendation

D.Retrain or fine-tune the model using data representative of the current patient population and revalidate its performance

AnswerD

The stated root cause is a training population that does not match the served population, which produces recommendations clinicians find unreliable and override. Retraining or fine-tuning on representative local data, followed by revalidation, directly corrects the mismatch and is the action most likely to restore clinical trust and acceptance.

Why this answer

The review identified a population mismatch between training data and the patients now being served, so the corrective action must close that gap. Retraining or fine-tuning on representative local data and revalidating performance targets the cause directly. Confidence displays, override documentation, and higher refresh rates are peripheral measures that do not change what the model has learned.

Exam trap

The trap here is choosing a transparency or workflow feature that appears to improve trust, when the actual defect is a training-data population mismatch requiring data remediation.

Practice this question →

39

MCQeasy

A company deploys a deep learning model for real-time image classification. After deployment, they notice high inference latency exceeding the 100ms SLA. Which action would most likely reduce latency without significantly impacting accuracy?

A.Add more training data to improve model robustness

B.Replace the model with a simpler logistic regression model

C.Increase batch size for inference

D.Apply model quantization

AnswerD

Quantization converts weights and activations from 32-bit floats to 8-bit integers, cutting memory bandwidth and enabling faster arithmetic, which reduces inference latency below the 100ms SLA. Accuracy loss is typically minimal because the reduced precision retains sufficient numerical range for classification.

Why this answer

Model quantization reduces the precision of the model's weights and activations (e.g., from 32-bit floating point to 8-bit integer), which significantly decreases memory bandwidth and computational requirements during inference. This directly lowers latency without fundamentally altering the model's learned representations, so accuracy degradation is typically minimal (often <1-2%).

Exam trap

CompTIA often tests the misconception that increasing batch size always improves latency, when in fact it increases per-request latency in real-time systems, and that simpler models are always better for latency, ignoring the critical accuracy requirement.

How to eliminate wrong answers

Option A is wrong because adding more training data improves model robustness and generalization but does not reduce inference latency; it may even increase training time and model complexity. Option B is wrong because replacing a deep learning model with a logistic regression model would drastically reduce accuracy for complex image classification tasks, failing the 'without significantly impacting accuracy' constraint. Option C is wrong because increasing batch size for inference increases the number of images processed per batch, which can improve throughput but actually increases per-request latency (time to first prediction) and may exceed the 100ms SLA for real-time applications.

Practice this question →

40

MCQmedium

A company uses an AI model to predict equipment failures. The model outputs a probability of failure. To minimize false alarms, the operations team wants a high precision. Which deployment strategy should they implement?

A.Retrain the model on more recent data

B.Increase the decision threshold for positive classification

C.Decrease the decision threshold

D.Use an ensemble of models with voting

AnswerB

Raising the decision threshold means predictions are labelled positive only when probability exceeds a higher value, reducing false positives and therefore increasing precision, which directly minimises the false alarms the operations team wants to avoid.

Why this answer

To minimize false alarms and achieve high precision, the operations team should increase the decision threshold for positive classification. A higher threshold means the model only predicts a failure when it is very confident, reducing the number of false positives (false alarms) at the cost of potentially missing some true failures (lower recall). This directly controls the precision-recall trade-off without changing the underlying model.

Exam trap

CompTIA often tests the precision-recall trade-off by making candidates confuse increasing the threshold (which improves precision) with decreasing it (which improves recall), or by suggesting retraining or ensemble methods as direct solutions for precision tuning.

How to eliminate wrong answers

Option A is wrong because retraining on more recent data improves model accuracy and relevance but does not directly control the precision-recall trade-off; it may not reduce false alarms if the model's calibration remains unchanged. Option C is wrong because decreasing the decision threshold would make the model more sensitive, increasing the number of positive predictions and thus increasing false alarms (lower precision), which is the opposite of the goal. Option D is wrong because using an ensemble of models with voting can improve overall accuracy and robustness, but it does not specifically target precision; the voting mechanism may still produce many false positives unless the threshold is also adjusted.

Practice this question →

41

MCQhard

An ML engineering team has a retraining pipeline that triggers automatically when model accuracy drops below a threshold. Recently, the model's accuracy has been fluctuating, causing frequent retraining and high compute costs. The team suspects the data distribution is changing slowly. Which approach should the team implement to reduce unnecessary retraining while maintaining model performance?

A.Use a simpler model to reduce variability

B.Implement a statistical drift detection method on input features

C.Increase the frequency of model retraining

D.Reduce the batch size for inference

AnswerB

Statistical drift detection on input features distinguishes genuine slow distributional change from normal accuracy noise, triggering retraining only when drift is confirmed. This satisfies the constraint of cutting unnecessary retraining and compute cost while preserving performance.

Why this answer

Implementing a statistical drift detection method (e.g., using KL divergence, PSI, or ADWIN) on input features allows the team to identify when the data distribution has genuinely changed, rather than reacting to random accuracy fluctuations. This reduces unnecessary retraining by triggering the pipeline only when statistically significant drift is detected, maintaining model performance without the high compute costs of frequent retraining.

Exam trap

CompTIA often tests the misconception that increasing retraining frequency or simplifying the model can solve drift-related issues, but the correct approach is to detect drift statistically before deciding to retrain.

How to eliminate wrong answers

Option A is wrong because using a simpler model may reduce variability but does not address the root cause of distribution drift; it could also degrade performance by underfitting the true underlying patterns. Option C is wrong because increasing retraining frequency would exacerbate the compute cost problem and may overfit to transient fluctuations, not solve the issue of unnecessary retraining. Option D is wrong because reducing the batch size for inference affects throughput and latency, not the detection of data distribution changes or the decision to retrain.

Practice this question →

42

Multi-Selectmedium

A machine learning engineer is deploying a model to production. Which TWO practices are essential for ensuring reproducibility of model predictions?

Select 2 answers

A.Increase the number of training epochs to ensure convergence.

B.Use the same GPU hardware for both training and inference.

C.Use parallel data loading to speed up inference.

D.Version-control the model artifact (e.g., using MLflow or DVC).

E.Fix random seeds for all libraries (e.g., NumPy, TensorFlow).

AnswersD, E

Predictions are reproducible only when the exact trained weights are retrievable, so storing the model artefact in a versioned registry such as MLflow or DVC pins the serialised parameters, preprocessing state and framework version to a specific revision, letting any run reload the identical model.

Why this answer

Option D is correct because version-controlling the model artifact with tools like MLflow or DVC ensures that the exact trained weights, hyperparameters, and code revision used in production can be retrieved and audited, which is fundamental to reproducing identical predictions. Option E is correct because fixing random seeds across all libraries (e.g., NumPy, TensorFlow, and Python's random module) eliminates nondeterminism in weight initialization, data shuffling, and dropout, so the same inputs yield the same outputs. Option A is not essential for reproducibility since more epochs change the model rather than guarantee deterministic, repeatable predictions.

Option B is unnecessary because reproducibility depends on deterministic software and versioned artifacts, not on identical GPU hardware, and inference can run on different accelerators. Option C is also irrelevant because parallel data loading affects throughput and latency, not the determinism or reproducibility of the model's predictions.

Exam trap

CompTIA often tests the misconception that hardware consistency (e.g., same GPU) is required for reproducibility, when in fact deterministic software practices (version control and seed fixing) are the critical factors.

Practice this question →

43

MCQmedium

A company is deploying a fraud detection model that must return predictions within 100ms to avoid transaction delays. The team is deciding between batch and real-time inference. Which factor most strongly supports a real-time inference architecture?

A.The model requires large amounts of historical data for each prediction

B.The application requires immediate feedback for each transaction

C.The infrastructure budget is limited and must be optimized

D.The model can be retrained weekly using gathered data

AnswerB

Immediate per-transaction feedback demands synchronous scoring, which only real-time inference provides; batch processing defers predictions until a scheduled job runs, breaching the 100ms constraint. Real-time endpoints score each transaction on arrival, satisfying the latency requirement that the fraud detection scenario specifies.

Why this answer

Real-time inference is required when the application must return predictions within strict latency bounds (e.g., 100ms) to avoid transaction delays. The need for immediate feedback per transaction directly aligns with a real-time architecture, where each request is processed individually as it arrives, rather than waiting for a batch window. Batch inference would introduce unacceptable latency because it processes groups of records on a schedule, not on-demand.

Exam trap

CompTIA often tests the misconception that batch inference is always cheaper or more efficient, but the trap here is that latency requirements (under 100ms) force a real-time architecture regardless of cost or data volume.

How to eliminate wrong answers

Option A is wrong because requiring large amounts of historical data for each prediction does not dictate real-time vs. batch; it affects feature engineering and storage, not inference latency. Option C is wrong because limited infrastructure budget typically favors batch inference, which can use cheaper, less scalable resources and process data in bulk, not real-time. Option D is wrong because weekly retraining is a model update frequency concern, unrelated to the inference serving architecture; both batch and real-time systems can support periodic retraining.

Practice this question →

44

MCQeasy

Refer to the exhibit. The monitoring dashboard for a deployed churn prediction model shows a drift detected flag. However, the error rate and latency are within acceptable ranges. What is the most appropriate immediate action?

A.Trigger automatic retraining using the latest data

B.Roll back to the previous model version immediately

C.Ignore the drift since performance metrics are stable

D.Investigate the type and severity of drift before deciding

AnswerD

A drift flag alone does not indicate degraded performance, since error rate and latency remain acceptable. Investigating the drift's type and severity first establishes whether it is genuine, benign, or requires retraining, avoiding unnecessary remediation that could destabilise a currently healthy model.

Why this answer

When drift is detected but performance metrics like error rate and latency are still acceptable, it is important to investigate the type and severity of drift before taking any action. Drift may be benign or may indicate a shift that will eventually degrade performance. Option A is wrong because automatic retraining could be risky if the drift is temporary or benign.

Option B is wrong because rolling back immediately discards potential improvements and could be unnecessary. Option C is wrong because ignoring drift may lead to future degradation.

Practice this question →

45

MCQhard

A retail bank runs a batch credit-limit model that scores the entire customer base nightly. The model consumes 40 features, several of which are aggregates computed from transaction history. Downstream systems report that scores for some customers change dramatically between consecutive nights even though nothing about those customers changed. The team needs to make the nightly pipeline reproducible and explainable. Which action should the team take FIRST?

A.Capture the exact feature values and pipeline code version used for each nightly scoring run so any score can be reproduced and compared.

B.Increase the batch window so the nightly job has more time to compute the aggregate features.

C.Add a post-processing step that clamps each customer's score change to a fixed maximum per night.

D.Replace the aggregated transaction features with raw transaction counts to eliminate the variability.

AnswerA

Unexplained night-to-night swings with unchanged customer behavior usually come from nondeterministic or time-dependent feature computation. Recording the feature snapshot, pipeline code version, and parameters for every run lets the team replay a specific score and diff it against the prior night, isolating the offending aggregate. This is the prerequisite for every later fix and for regulatory explainability.

Why this answer

Score changes with no corresponding customer change indicate the feature pipeline is producing different values on different nights. Capturing a per-run feature snapshot alongside the pipeline code version makes each score reproducible, which is the only way to identify the unstable aggregate and satisfy explainability obligations before attempting any fix.

Exam trap

The trap here is jumping to a modeling or feature-engineering change when the immediate need is provenance, because without a recorded feature snapshot the anomalous scores cannot be reproduced or explained at all.

Practice this question →

46

MCQeasy

A retailer's recommendation service runs on a managed inference endpoint. During a flash sale, request volume triples and the endpoint's response time exceeds the acceptable threshold. The operations team must reduce latency quickly without retraining the model. Which action should they take first?

A.Raise the client-side request timeout so slow responses are tolerated instead of failing.

B.Increase the number of provisioned inference instances behind the endpoint so requests are distributed across more compute.

C.Lower the endpoint's logging verbosity and disable request tracing to reduce per-request overhead.

D.Retrain the model with a smaller architecture so each inference completes faster.

AnswerB

When latency rises because request volume exceeds serving capacity, adding replicas spreads the load and directly reduces queueing and response time. It requires no model change, can be applied immediately, and is reversible once the sale ends. This addresses the actual bottleneck described rather than a downstream symptom.

Why this answer

The described symptom is a capacity shortfall during a traffic spike, so the fastest effective remedy is horizontal scaling of the serving tier. Adding inference instances distributes load and cuts queueing delay without touching the model. Retraining, trimming logging, and extending timeouts either take too long or merely conceal the latency, leaving the underlying bottleneck in place.

Exam trap

The trap here is reaching for model optimization when the bottleneck is serving capacity, since latency can also stem from the model, the hardware, or the network.

Practice this question →

47

MCQeasy

A team deploys a machine learning model as a REST API. They want to monitor model drift. Which metric is MOST appropriate for detecting drift in the input data distribution?

A.Model accuracy on a recent holdout set.

B.Population stability index (PSI) comparing training and recent data.

C.F1 score on the training data.

D.Root mean squared error (RMSE) on test data.

AnswerB

PSI quantifies how much a variable's distribution has shifted between the training baseline and recent production data, which is exactly the input-distribution drift the team must detect. It is computed on features rather than predictions, unlike accuracy or label-based metrics.

Why this answer

Population stability index (PSI) is the most appropriate metric for detecting drift in input data distribution because it directly measures the shift between the training data distribution and the recent production data distribution. PSI is calculated by binning both distributions and computing the sum of (proportion in bin of recent data minus proportion in bin of training data) times the natural log of their ratio, making it sensitive to changes in feature distributions without requiring ground truth labels.

Exam trap

The trap here is that candidates often confuse performance metrics (accuracy, F1, RMSE) with distribution drift detection, not realizing that PSI specifically quantifies covariate shift without needing ground truth labels.

How to eliminate wrong answers

Option A is wrong because model accuracy on a recent holdout set measures performance degradation, not input data distribution drift; accuracy can drop due to concept drift or other factors, and it requires labeled data which may not be available in production. Option C is wrong because F1 score on the training data is a measure of model fit on historical data, not a metric for detecting changes in the input distribution of new data. Option D is wrong because root mean squared error (RMSE) on test data evaluates prediction error on a static test set, not the distributional shift between training and current production inputs.

Practice this question →

48

Multi-Selecteasy

Which TWO actions are most appropriate for managing model drift in a production AI system?

Select 2 answers

A.Freeze the model to prevent any changes

B.Roll back to a previous model version if performance degrades

C.Periodically retrain the model on recent data

D.Manually review all model predictions

E.Implement automated monitoring to detect drift indicators

AnswersC, E

Periodic retraining on recent data directly counters data drift by updating learned parameters to reflect the current input distribution, satisfying the requirement to manage drift in production. It addresses gradual distributional shift, which monitoring alone cannot correct, restoring alignment between the model's training assumptions and live data.

Why this answer

Option C is correct because periodically retraining the model on recent data directly addresses model drift by updating the model's learned parameters to reflect the current data distribution, which is the standard remediation for both data drift and concept drift in production AI systems. Option E is correct because implementing automated monitoring to detect drift indicators (such as statistical divergence in input feature distributions, changes in prediction distributions, or declining accuracy/latency metrics) provides the early-warning capability needed to trigger retraining or rollback before business impact occurs. Option A is incorrect because freezing the model prevents any adaptation and guarantees that drift will progressively degrade performance over time.

Option B, while a reasonable incident-response tactic, is not a drift management action in itself since rollback only restores a prior state that will also drift and does not address the underlying distribution change. Option D is incorrect because manually reviewing all predictions is operationally infeasible at production scale and does not systematically detect or correct drift.

Exam trap

CompTIA often tests the distinction between reactive fixes (like rollback) and proactive, automated strategies (like monitoring and retraining), tricking candidates into choosing rollback as a valid long-term drift management action.

Practice this question →

49

Multi-Selectmedium

A financial services firm has deployed an AI model for real-time credit scoring. The operations team needs to ensure the model remains reliable and compliant over time. Which TWO actions should the team prioritize? (Choose two.)

Select 2 answers

A.Implement automated monitoring for data drift and model performance metrics.

B.Deploy a model versioning system with automated rollback capabilities.

C.Establish a governance process for version-controlled model deployment and retraining.

D.Schedule monthly manual retraining of the model using historical data.

E.Generate weekly compliance reports for regulatory review.

AnswersA, C

Monitoring data drift and performance metrics is proactive and addresses the root cause of model degradation.

Why this answer

Automated monitoring for data drift and model performance metrics is essential for maintaining reliability and compliance in a real-time credit scoring system. Data drift detection (e.g., using population stability index or KL divergence) alerts the team when input distributions shift, which could degrade model accuracy and lead to non-compliant decisions. Continuous monitoring of metrics like AUC, precision, and recall ensures the model stays within regulatory thresholds without manual intervention.

Exam trap

CompTIA often tests the distinction between operational monitoring/governance actions versus reactive or administrative tasks, so candidates may mistakenly choose versioning (B) or reporting (E) instead of recognizing that continuous monitoring (A) and governance processes (C) directly address reliability and compliance over time.

Practice this question →

50

MCQmedium

A healthcare AI startup has developed a model to detect diabetic retinopathy from retinal images. The model achieved 96% sensitivity and 94% specificity on a validation set from the same distribution as the training data. After deployment in a rural clinic, the model's sensitivity drops to 80%. The data team analyzes the clinical images from the clinic and finds that the images have lower resolution and different lighting conditions compared to the training dataset. The team has the ability to collect more data from the clinic and retrain the model. What is the BEST course of action?

A.Reduce the model's complexity by removing several convolutional layers to improve generalization.

B.Apply transfer learning using a model pre-trained on a different medical imaging dataset.

C.Implement adversarial validation to identify which images are out-of-distribution and filter them out.

D.Collect additional retinal images from the rural clinic, label them, and retrain the model including the new data.

AnswerD

Retraining on labelled images from the rural clinic directly addresses the domain shift causing the sensitivity drop, since lower resolution and different lighting are represented in the new data, aligning the model with deployment conditions.

Why this answer

The performance drop is caused by a domain shift (lower resolution, different lighting) between the training and deployment data. The most direct and effective solution is to collect labeled images from the target domain (rural clinic) and retrain the model, which aligns with the principle of domain adaptation through data augmentation. This approach addresses the root cause by exposing the model to the actual distribution it will encounter in production.

Exam trap

CompTIA often tests the misconception that reducing model complexity or using generic transfer learning can fix domain shift, when in reality the most reliable solution is to retrain with data from the target deployment environment.

How to eliminate wrong answers

Option A is wrong because reducing model complexity (e.g., removing convolutional layers) would likely decrease capacity to learn domain-specific features, potentially worsening performance rather than fixing the domain shift. Option B is wrong because transfer learning from a different medical imaging dataset (e.g., X-rays or MRIs) may not help if the source domain still differs significantly from the rural clinic's retinal images; it could introduce irrelevant features or negative transfer. Option C is wrong because adversarial validation only identifies out-of-distribution samples but does not improve model performance on those samples; filtering them out would reduce the usable data and fail to address the need for the model to work on the clinic's images.

Practice this question →

51

MCQhard

An MLOps team uses a CI/CD pipeline to automate model retraining. The pipeline triggers on new labeled data, runs feature engineering, retrains the model, evaluates against a holdout set, and deploys if metrics exceed thresholds. Recently, a retrained model passed validation but caused a 5% accuracy drop in production. Which improvement best prevents this?

A.Implement canary deployment with shadow scoring to compare with current model

B.Require manual approval before deployment

C.Use the entire production dataset for validation instead of a holdout set

D.Increase the amount of training data used in each retraining cycle

AnswerA

Canary deployment with shadow scoring routes live traffic to the retrained model in parallel, comparing its predictions against the incumbent before full promotion. This catches the production accuracy drop that holdout validation missed, because the stem's failure arose from a validation-to-production gap, not from flawed training metrics.

Why this answer

Canary deployment with shadow scoring allows the new model to serve predictions to a small subset of traffic while comparing its outputs against the current production model in real time, without affecting all users. This catches subtle data drift or concept drift that a static holdout set may miss, preventing the 5% accuracy drop from reaching full production.

Exam trap

A common misconception is that more data or larger validation sets always improve model reliability. However, the trap here is that distribution drift between training/validation and live production is the real cause of accuracy drops, which only online evaluation methods like canary deployment can detect.

How to eliminate wrong answers

Option B is wrong because manual approval adds a human bottleneck and does not detect the underlying data drift or distribution mismatch that caused the accuracy drop; it only gates deployment without technical validation. Option C is wrong because using the entire production dataset for validation would include the same data the model was trained on, leading to data leakage and overoptimistic metrics that mask real-world performance. Option D is wrong because simply increasing training data volume does not address the root cause of distribution shift between the validation holdout set and live production traffic; more data may even amplify bias if the new data is not representative.

Practice this question →

52

MCQmedium

An e-commerce company uses a machine learning model to recommend products to users. The model is retrained weekly and deployed to production. For the past three weeks, the model's click-through rate (CTR) has been stable except on Mondays, when it drops by 15%. Analysis reveals that the training data is extracted on Sundays and includes only weekday behavior. On Mondays, user behavior shifts due to weekend browsing patterns not captured in the training data. The team wants to maintain a weekly retraining cadence but fix the Monday performance drop. Which solution best addresses the Monday CTR drop without changing the retraining frequency?

A.Deploy a separate model specifically for Monday predictions

B.Modify the data pipeline to include the full week (including the past weekend) in each retraining

C.Serve the previous week's model on Mondays to use older but stable patterns

D.Change to daily retraining to include weekend data more promptly

AnswerB

Including the full week, particularly the weekend, in each Sunday extraction gives the model training examples of weekend browsing behaviour, so Monday predictions reflect the shift the stem describes. Retraining cadence stays weekly, satisfying the constraint of not changing retraining frequency.

Why this answer

It directly addresses the root cause: the training data excludes weekend behavior, causing the model to be blind to Monday patterns. By modifying the data pipeline to include the full week (including the past weekend) in each retraining, the model learns from weekend browsing patterns and can generalize to Monday user behavior without changing the weekly retraining cadence. This ensures the training distribution matches the inference distribution on Mondays, stabilizing CTR.

Exam trap

CompTIA often tests the misconception that changing retraining frequency (Option D) is the only way to incorporate new data, when in fact adjusting the data window within the existing cadence (Option B) is a more efficient and correct solution.

How to eliminate wrong answers

Option A is wrong because deploying a separate model for Monday predictions introduces operational complexity and does not fix the data gap; it merely treats the symptom by creating a specialized model that still lacks weekend data unless separately trained. Option C is wrong because serving the previous week's model on Mondays would use older patterns that also exclude the most recent weekend behavior, and the model would be even more stale, likely worsening the drop. Option D is wrong because changing to daily retraining alters the retraining frequency, which the team explicitly wants to maintain; it also adds unnecessary overhead and does not address the fact that the training data extraction point (Sundays) is the core issue.

Practice this question →

53

MCQhard

An AI operations team is designing a rollback strategy for a fraud-detection model served behind a feature flag. A new model version shows degraded precision after release. The team wants to restore the previous behavior within minutes without redeploying code or losing the ability to collect data on the new version. Which approach best meets these requirements?

A.Route traffic back to the prior model version by toggling the feature flag, while continuing shadow-mode evaluation of the new version

B.Lower the model's decision threshold so fewer transactions are flagged as fraudulent

C.Keep the new model live and immediately retrain it on the most recent labeled fraud cases

D.Rebuild the container image with the prior model artifact and redeploy through the CI/CD pipeline

AnswerA

Feature flags decouple model selection from code deployment, so toggling the flag instantly shifts live traffic to the previous artifact. Running the new version in shadow mode preserves data collection and evaluation without exposing customers to degraded precision, satisfying both the fast-rollback and continued-learning requirements without a redeploy.

Why this answer

A feature flag allows instant switching between model versions without touching application code, and shadow mode lets the suspect version keep receiving copied traffic for evaluation while customers are served by the proven model. Redeployment is too slow, threshold tuning does not restore validated behavior, and retraining cannot act within minutes while labels accumulate.

Exam trap

The trap here is equating rollback with redeploying a previous container image, when a feature flag can redirect live traffic in seconds with no code deployment at all.

Practice this question →

54

MCQmedium

A healthcare AI system that diagnoses medical images must provide explanations for its predictions to comply with regulatory requirements. Which technique should the team implement?

A.Reduce the model's accuracy to make it simpler.

B.Only deploy rule-based systems.

C.Apply model interpretability methods such as SHAP or LIME.

D.Use a more complex deep learning model.

AnswerC

SHAP and LIME are post-hoc interpretability techniques that attribute a model's output to individual input features, generating per-prediction explanations. This satisfies the regulatory requirement for transparent, auditable diagnostic reasoning without retraining, unlike inherently opaque deep networks or purely performance-focused methods.

Why this answer

SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-agnostic Explanations) are established model interpretability techniques that provide per-prediction explanations, which are essential for regulatory compliance in healthcare AI. These methods generate feature attribution scores or local surrogate models to explain why a specific diagnosis was made, meeting transparency requirements without sacrificing model performance.

Exam trap

The trap here is that candidates often assume complex models are inherently better for compliance, but the exam tests the understanding that interpretability techniques are required to bridge the gap between high-performance black-box models and regulatory transparency.

How to eliminate wrong answers

Option A is wrong because reducing model accuracy to make it simpler would degrade diagnostic performance and still not guarantee interpretability; a simpler model is not inherently explainable in a regulatory sense. Option B is wrong because only deploying rule-based systems is overly restrictive and impractical for complex medical image analysis, where deep learning models often achieve superior accuracy; rule-based systems may also lack the flexibility to handle edge cases. Option D is wrong because using a more complex deep learning model typically reduces interpretability, making it harder to provide the required explanations, and does not address regulatory compliance.

Practice this question →

55

MCQeasy

A logistics company wants to detect packages damaged in transit by analyzing photos taken at warehouse checkpoints. The team has only about 200 labeled examples of damaged packages but tens of thousands of photos of undamaged ones. They need a working classifier quickly and cannot collect more damaged-package images in the near term. Which approach should the team use?

A.Fine-tune a pretrained vision model on the labeled images and address the class imbalance with techniques such as class weighting or data augmentation.

B.Collect at least 50,000 additional damaged-package images before training any model.

C.Train a convolutional neural network from scratch on the 200 damaged-package images until training accuracy reaches 100 percent.

D.Deploy a rule-based image comparison that flags any photo differing from the warehouse's average undamaged package appearance.

AnswerA

Fine-tuning a pretrained vision model transfers general visual features learned from large datasets, so it can achieve useful accuracy with only a few hundred damaged-package examples. Combining this with class weighting or augmentation for the rare damaged class directly addresses the imbalance and delivers a working classifier quickly without waiting for more labeled damage images.

Why this answer

With only a few hundred damaged-package examples against many undamaged ones, transfer learning is the practical path: fine-tuning a pretrained vision model leverages general visual features and works with small labeled sets, while class weighting or augmentation handles the imbalance. Training from scratch overfits, waiting for more data violates the timeline, and rule-based comparison cannot reliably distinguish damage from normal variation.

Exam trap

The trap here is assuming that a deep network trained from scratch is the default solution, when a small, imbalanced labeled set makes transfer learning from a pretrained model the appropriate choice.

Practice this question →

56

MCQeasy

An operations team is preparing to deploy a new AI inference service. Security leadership requires that all data in transit between the application and the model endpoint be encrypted and that clients be authenticated before they can submit inference requests. Which combination of controls should the team implement?

A.Network segmentation of the inference subnet and IP allowlisting of known clients

B.A web application firewall and rate limiting on the inference endpoint

C.TLS for transport encryption and API keys or OAuth tokens for client authentication

D.AES-256 encryption of the model weights at rest and role-based access control on the model registry

AnswerC

TLS encrypts data in transit between clients and the inference endpoint, and API keys or OAuth tokens verify client identity before requests are processed. Together they satisfy both the encryption-in-transit and authenticated-access requirements, and they are standard controls for exposing any AI inference API to internal or external consumers.

Why this answer

The requirement has two distinct parts: confidentiality of data in transit and verification of client identity. TLS provides the former by encrypting the connection, while API keys or OAuth tokens provide the latter by proving the caller is authorized. Controls that protect stored weights, filter traffic, or restrict network ranges address other risks and do not deliver both required properties.

Exam trap

The trap here is treating network-level protections such as firewalls or IP allowlists as equivalent to transport encryption and cryptographic client authentication.

Practice this question →

57

MCQeasy

A startup has developed a natural language processing model for sentiment analysis. Their CI/CD pipeline includes a step that runs unit tests on the model's output format and a validation step that checks accuracy on a static test dataset. Recently, the pipeline often fails during the validation step, but the failures are inconsistent—sometimes the same model version passes, sometimes fails. The team suspects the test dataset is small and randomly sampled. They need a reliable validation process to deploy models with confidence. Which approach should the team implement?

A.Replace the static test set with k-fold cross-validation in each pipeline run

B.Increase the accuracy threshold to 95% so only very good models pass

C.Remove the validation step and rely on unit tests only

D.Fix the test dataset to be larger and more representative, and use a statistical test to compare against baseline

AnswerD

A fixed, larger and representative dataset removes the random sampling variance causing inconsistent pass/fail results, while a statistical test against the baseline distinguishes genuine regressions from noise, satisfying the need for reliable, repeatable validation before deployment.

Why this answer

The core issue is that the static test dataset is too small and randomly sampled, leading to inconsistent validation results. By fixing the dataset to be larger and more representative, and using a statistical test (e.g., a paired t-test or McNemar's test) to compare the model's accuracy against a baseline, the team can reliably determine if performance changes are statistically significant, eliminating the randomness that causes pipeline failures to be inconsistent.

Exam trap

CompTIA often tests the misconception that increasing the accuracy threshold or using cross-validation alone can fix validation instability, when the real solution is to address the root cause of small, non-representative test data with statistical rigor.

How to eliminate wrong answers

Option A is wrong because k-fold cross-validation is computationally expensive and time-consuming for a CI/CD pipeline, and it does not directly address the root cause of a small, randomly sampled test set; it would still suffer from variance if the dataset is small. Option B is wrong because simply raising the accuracy threshold to 95% does not fix the underlying inconsistency from a small test set; it may cause even more frequent failures due to random sampling noise, and it does not provide a statistical basis for decision-making. Option C is wrong because removing the validation step entirely would allow models with poor accuracy to be deployed, undermining the goal of deploying with confidence; unit tests alone cannot assess model performance.

Practice this question →

58

MCQeasy

A model serving endpoint is tested using curl commands. Based on the exhibit, what is the most likely issue?

A.The server is returning HTTP 500 errors

B.The input features are malformed

C.The model is experiencing intermittent high latency leading to timeouts

D.The model is not deployed on the server

AnswerC

Intermittent latency produces sporadic timeouts rather than consistent failures: some curl calls return quickly while others hang until the client aborts. This pattern distinguishes it from a persistent connection error or authentication fault, which would fail every request uniformly, matching the exhibit's mixed success and timeout responses.

Why this answer

The exhibit shows that the first curl request succeeds (HTTP 200), but subsequent requests fail with 'curl: (28) Operation timed out' after the default timeout of 30 seconds. This pattern of intermittent success followed by timeouts is characteristic of a model experiencing high latency spikes, not a persistent server error or configuration issue. The server is reachable and the model responds correctly some of the time, ruling out deployment or malformed input issues.

Exam trap

CompTIA often tests the distinction between persistent errors (like 500 or 404) and intermittent timeout failures, where candidates mistakenly attribute timeouts to server errors or input issues rather than recognizing the pattern of variable latency.

How to eliminate wrong answers

Option A is wrong because the exhibit shows HTTP 200 responses for successful requests, not HTTP 500 errors; a server returning 500 errors would consistently fail with a 5xx status code, not timeouts. Option B is wrong because the first request succeeds, proving the input features are correctly formatted and accepted by the model; malformed features would cause persistent failures across all requests. Option D is wrong because the successful first request confirms the model is deployed and serving predictions; an undeployed model would return a 404 or 503 error, not a timeout after a successful response.

Practice this question →

59

MCQhard

An ML team monitors a production model using a dashboard that shows daily performance metrics. Over the past month, the model's accuracy has dropped from 92% to 87%, while the data distribution of input features has remained stable according to statistical tests. Which type of model drift is most likely occurring?

A.Data drift (covariate shift)

B.Model decay

C.Overfitting

D.Concept drift

AnswerD

Stable input distributions rule out data drift, so the accuracy decline stems from a changed relationship between features and labels. Concept drift describes exactly this: the mapping the model learned no longer matches the real-world target, degrading performance despite unchanged inputs.

Why this answer

Concept drift occurs when the relationship between input features and the target variable changes, even if the input data distribution remains stable. In this scenario, the model's accuracy declines from 92% to 87% while input feature distributions are unchanged, indicating that the underlying mapping from features to labels has shifted—a classic sign of concept drift.

Exam trap

CompTIA often tests the distinction between data drift and concept drift by presenting a scenario where input distributions are stable but model performance degrades, leading candidates to mistakenly choose data drift (covariate shift) because they focus on the input features rather than the label relationship.

How to eliminate wrong answers

Option A is wrong because data drift (covariate shift) refers to changes in the distribution of input features, which the question explicitly states has remained stable according to statistical tests. Option B is wrong because model decay is a general term for performance degradation over time, but it is not a specific type of drift; the question asks for the type of drift, and concept drift is the precise classification. Option C is wrong because overfitting is a training-time issue where a model fits noise in the training data, leading to poor generalization on new data; it does not explain a gradual performance drop in production while input distributions remain stable.

Practice this question →

60

Multi-Selectmedium

Which TWO are best practices for deploying AI models in a containerized production environment? (Select TWO.)

Select 2 answers

A.Always pull the latest image tag for automatic updates

B.Store model artifacts inside the container image for portability

C.Use an orchestration platform like Kubernetes for scaling and health management

D.Package the model and its dependencies into a single container image

E.Configure JVM heap arguments inside the container if using Java

AnswersC, D

Kubernetes provides declarative scaling, rolling updates and liveness/readiness probes, so model containers restart automatically when unhealthy and scale with demand. This satisfies production requirements for high availability and elastic capacity that standalone containers cannot deliver.

Why this answer

Option C is correct because Kubernetes (or a similar orchestrator) provides horizontal pod autoscaling, liveness/readiness probes, and rolling updates, which are essential for reliably scaling and health-managing AI inference services in production. Option D is correct because packaging the model together with its runtime dependencies (libraries, CUDA/cuDNN versions, Python packages) into a single immutable container image guarantees reproducible, portable deployments across environments. Option A is not a best practice because pulling the 'latest' tag yields non-deterministic, unreproducible builds and can silently introduce breaking changes; images should be pinned to immutable version or digest tags.

Option B is not recommended because baking large model artifacts into the image bloats it, slows pulls, and forces a full image rebuild for every model update; models are better mounted from object storage or a model registry. Option E is not generally applicable since most AI/ML containers are Python-based rather than JVM-based, and heap tuning is workload-specific rather than a universal deployment best practice.

Exam trap

CompTIA often tests the distinction between containerization best practices (e.g., immutable images, external model storage) and generic software deployment habits (e.g., using latest tags, embedding data), so candidates mistakenly select options that seem convenient but violate production reliability principles.

Practice this question →

61

Multi-Selecthard

An AI team is preparing a fraud-detection model for production deployment. The model performs well offline, but the team must ensure the deployment is operationally safe and that problems are detected quickly after release. Which TWO practices should be implemented as part of the pre-deployment and post-deployment plan? (Choose two.)

Select 2 answers

A.Establish a shadow deployment that mirrors live traffic to the new model and compares its decisions with the incumbent without affecting customers.

B.Define alert thresholds on prediction distribution, latency, and error rate that trigger automated rollback to the previous model version.

C.Increase the model's complexity by adding more layers until offline AUC reaches 0.99.

D.Publish a model card and require the fraud operations team to acknowledge it before go-live.

E.Retrain the model weekly on the most recent fraud data regardless of any observed performance change.

AnswersA, B

Shadow deployment exposes the new model to real production traffic distributions while isolating customers from its decisions, revealing performance and latency issues that offline evaluation misses. Comparing shadow decisions with the incumbent's output surfaces disagreement patterns and edge cases, providing evidence to approve or block the release before any user impact occurs.

Why this answer

Operational safety before release is best established by shadow deployment, which tests the model on real traffic without customer impact, and rapid detection after release comes from monitored alert thresholds tied to automated rollback. Together they cover both the pre-deployment validation gap and the post-deployment recovery path. Fixed retraining cadence, complexity increases, and documentation acknowledgments do not provide either capability.

Exam trap

The trap here is choosing governance documentation like a model card as a substitute for behavioral validation and automated rollback, mistaking process artifacts for operational safeguards.

Practice this question →

62

Multi-Selecteasy

A data scientist is monitoring a deployed image classification model. Which TWO actions are best practices for detecting model drift? (Choose 2.)

Select 2 answers

A.Schedule automatic weekly retraining of the model.

B.Increase the model's complexity to improve generalization.

C.Use a holdout test set to periodically evaluate model accuracy.

D.Monitor the average prediction confidence of the model.

E.Track the distribution of input data over time.

AnswersC, E

A holdout test set provides labelled ground truth, letting the team measure accuracy decay against known-correct outputs over time. This detects concept drift that unlabelled input monitoring alone cannot confirm, satisfying the requirement to identify genuine performance degradation.

Why this answer

Option C is correct because periodically scoring the model against a fixed holdout test set gives a direct, repeatable measurement of accuracy degradation, which is the core signal of model drift. Option E is correct because tracking the distribution of input features over time (e.g., via histograms or statistical tests like KL divergence or PSI) detects data drift, which typically precedes and causes model drift. Option A is not a detection practice but a remediation action, and retraining blindly on a schedule does not identify drift.

Option B is a modeling change that may affect generalization but does nothing to detect drift in a deployed model. Option D is weaker than C and E because average prediction confidence can shift for reasons unrelated to drift and is not a reliable standalone drift indicator.

Exam trap

CompTIA often tests the distinction between detection and remediation actions, so candidates mistakenly choose retraining (Option A) as a detection method when it is actually a corrective action.

Practice this question →

63

Multi-Selectmedium

A financial services firm runs a credit-scoring AI model in production. The compliance team wants continuous assurance that the deployed model still meets performance and fairness expectations as customer behavior changes. Which TWO operational practices best support this goal? (Choose two.)

Select 2 answers

A.Scheduled monitoring of key performance metrics such as AUC, precision, and recall against recent labeled outcomes

B.Regular fairness audits comparing approval rates and error rates across protected groups

C.Retraining the model on the full historical dataset every night regardless of any detected change

D.Storing all inference requests and responses in immutable logs for later forensic analysis

E.Increasing the model's parameter count to improve its capacity to fit customer data

AnswersA, B

Tracking performance metrics on recent labeled data detects degradation as customer behavior evolves, giving the firm evidence that the deployed model still performs as validated. Because labels for credit outcomes arrive with a delay, scheduling these evaluations ensures drift is caught before it materially harms decisions, which directly supports continuous assurance.

Why this answer

Continuous assurance requires active measurement of the deployed system on two fronts: predictive performance against fresh labeled outcomes and fairness across protected groups. These two practices detect degradation as conditions change and generate evidence for compliance. Retraining without evidence, enlarging the model, or merely archiving requests do not by themselves confirm that the model remains effective and equitable.

Exam trap

The trap here is selecting logging or retraining as assurance activities, when assurance specifically requires measuring performance and fairness outcomes over time.

Practice this question →

64

MCQmedium

A retail company runs a demand-forecasting model in production. Over three weeks, the average order value of incoming transactions has risen by 40 percent because of a promotional campaign, and forecast error has grown steadily. The model was trained on twelve months of historical data with no promotion periods. Which action should the operations team take FIRST to restore forecast reliability?

A.Increase the inference batch size so the model processes more transactions per call.

B.Add a caching layer in front of the inference endpoint to reduce repeated calls.

C.Instrument input-feature drift monitoring and retrain or recalibrate the model with recent promotion-period data.

D.Lower the model's confidence threshold so more forecasts are emitted per period.

AnswerC

The promotional campaign shifted the distribution of input features away from the training distribution, which is data drift. Detecting it with feature-distribution monitoring and then retraining or recalibrating on data that includes promotion periods restores the mapping the model learned. This addresses the root cause rather than a symptom such as latency or throughput.

Why this answer

The rising average order value from the promotion changed the distribution of input features relative to the training set, which is classic data drift and explains the growing forecast error. Monitoring feature distributions detects the shift, and retraining or recalibrating with promotion-period data realigns the model with current conditions. Throughput, caching, and threshold changes do not alter the underlying statistical mismatch.

Exam trap

The trap here is assuming that a production accuracy problem must be fixed by tuning serving infrastructure or thresholds, when the evidence points to input data drift that only retraining or recalibration can correct.

Practice this question →

65

Multi-Selectmedium

Which TWO actions should be taken to ensure an AI model complies with GDPR requirements when processing personal data?

Select 2 answers

A.Limit data collection to only what is necessary for the model

B.Provide a full explanation of model predictions

C.Store all user data for a minimum of 10 years

D.Anonymize all personal data before use

E.Implement user data deletion upon request

AnswersA, E

Data minimisation is a core GDPR principle, so restricting collection to what the model genuinely needs satisfies the lawfulness and storage-limitation requirements. This directly limits the volume of personal data processed, reducing exposure and helping demonstrate accountability under the regulation.

Why this answer

Option A is correct because GDPR's data minimization principle (Article 5(1)(c)) requires that personal data be adequate, relevant, and limited to what is necessary for the purposes for which it is processed, so restricting collection to only what the model needs directly supports compliance. Option E is correct because GDPR grants data subjects the right to erasure (Article 17, the 'right to be forgotten'), so implementing user data deletion upon request is a mandatory capability for any system processing personal data. Option B is not required by GDPR, which focuses on transparency about processing purposes and logic rather than mandating a full explanation of every model prediction (that concern relates more to interpretability and AI-specific regulation).

Option C is wrong because GDPR's storage limitation principle requires data to be kept no longer than necessary, so a 10-year minimum retention period would violate the regulation. Option D is not strictly required because GDPR permits processing of personal data with a lawful basis; anonymization is one way to reduce risk but is not a universal prerequisite, and true anonymization is often impractical for model training.

Exam trap

CompTIA often tests the misconception that anonymization is always required before any AI processing of personal data, but GDPR allows processing under lawful bases without anonymization, making Option D a tempting but incorrect choice.

Practice this question →

66

MCQmedium

A data science team uses Git for version control of model code and DVC for data versioning. They want to implement a model registry to track trained models, their hyperparameters, and performance metrics. Which tool is specifically designed for this purpose and integrates with the existing workflow?

A.Apache Airflow

B.Docker

C.MLflow Model Registry

D.Kubernetes

AnswerC

MLflow Model Registry is purpose-built to track trained models, their hyperparameters and performance metrics, and it integrates directly with Git and DVC workflows. It satisfies the stem's requirement for a dedicated registry rather than a general-purpose artefact store.

Why this answer

MLflow Model Registry is specifically designed for managing model versions, tracking metadata, and integrating with Git and DVC. Apache Airflow is for workflow orchestration, not model registry. Kubernetes is for container orchestration.

Docker is for containerization.

Practice this question →

67

Multi-Selecthard

An AI operations team is monitoring a deployed image classification model. They notice a gradual increase in prediction confidence but a drop in accuracy. Which THREE actions should they take to diagnose the issue?

Select 3 answers

A.Analyze the model's calibration curve to see if confidence scores align with actual accuracy.

B.Increase the size of the training dataset by collecting more unlabeled data.

C.Compare the distribution of input features between training and recent production data.

D.Evaluate model performance on a held-out test set collected at deployment time.

E.Retrain the model immediately with the most recent data.

AnswersA, C, D

Rising confidence alongside falling accuracy signals overconfident misclassification, so plotting the calibration curve quantifies the gap between predicted probability and observed correctness. This reveals whether the model's probability outputs have drifted from true likelihoods, guiding recalibration or retraining decisions.

Why this answer

Option A is correct because a calibration curve (reliability diagram) directly compares predicted confidence against observed accuracy, revealing whether the model has become overconfident — exactly the symptom of rising confidence with falling accuracy. Option C is correct because comparing training versus production input feature distributions (e.g., via drift metrics like PSI or KL divergence) detects data drift or covariate shift that can degrade accuracy while inflating confidence. Option D is correct because evaluating on a held-out test set collected at deployment time establishes a stable baseline, distinguishing genuine model degradation from changes in the production data distribution.

Option B is not appropriate because collecting unlabeled data does not diagnose the cause and cannot be used for supervised evaluation without labels. Option E is not appropriate because immediate retraining without root-cause analysis risks masking the problem and may reinforce the drift or labeling issues causing the confidence-accuracy mismatch.

Exam trap

CompTIA often tests the distinction between diagnostic actions and corrective actions—candidates mistakenly jump to retraining (Option E) or data collection (Option B) instead of first analyzing calibration and data distribution (Options A, C, D) to identify the specific type of drift or miscalibration.

Practice this question →

68

MCQhard

A financial institution needs to integrate an AI-based credit scoring model into an existing mainframe system that processes transactions in COBOL. The model is deployed as a REST API. What is the best strategy to ensure minimal disruption and maintain data integrity?

A.Copy all transaction data to a cloud database for the model to access.

B.Use an API gateway with versioning and circuit breaker patterns.

C.Rewrite the mainframe system in Java to directly call the model.

D.Install a GPU on the mainframe to run the model natively.

AnswerB

An API gateway with versioning and circuit breakers isolates the COBOL mainframe from model changes, letting the REST API evolve without breaking existing calls. Circuit breakers halt failing requests, preventing cascading timeouts and preserving transaction data integrity during partial outages.

Why this answer

An API gateway with versioning and circuit breaker patterns allows the COBOL mainframe to call the REST API without modifying its core transaction logic. The gateway handles protocol translation, rate limiting, and failover, ensuring minimal disruption to the existing mainframe system while maintaining data integrity through transactional consistency and graceful degradation.

Exam trap

CompTIA often tests the misconception that legacy systems must be replaced or heavily modified to integrate with modern AI services, when in fact an API gateway provides a non-invasive integration layer that preserves the existing infrastructure.

How to eliminate wrong answers

Option A is wrong because copying all transaction data to a cloud database introduces latency, potential data inconsistency, and security risks, and does not address the integration between COBOL and the REST API. Option C is wrong because rewriting the mainframe system in Java is a massive, high-risk, and costly undertaking that would cause significant disruption and is unnecessary for integrating a REST API. Option D is wrong because installing a GPU on the mainframe does not enable native execution of the AI model, as mainframes lack the necessary software stack and the model is deployed as a REST API, not as a local executable.

Practice this question →

69

Multi-Selectmedium

Which TWO techniques should be considered when optimizing a deep learning model for deployment on edge devices with limited computational resources?

Select 2 answers

A.Apply adversarial training

B.Model quantization

C.Use a GPU for inference

D.Knowledge distillation

E.Increase the number of layers

AnswersB, D

Quantization reduces numerical precision of weights and activations, typically from 32-bit floats to 8-bit integers, cutting model size and memory bandwidth while accelerating inference. This directly addresses the limited computational resources of edge devices, satisfying the deployment constraint.

Why this answer

Model quantization (B) is correct because it reduces the numerical precision of weights and activations (e.g., from FP32 to INT8), shrinking model size and memory bandwidth while enabling faster integer arithmetic on resource-constrained edge hardware. Knowledge distillation (D) is correct because it trains a smaller 'student' model to mimic a larger 'teacher' model, yielding a compact network with far fewer parameters and FLOPs suitable for edge deployment. Adversarial training (A) is a robustness technique against adversarial examples and does not reduce compute or memory footprint.

Using a GPU for inference (C) increases power, cost, and hardware requirements, which is counterproductive on constrained edge devices. Increasing the number of layers (E) enlarges the model and raises computational and memory demands, the opposite of optimization.

Exam trap

CompTIA often tests the distinction between training-phase techniques (like adversarial training) and deployment-phase optimization techniques (like quantization and knowledge distillation), leading candidates to select options that improve model quality rather than reduce resource consumption.

Practice this question →

70

MCQeasy

A hospital's radiology department uses an AI model to detect lung nodules in CT scans. The model was trained on data from a specific brand of scanners and patient demographics common in Europe. Recently, the hospital acquired new scanners from a different manufacturer and started serving a more diverse patient population. Over the past month, the model's false-positive rate has increased by 15% and false-negative rate by 8%. The radiologists are losing confidence and are considering abandoning the AI tool altogether. The IT team has verified that the model inference is running correctly and the hardware is performing as expected. The data science team suspects the problem is related to the change in input data distribution. The hospital's AI operations policy requires that any model update must be validated on at least 500 recent cases before deployment. What is the BEST course of action for the AI operations team?

A.Roll back to the previous model version and restrict use of the AI tool to only European patients.

B.Collect 500 recent CT scans from the new scanners, retrain the model on a combined old and new dataset, and validate before deployment.

C.Retrain the model using the original training data but with increased regularization to avoid overfitting.

D.Adjust the model's decision threshold to reduce false positives and then monitor for two weeks.

AnswerB

Data drift from new scanners and demographics explains the degraded metrics, so retraining on a combined old and new dataset restores generalisation. Collecting 500 recent scans satisfies the policy's validation requirement, and validating before deployment confirms the fix works.

Why this answer

The model's performance degradation is likely due to data drift: the input data distribution has changed because of new scanners and a more diverse patient population. The best course is to collect recent data representative of the new distribution, retrain the model on a combined dataset (old and new), and validate on at least 500 recent cases as per policy. This addresses the root cause and ensures the model generalizes to the new data.

Exam trap

AI0-001 often tests concepts of data drift and model retraining. Candidates may choose to adjust the threshold or roll back, but the trap is not recognizing that the root cause is distribution shift, which requires retraining with new data.

How to eliminate wrong answers

Option A is wrong because rolling back and restricting use to European patients is not feasible and does not address the diverse patient population; it also abandons the AI tool for others. Option C is wrong because retraining on the original data with increased regularization does not account for the new data distribution; it may reduce overfitting but won't help with data drift. Option D is wrong because adjusting the decision threshold only trades off false positives and false negatives; it does not improve the model's underlying performance on the new data and may not meet the validation requirement.

Practice this question →

71

MCQmedium

A retail bank deploys an AI model that approves or declines small-business loan applications. Regulators require the bank to explain any adverse decision to the applicant in plain language. The model is a gradient-boosted ensemble over dozens of features, and the bank's data scientists cannot easily describe why a specific applicant was declined. Which approach best satisfies the regulatory requirement?

A.Apply a local explanation technique such as SHAP values to identify the features that most influenced the individual applicant's score and translate them into plain-language reasons.

B.Publish the model's global feature importance rankings alongside each decision notice so applicants see which factors matter most overall.

C.Replace the gradient-boosted ensemble with a single decision tree so the decision path itself can be shown to the applicant.

D.Provide applicants with the model's overall accuracy and fairness audit results to demonstrate that the system is trustworthy.

AnswerA

Local explanation methods attribute a specific prediction to its contributing features for that individual case, which is exactly what an adverse-action explanation requires. Translating the top contributing features into plain language gives applicants a faithful, case-specific reason for the decline and provides the audit trail regulators expect from a complex ensemble model.

Why this answer

Regulatory adverse-action requirements demand case-specific reasons for each declined applicant. Local explanation techniques such as SHAP values attribute an individual prediction to its contributing features, which can then be rendered in plain language. Global feature importance, aggregate audit results, and swapping in a simpler model either describe the population rather than the individual or disrupt the production system without addressing the disclosure need.

Exam trap

The trap here is conflating global model interpretability, which explains average behavior, with local explainability, which is what an individual adverse-action notice actually requires.

Practice this question →

72

MCQeasy

A small business launched a customer support chatbot powered by a pre-trained language model. The chatbot was fine-tuned on a dataset of past support tickets. For the first week, it performed well, accurately answering 85% of queries. After a routine software update that included a new version of the underlying language model library, the chatbot's accuracy dropped to 60% and it began giving nonsensical responses to some questions. The update did not change any code or configuration specific to the chatbot. The business has a backup of the previous environment. What is the MOST appropriate immediate action?

A.Retrain the chatbot on the original dataset using the new library version.

B.Add more intents to the chatbot's configuration to cover the errors.

C.Increase the model's temperature parameter to 1.5 to encourage more varied responses.

D.Roll back the software update to the previous version of the language model library.

AnswerD

The accuracy collapse began immediately after the library update, with no chatbot code or configuration changed, so the new library version is the only altered variable. Restoring the backed-up environment removes that incompatibility, returning the fine-tuned model to its prior 85% accuracy while the library issue is investigated.

Why this answer

The most appropriate immediate action is to roll back the software update to the previous version of the language model library (Option D). The accuracy drop and nonsensical responses are directly caused by the library update, which likely changed internal model behavior (e.g., tokenization, attention mechanisms, or default hyperparameters) without any code or configuration changes. Restoring the previous environment immediately resolves the issue and allows the business to investigate the library changes in a controlled manner.

Exam trap

CompTIA often tests the misconception that retraining or adjusting hyperparameters can fix a regression caused by an underlying library change, when the immediate and correct action is to roll back to the known-good environment.

How to eliminate wrong answers

Option A is wrong because retraining the chatbot on the original dataset using the new library version does not address the root cause—the library update itself may have altered model internals (e.g., tokenizer version, default parameters) that cannot be fixed by retraining alone, and retraining is time-consuming and not an immediate fix. Option B is wrong because adding more intents does not resolve the underlying model behavior change; the chatbot is producing nonsensical responses, not missing intents, so intent expansion is irrelevant to the core issue. Option C is wrong because increasing the temperature parameter to 1.5 would make responses more random and less coherent, worsening the nonsensical outputs; temperature controls output randomness, not model correctness or library compatibility.

Practice this question →

73

MCQmedium

A logistics company runs an AI route-optimization model on a cloud inference endpoint. The model receives 200 requests per second during business hours and 20 requests per second at night. The operations team wants to reduce cost without violating the 200 ms p95 latency SLA, and they observe that provisioned capacity is sized for peak load. Which approach is MOST appropriate?

A.Move the endpoint to a region with lower compute pricing and keep the same replica count.

B.Reduce the model's input feature set to lower per-request compute time.

C.Configure scheduled scaling that reduces replica count during known low-traffic windows and scales up before peak hours.

D.Switch to a serverless inference endpoint with a cold-start penalty of several seconds per invocation.

AnswerC

The traffic pattern is predictable, so scheduling replica count to match the daily curve avoids paying for peak-sized capacity overnight while pre-scaling ahead of the morning ramp preserves the p95 SLA. This is more cost-effective than reactive scaling for a deterministic pattern and avoids the cold-start latency that could breach the SLA during the morning surge.

Why this answer

When traffic follows a predictable daily curve, scheduled scaling that shrinks replicas overnight and pre-scales before the morning peak directly removes the cost of idle peak-sized capacity while protecting the latency SLA. Serverless cold starts, feature reduction, and regional relocation do not address the overprovisioning root cause and risk either SLA violations or business degradation.

Exam trap

The trap here is reaching for scale-to-zero serverless as the default cost-saving answer without checking whether cold-start latency can satisfy a strict p95 SLA.

Practice this question →

74

Multi-Selectmedium

A DevOps team is deploying a machine learning model using a CI/CD pipeline. They want to ensure the model is reproducible and traceable. Which TWO practices should they implement?

Select 2 answers

A.Version the training dataset and code using Git and DVC.

B.Manually deploy the model to production after approval.

C.Store only the final model artifact in a shared drive.

D.Use a spreadsheet to record model version numbers.

E.Package the model in a Docker container with a fixed base image.

AnswersA, E

Versioning both datasets and training code in Git and DVC pins the exact inputs and logic behind each model artefact. That linkage is what makes a training run reproducible and traceable to a specific commit and data revision.

Why this answer

Option A is correct because versioning both the training dataset and the code with Git and DVC (Data Version Control) captures the exact data and source revisions used, which is essential for reproducing and tracing a model. Option E is correct because packaging the model in a Docker container with a fixed (pinned) base image locks down the OS libraries, dependencies, and runtime environment, ensuring the model behaves identically across environments and builds. Option B is not appropriate because manual deployment after approval is error-prone and not automated or traceable, undermining CI/CD reproducibility.

Option C is wrong because storing only the final model artifact in a shared drive loses the training data, code, and environment context needed for reproducibility. Option D is wrong because a spreadsheet is a manual, non-versioned record that cannot reliably or automatically trace model versions.

Exam trap

The AI0-001 exam often tests the misconception that manual steps or simple documentation (like spreadsheets) are sufficient for traceability, when in fact automated version control and containerization are required for true reproducibility in a CI/CD pipeline.

Practice this question →

75

Multi-Selecteasy

An AI system is being implemented in a healthcare setting. Which TWO ethical considerations should be prioritized?

Select 2 answers

A.Ensuring the model does not exhibit racial or gender bias

B.Maximizing cost reduction for the hospital

C.Providing explainable predictions to doctors

D.Replacing human judgment entirely with AI

E.Using open-source models to reduce licensing costs

AnswersA, C

Bias mitigation directly addresses healthcare's duty of non-maleficence and equity: a model trained on skewed historical data can systematically underdiagnose protected groups. Auditing and correcting for racial or gender bias satisfies the ethical requirement that diagnostic benefit be distributed fairly across patient populations, preventing discriminatory clinical outcomes.

Why this answer

Option A is correct because in a healthcare AI system, ensuring the model does not exhibit racial or gender bias is a core ethical requirement: biased training data or features can produce discriminatory diagnostic or treatment recommendations that harm protected patient groups, violating fairness and equity principles in clinical care. Option C is correct because providing explainable predictions to doctors supports transparency, accountability, and informed clinical decision-making; clinicians must understand the basis of AI recommendations to validate them, obtain patient consent, and meet medical-legal and regulatory obligations. Option B is not an ethical consideration but a financial/business objective, and cost reduction does not justify compromising patient welfare.

Option D is not appropriate because replacing human judgment entirely with AI removes clinician oversight and accountability, which is ethically and legally unacceptable in healthcare. Option E is also a cost/licensing concern rather than an ethical priority, and using open-source models does not by itself address fairness, transparency, or patient safety.

Exam trap

CompTIA often tests the distinction between ethical priorities and operational or financial goals, tricking candidates into selecting cost-saving or efficiency options instead of fairness and explainability.

Practice this question →

Page 1 of 2 · 106 questions totalNext →

Ready to test yourself?

Try a timed practice session using only AI Implementation and Operations questions.

Start 20-question session