How many Troubleshooting Scenario Questions questions are on this page?

This page has 13 Troubleshooting Scenario Questions scenario questions for the AI0-001 exam, each with detailed explanations and wrong-answer analysis.

How should I approach AI0-001 scenario questions?

Read the full scenario before looking at the answer options. Identify the constraint or requirement in the scenario, then eliminate options that are generally true but wrong for this specific case. Scenario questions reward careful reading over pattern matching.

← Back to CompTIA AI+ AI0-001 questions

Scenario-based practice

Troubleshooting Scenario Questions

Practise CompTIA AI+ AI0-001 practice questions — original exam-style scenarios covering every exam domain, with detailed explanations, wrong-answer analysis, and common exam traps.

Start full practice test Read exam guide

scenario questions

AI0-001

exam code

CompTIA

vendor

Scenario guide

How to approach troubleshooting scenario questions

These questions describe a network symptom and ask you to identify the root cause or the correct fix. They appear across all certification exams and reward systematic thinking over memorisation. The best candidates follow a consistent troubleshooting framework even under time pressure.

Quick answer

Troubleshooting Scenario Questions questions test whether you can apply the concept in context, not just recognise a definition.

How the topic appears in realistic exam-style scenarios.

Which detail in the question changes the correct answer.

How to eliminate plausible but wrong options.

How to connect the question back to the wider exam objective.

Practice scenarios

Question 1hardmultiple choice

Full question →

A financial services firm deploys an AI system to screen loan applications. The model was trained on historical data that reflected biased lending practices. After deployment, a regulatory body investigates and finds that the model denies loans at a disproportionately higher rate to a protected demographic group. The firm must address this issue while maintaining compliance with fair lending laws. The Chief AI Officer proposes four possible actions. Which action is the most appropriate first step?

A
Retrain the model using a debiased dataset and implement fairness-aware algorithms, then validate with fairness metrics
This directly addresses the biased model and demonstrates a commitment to fairness.
B
Document the model's predictions and submit a report to the regulator explaining the historical dataset bias
Why wrong: Documentation is important but does not remediate the bias; the regulator expects corrective action.
C
Immediately deploy a rule-based system to manually review all denial decisions from the AI system
Why wrong: This is a temporary measure but does not solve the bias in the model itself.
D
Disclose the bias findings to all rejected applicants and offer them priority reconsideration
Why wrong: Transparency is good, but without actually fixing the model, the same bias will continue.

Full breakdown with real-world context →

Question 2hardmultiple choice

Full question →

A fraud detection model is trained on a dataset where only 0.1% of transactions are fraudulent. The model achieves 99.9% accuracy but fails to catch most frauds. Which metric should the team prioritize, and which technique could help?

A
Mean Squared Error; use L2 regularization
Why wrong: MSE is for regression; regularization does not address class imbalance.
B
F1 score; use principal component analysis
Why wrong: F1 is good but PCA reduces features, not imbalance; SMOTE is more direct.
C
Accuracy; collect more data
Why wrong: Accuracy is misleading in imbalance; more data of majority class may not help.
D
Precision-Recall AUC; use oversampling like SMOTE
Precision-Recall AUC evaluates minority class well; SMOTE generates synthetic samples.

Full breakdown with real-world context →

Question 3easymultiple choice

Full question →

A data scientist is building a binary classification model to predict customer churn. The dataset has 10,000 samples with 80% non-churn and 20% churn. The model achieves 95% accuracy but fails to identify churners correctly. Which metric should the scientist focus on to evaluate model performance properly?

A
Precision
Why wrong: Precision measures accuracy of positive predictions, but the priority is catching actual churners.
B
F1-score
Why wrong: F1-score is a harmonic mean of precision and recall, but recall alone is more appropriate here.
C
Recall (TPR)
Recall focuses on identifying positive cases, which is the main objective.
D
Specificity
Why wrong: Specificity measures true negative rate, not relevant for identifying churners.

Full breakdown with real-world context →

Question 4mediummultiple choice

Full question →

A self-driving car company uses a reinforcement learning agent to navigate. The agent was trained in a simulated environment and achieved high rewards. When deployed in the real world, the agent fails to avoid obstacles. The team collects real-world driving data and uses it to fine-tune the model. However, fine-tuning leads to catastrophic forgetting of the simulated knowledge. Which technique should the team use to mitigate this? A. Increase the learning rate during fine-tuning. B. Use elastic weight consolidation (EWC) to regularize important weights. C. Train the model from scratch using only real-world data. D. Increase the number of layers in the network.

A
Increase the number of layers in the network.
Why wrong: Adding layers does not address catastrophic forgetting; it may even introduce more parameters that can overwrite previous knowledge.
B
Use elastic weight consolidation (EWC) to regularize important weights.
EWC selectively slows down learning on important weights for previous tasks, preserving simulated knowledge.
C
Train the model from scratch using only real-world data.
Why wrong: This discards all simulation knowledge, which is wasteful and may lead to poor performance due to limited real data.
D
Increase the learning rate during fine-tuning.
Why wrong: A higher learning rate would cause larger weight updates, accelerating forgetting.

Full breakdown with real-world context →

Question 5mediummultiple choice

Full question →

Refer to the exhibit. A team created an access policy for a fraud detection model endpoint. An intern reports being unable to access the model for testing. Reviewing the policy, what is the most likely cause?

Exhibit

Refer to the exhibit.

```json
{
  "model_policy": {
    "model": "fraud-detection-v3",
    "allowed_roles": ["data_scientist", "ml_engineer"],
    "denied_roles": ["intern"],
    "endpoint": "/api/v1/predict"
  }
}
```

A
The intern's role is not included in the allowed roles
Why wrong: That alone wouldn't cause denial if not explicitly denied.
B
The policy JSON has a syntax error
Why wrong: The JSON is valid.
C
The endpoint path is incorrect
Why wrong: Exhibit shows correct path.
D
The intern's role is explicitly denied in the policy
Denied roles override any allowed list.

Full breakdown with real-world context →

Question 6mediummultiple choice

Full question →

While training a deep neural network, the loss function fails to converge and oscillates wildly. Which adjustment is most likely to stabilize training?

A
Increase the number of hidden layers
Why wrong: More layers increase complexity and may worsen oscillations.
B
Decrease the batch size
Why wrong: Smaller batch sizes introduce more noise, which can increase oscillations.
C
Reduce the learning rate
Lower learning rate reduces step size, stabilizing training.
D
Use a test set
Why wrong: Test set is for evaluation, not for training stability.

Full breakdown with real-world context →

Question 7easymultiple choice

Full question →

A company deploys an AI model to predict equipment failure. The model performs well on historical data but fails to generalize to new data from a different factory. Which concept best describes this issue?

A
Transfer learning
Why wrong: Transfer learning is a technique, not a problem description.
B
Underfitting
Why wrong: Underfitting would show poor performance even on training data.
C
Overfitting
The model fits training data too closely and fails on new data.
D
Bias-variance tradeoff
Why wrong: This describes the balance but not the specific failure to generalize.

Full breakdown with real-world context →

Question 8hardmultiple choice

Full question →

A self-driving car company is testing an AI model for pedestrian detection. During simulation, the model fails to detect pedestrians in low-light conditions. The safety team wants to improve robustness without retraining the entire model from scratch. Which approach is most appropriate?

A
Replace the convolutional layers with transformer layers to improve attention.
Why wrong: Changing architecture typically requires full retraining and may not address low-light specifically.
B
Apply data augmentation techniques to simulate low-light conditions in the training dataset.
Data augmentation can expand the training data to include low-light scenarios, improving robustness without full retraining.
C
Use adversarial training to add imperceptible perturbations to training images.
Why wrong: Adversarial training improves resistance to malicious perturbations but not necessarily to natural low-light conditions.
D
Increase the model's depth by adding more convolutional layers.
Why wrong: Increasing depth changes architecture and requires retraining; it may not directly address low-light performance.

Full breakdown with real-world context →

Question 9mediummultiple choice

Full question →

A hospital deploys an AI system to detect pneumonia from chest X-rays. The model achieves 95% accuracy on the test set but later is found to be less accurate for patients under 18. The development team suspects bias. Which step should be taken first to investigate?

A
Automatically retrain the model with a balanced dataset including more pediatric cases.
Why wrong: Retraining without confirming the cause may not solve the problem and could introduce other issues.
B
Expand the test set with more pediatric X-rays and re-evaluate overall accuracy.
Why wrong: Overall accuracy may still hide subgroup disparities; need stratified analysis.
C
Compute and compare performance metrics for different age subgroups in the test set.
Subgroup analysis is the standard first step in fairness auditing.
D
Add more features to the model to capture age-related anatomical differences.
Why wrong: Feature engineering might help but is not the first diagnostic step.

Full breakdown with real-world context →

Question 10hardmultiple choice

Full question →

A machine learning engineer is troubleshooting a recurrent neural network that fails to learn long-range dependencies in sequential data. The gradients are computed using backpropagation through time. Which phenomenon is most likely occurring, and what architectural change would best address it?

A
Underfitting; increase the number of time steps
Why wrong: Increasing time steps can worsen vanishing gradients and does not address the core issue.
B
Vanishing gradients; use LSTM or GRU units
Vanishing gradients prevent learning long-range patterns; LSTMs and GRUs have gating mechanisms to preserve gradients.
C
Exploding gradients; apply gradient clipping
Why wrong: Exploding gradients cause large updates, but do not specifically hinder long-range dependencies; vanishing gradients are the typical culprit.
D
Overfitting; reduce the number of layers
Why wrong: Overfitting is not indicated; the model fails to learn, not memorize.

Full breakdown with real-world context →

Question 11mediummultiple choice

Full question →

A financial institution uses a machine learning model to approve personal loans. The model was trained on historical data that includes applicant age, income, credit score, and loan amount. Compliance officers have received customer complaints suggesting the model may be discriminating against applicants over 60 years old. Initial analysis shows that the approval rate for applicants over 60 is 20 percentage points lower than for younger applicants with similar credit profiles. The data science team has been asked to investigate and remediate any bias. They have access to the training data, model coefficients, and can retrain or modify the model. What is the FIRST step the team should take?

A
Replace the model with a third-party vendor model that claims to be bias-free.
Why wrong: Switching vendors does not ensure fairness and may introduce new issues; audit first.
B
Re-sample the training data to have equal numbers of applicants over and under 60.
Why wrong: Re-sampling without bias assessment may not address the root cause and could hurt model performance.
C
Conduct a fairness audit using appropriate metrics such as disparate impact ratio on the current model.
An audit quantifies bias and provides a baseline to measure remediation effectiveness.
D
Remove the age feature from the training data and retrain the model.
Why wrong: Other features may correlate with age, so removal alone may not eliminate bias; also lacks measurement.

Full breakdown with real-world context →

Question 12hardmultiple choice

Full question →

An e-commerce company deploys a recommendation system using collaborative filtering. After launch, the system shows high accuracy for popular items but fails to recommend niche products to users who would likely buy them. Which technique should the team implement to improve recommendations for long-tail items?

A
Apply matrix factorization with higher latent factors
Why wrong: Matrix factorization still depends on interaction data and may not capture niche item features.
B
Switch to a hybrid filtering approach that incorporates item metadata
Hybrid filtering uses item features to recommend niche items even with sparse interaction data.
C
Increase the weight of popular items in the recommendation score
Why wrong: This would further bias toward popular items and worsen the long-tail problem.
D
Collect more user interaction data over time
Why wrong: More data won't help if niche items inherently have few interactions.

Full breakdown with real-world context →

Question 13easymultiple choice

Full question →

A data scientist is training a binary classification model to detect fraudulent transactions. The dataset has 99% legitimate transactions and 1% fraudulent. The model achieves 99% accuracy but fails to catch most fraud. Which metric should the team prioritize to evaluate model performance?

A
F1 score
Why wrong: F1 balances precision and recall, but recall alone is more appropriate when missing fraud is costly.
B
Precision
Why wrong: Precision focuses on false positives, not on catching fraud.
C
Accuracy
Why wrong: Accuracy is misleading on imbalanced datasets.
D
Recall
Recall measures the ability to catch fraudulent transactions, which is the primary goal.

Full breakdown with real-world context →

These AI0-001 practice questions are part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style AI0-001 questions with detailed explanations, topic-based practice, mock exams, readiness tracking, and study analytics.

Troubleshooting Scenario Questions

How to approach troubleshooting scenario questions

Quick answer

Related AI0-001 topic practice pages

AI Infrastructure and Technologies practice questions

AI Security practice questions

AI Concepts and Foundations practice questions

AI Concepts and Techniques practice questions

Machine Learning and Deep Learning practice questions

AI Models and Data Engineering practice questions

Implementing AI Solutions practice questions

AI Implementation and Operations practice questions

AI Security, Ethics and Governance practice questions

AI Governance and Ethics practice questions

CompTIA A+ hardware practice questions

CompTIA A+ mobile devices practice questions

Practice scenarios

A fraud detection model is trained on a dataset where only 0.1% of transactions are fraudulent. The model achieves 99.9% accuracy but fails to catch most frauds. Which metric should the team prioritize, and which technique could help?

Refer to the exhibit. A team created an access policy for a fraud detection model endpoint. An intern reports being unable to access the model for testing. Reviewing the policy, what is the most likely cause?

Exhibit

While training a deep neural network, the loss function fails to converge and oscillates wildly. Which adjustment is most likely to stabilize training?

A company deploys an AI model to predict equipment failure. The model performs well on historical data but fails to generalize to new data from a different factory. Which concept best describes this issue?

A self-driving car company is testing an AI model for pedestrian detection. During simulation, the model fails to detect pedestrians in low-light conditions. The safety team wants to improve robustness without retraining the entire model from scratch. Which approach is most appropriate?

A hospital deploys an AI system to detect pneumonia from chest X-rays. The model achieves 95% accuracy on the test set but later is found to be less accurate for patients under 18. The development team suspects bias. Which step should be taken first to investigate?

A machine learning engineer is troubleshooting a recurrent neural network that fails to learn long-range dependencies in sequential data. The gradients are computed using backpropagation through time. Which phenomenon is most likely occurring, and what architectural change would best address it?

A data scientist is training a binary classification model to detect fraudulent transactions. The dataset has 99% legitimate transactions and 1% fraudulent. The model achieves 99% accuracy but fails to catch most fraud. Which metric should the team prioritize to evaluate model performance?