AI0-001 Practice Exam 51 — 20 Questions

Question 1

A financial institution needs to integrate an AI-based credit scoring model into an existing mainframe system that processes transactions in COBOL. The model is deployed as a REST API. What is the best strategy to ensure minimal disruption and maintain data integrity?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Use an API gateway with versioning and circuit breaker patterns.. An API gateway with versioning and circuit breaker patterns allows the COBOL mainframe to call the REST API without modifying its core transaction logic. The gateway handles protocol translation, rate limiting, and failover, ensuring minimal disruption to the existing mainframe system while maintaining data integrity through transactional consistency and graceful degradation.

Answer

Copy all transaction data to a cloud database for the model to access.

Answer

Rewrite the mainframe system in Java to directly call the model.

Answer

Install a GPU on the mainframe to run the model natively.

Question 2

A deep learning model for image classification is overfitting due to a small dataset. The team decides to apply data augmentation. Which augmentation technique is least likely to preserve the label?

Accepted Answer

Random cropping and rescaling. Random cropping and rescaling is least likely to preserve the label because it can cut out the primary object or distort its proportions, potentially removing the discriminative features needed for correct classification. For example, cropping a dog image to show only the background or a leg could change the semantic meaning, making the label 'dog' incorrect. In contrast, other techniques like noise, rotation, or flipping typically retain the core subject and its label.

Answer

Adding random noise

Answer

Random rotation

Answer

Horizontal flip

Question 3

An AI system used for resume screening is found to consistently rank male candidates higher than female candidates with similar qualifications. The HR director wants to remediate this bias without significantly reducing model accuracy. Which technique should be applied?

Accepted Answer

Apply adversarial debiasing to the model during training.. Adversarial debiasing is the correct technique because it directly addresses bias during training by introducing an adversarial network that attempts to predict the protected attribute (e.g., gender) from the model's predictions. The main model is trained to maximize accuracy while minimizing the adversary's ability to infer the protected attribute, thereby reducing bias without a significant drop in predictive performance. This approach is more effective than simple feature removal or data collection because it actively learns to remove correlations between the protected attribute and the output.

Answer

Use a random selection of candidates to avoid bias.

Answer

Remove the gender feature from the dataset and retrain.

Answer

Collect more training data from underrepresented groups.

Question 4

Refer to the exhibit. A data scientist reviews the MLflow run for a Random Forest model on customer churn data. What is the most likely issue with this model?

Accepted Answer

The model is overfitting because there is a large gap between train and validation accuracy.. A large gap between training accuracy (e.g., 0.99) and validation accuracy (e.g., 0.82) indicates that the Random Forest model has memorized the training data but fails to generalize to unseen validation data. This is the classic symptom of overfitting, where the model captures noise rather than the underlying pattern. In MLflow, comparing train and validation metrics directly reveals this discrepancy.

Answer

The model is underfitting because training accuracy is too high.

Answer

The model is performing well because validation accuracy is above 0.8.

Answer

The model has a data leak because dataset version is v2.

Question 5

A machine learning team is deploying a model that predicts customer churn. They notice that the model's predictions are highly sensitive to small changes in input features, leading to inconsistent outputs. Which technique should the team apply to improve model stability?

Accepted Answer

Regularization. Regularization (Option C) is the correct technique because it adds a penalty term to the loss function (e.g., L1 or L2 regularization), which constrains the model's weights. This reduces variance and prevents overfitting to noise in the training data, directly addressing the high sensitivity to small input changes (brittleness). By shrinking coefficients, regularization forces the model to learn more general patterns, improving stability and consistency in predictions.

Answer

Increase learning rate

Answer

Feature scaling

Answer

Cross-validation

Question 6

An organization deploys an AI model on edge devices for real-time image classification. Which metric is most important to monitor for ensuring the device's operational health?

Accepted Answer

Inference memory consumption. For edge devices with limited resources, inference memory consumption is the most critical operational health metric because exceeding available memory can cause the model to crash or the device to become unresponsive. Unlike accuracy or confidence, memory usage directly reflects whether the device can sustain real-time inference without resource exhaustion.

Answer

Model calibration error

Answer

Average prediction confidence

Answer

Model accuracy on local test data

Question 7

Based on the exhibit, what is the most likely issue with the trained model?

Accepted Answer

Overfitting because training accuracy is much higher than validation accuracy. The exhibit shows a significant gap between high training accuracy and lower validation accuracy, which is the classic symptom of overfitting. The model has memorized the training data rather than learning generalizable patterns, leading to poor performance on unseen validation data.

Answer

Data leakage artificially inflating training accuracy

Answer

Vanishing gradients causing no learning

Answer

Underfitting due to insufficient epochs

Question 8

A security engineer is implementing defenses against membership inference attacks on a classification model. Which TWO techniques are most effective? (Select TWO.)

Accepted Answer

Differential privacy. Differential privacy (C) is effective against membership inference attacks because it adds calibrated noise to the training process or model outputs, ensuring that the model's behavior does not significantly change whether any individual data point is included. This bounds the attacker's ability to distinguish between members and non-members of the training set, directly mitigating the core vulnerability exploited by membership inference.

Answer

Data augmentation

Answer

Homomorphic encryption

Answer

Increasing model size

Question 9

A company is deploying a machine learning model to predict customer churn. The dataset is highly imbalanced (95% non-churn, 5% churn). The model achieves 96% accuracy, but the F1-score for the churn class is only 0.2. Which metric should the team prioritize to evaluate model performance for this business problem?

Accepted Answer

F1-score. In a highly imbalanced dataset (95% non-churn, 5% churn), accuracy is misleading because a model can achieve 96% accuracy by simply predicting the majority class for all instances. The F1-score, which is the harmonic mean of precision and recall, specifically measures the model's performance on the minority (churn) class. A low F1-score of 0.2 indicates the model fails to correctly identify churners, which is the critical business outcome, making F1-score the correct metric to prioritize.

Answer

Accuracy

Answer

Log loss

Answer

AUC-ROC

Question 10

A financial institution uses a deep learning model for fraud detection. The model is a feedforward neural network with three hidden layers. It was trained on a balanced dataset of 100,000 transactions. During deployment, the model achieves high accuracy on the test set but the fraud detection rate (true positive rate) is only 40% while the false positive rate is 0.1%. The business requires a true positive rate of at least 80%. Which of the following actions is most likely to achieve the required true positive rate while minimizing the increase in false positives?

Accepted Answer

Change the threshold for classifying a transaction as fraud from the default 0.5 to a lower value. (increase hidden layers) may capture more complexity but does not directly increase TPR and could overfit. Option B (SMOTE) rebalances the training set, but the dataset is already balanced, so this is unlikely to improve TPR. Option D (L2 regularization) reduces overfitting but increases bias, which could lower TPR. Option C (change threshold) is the most direct approach: lowering the classification threshold increases the true positive rate, and by tuning, it can achieve 80% TPR with a minimal increase in false positives.

Answer

Increase the number of hidden layers to five to capture more complex patterns

Answer

Use synthetic minority oversampling (SMOTE) to rebalance the training set

Answer

Add L2 regularization to reduce overfitting

Question 11

Based on the exhibit, what is the likely problem with the model?

Accepted Answer

Overfitting. The exhibit shows training loss decreasing to near zero while validation loss increases after a certain point, which is a classic sign of overfitting. The model is memorizing the training data rather than learning generalizable patterns, leading to poor performance on unseen data.

Answer

Batch size too small

Answer

Learning rate too high

Answer

Underfitting

Question 12

An organization uses a batch prediction pipeline that processes daily customer data to generate marketing recommendations. One month after deployment, the model's performance degrades significantly. The data pipeline logs show that the input data schema has changed — a new categorical feature 'customer_segment' has been added, and the existing feature 'age_group' is now missing. Which step should the operations team take first?

Accepted Answer

Update the data preprocessing pipeline to handle missing features and add the new feature. The immediate priority is to ensure the data preprocessing pipeline can handle the schema change without breaking. The pipeline must gracefully handle the missing 'age_group' feature (e.g., by imputing or dropping it) and incorporate the new 'customer_segment' feature before any model retraining or rollback. This prevents data drift from causing inference errors and maintains pipeline stability.

Answer

Retrain the model using the new schema and redeploy

Answer

Revert to the previous week's model version that was performing well

Answer

Contact the data engineering team to revert the schema change

Question 13

A data scientist is using an ensemble method to combine multiple models. Which three statements about bagging (Bootstrap Aggregating) are true? (Select THREE.)

Accepted Answer

It reduces variance without increasing bias. Bagging reduces variance by training models on different bootstrap samples of the data and averaging their predictions. Since each model is trained independently on a random sample with replacement, the ensemble's variance decreases without introducing additional bias, as the expected prediction remains unbiased. This is a key property that distinguishes bagging from boosting, which reduces both bias and variance.

Answer

It requires the base models to be of different types

Answer

It reduces the error by combining weak learners

Question 14

An engineer is training a neural network and observes the output shown. Which conclusion is most likely correct?

Accepted Answer

The model is overfitting after epoch 2.. The output shows training loss decreasing while validation loss increases after epoch 2, which is a classic sign of overfitting. The model begins to memorize the training data rather than generalize, leading to poor performance on unseen data. This pattern confirms that overfitting starts after epoch 2, making option B correct.

Answer

The gradients are vanishing.

Answer

The model is underfitting.

Answer

The learning rate is too high.

Question 15

A machine learning engineer notices that the gradient values in a deep network are becoming extremely small during backpropagation. What is this problem?

Accepted Answer

Vanishing gradient. The vanishing gradient problem occurs when gradients become extremely small during backpropagation, especially in deep networks with many layers. This causes the weights in earlier layers to update very slowly or not at all, severely hindering training. The correct answer is D because the scenario directly describes the hallmark symptom of vanishing gradients.

Answer

Dead ReLU

Answer

Exploding gradient

Answer

Covariate shift

Question 16

A company is developing an AI chatbot for customer service. The legal team is concerned that the chatbot might generate responses that violate privacy regulations. Which governance mechanism should be implemented to mitigate this risk?

Accepted Answer

Implement a human-in-the-loop review process for high-risk responses.. A human-in-the-loop (HITL) review process directly addresses the risk of privacy violations by ensuring that high-risk responses are reviewed by a human before being sent to the customer. This governance mechanism provides a safety net for unpredictable outputs from the generative AI model, which may inadvertently leak personally identifiable information (PII) or violate data protection regulations like GDPR or CCPA. Unlike technical controls that only reduce the attack surface, HITL offers real-time compliance oversight for the chatbot's natural language generation (NLG) outputs.

Answer

Use explainable AI techniques to understand why the chatbot generates certain responses.

Answer

Encrypt all chatbot conversations at rest and in transit.

Answer

Anonymize the training data used to train the chatbot.

Question 17

Which TWO practices are most effective for ensuring the security of an AI model against adversarial attacks?

Accepted Answer

Input sanitization and validation. Input sanitization and validation (C) is correct because it prevents adversarial inputs—such as specially crafted perturbations or injection strings—from reaching the model's inference pipeline. By filtering, encoding, or rejecting malicious data at the application layer, the model's decision boundary is protected from manipulation. This is a fundamental defense-in-depth measure against evasion and poisoning attacks.

Answer

Encrypting the model weights

Answer

Continuous model monitoring

Answer

Rate limiting API access

Question 18

A financial institution uses an AI model to approve loan applications. The model was trained on historical data that included biased lending practices. The bank's ethics committee wants to mitigate bias without removing protected attributes. Which approach best balances fairness and model performance?

Accepted Answer

Apply adversarial debiasing during training. Adversarial debiasing is the best approach because it directly optimizes the model to reduce bias during training while preserving predictive accuracy. It uses an adversarial network that tries to predict the protected attribute from the model's predictions, forcing the main model to learn representations that are less correlated with that attribute. This allows the bank to keep protected attributes in the data (as required by the ethics committee) while actively mitigating bias.

Answer

Retrain the model using a balanced dataset

Answer

Remove all protected attributes from the training data

Answer

Post-process model outputs to adjust for demographic parity

Question 19

An organization is implementing an AI-powered chatbot for customer service. The chatbot must comply with GDPR and handle data subject access requests (DSARs). Which design approach best ensures compliance?

Accepted Answer

Implement an audit trail that logs interactions with a unique user identifier, and provide a mechanism to delete logs upon user request.. GDPR requires that personal data be stored only as long as necessary and that data subjects have the right to erasure. By logging interactions with a unique user identifier and providing a deletion mechanism, the chatbot can fulfill DSARs while maintaining an audit trail for compliance monitoring. This approach balances operational needs with regulatory obligations.

Answer

Minimize data collection by not logging any user interactions.

Answer

Anonymize all user data before logging interactions.

Answer

Encrypt all chat logs and store them indefinitely for audit purposes.

Question 20

A data scientist is training a deep learning model for image classification. The training loss decreases steadily but the validation loss starts increasing after 10 epochs. Which technique should the scientist apply to address this issue?

Accepted Answer

Implement early stopping. The scenario describes overfitting: the model memorizes training data (loss decreases) but fails to generalize to unseen validation data (validation loss increases). Early stopping (Option C) halts training when validation performance degrades, preventing overfitting while preserving the best model weights. This is a standard regularization technique in deep learning frameworks like TensorFlow and PyTorch.

Answer

Add more dropout layers

Answer

Reduce the learning rate

Answer

Increase the number of training epochs