AI0-001 Practice Test 9 — 10 Questions

Question 1

A financial institution uses a machine learning model to approve loan applications. The model was trained on historical data that inadvertently encoded a bias against applicants from certain zip codes, leading to discriminatory lending practices. A recent audit reveals that the model's decisions are unfair, and regulators require the bank to remediate the bias without significantly reducing overall approval accuracy. The data science team has access to the training data, the model, and a set of fairness metrics. They also have a small, unbiased validation set. Which course of action should the team take to satisfy regulatory requirements?

Accepted Answer

Implement adversarial debiasing using the unbiased validation set to enforce fairness constraints. Adversarial debiasing directly addresses the bias encoded in the model by training a predictor and an adversary simultaneously. The adversary tries to predict the protected attribute (e.g., zip code) from the model's predictions, while the predictor is penalized for allowing such inference, enforcing fairness constraints. Using the unbiased validation set ensures the debiasing process is guided by ground truth labels that are free from historical bias, allowing the model to retain high accuracy while reducing discrimination.

Answer

Remove the zip code feature from the model and retrain

Answer

Increase the weight of samples from disadvantaged zip codes in the training data

Answer

Retrain the model using only the unbiased validation set

Question 2

A cybersecurity firm is developing an AI system to detect zero-day malware using behavior analysis. The team collects a dataset of 1,000 malware samples and 10,000 benign files from corporate endpoints. The model is a random forest classifier. After deployment, the false positive rate is 5%, which is acceptable, but the detection rate for new malware variants drops to 30%. The security analyst suspects the model is overfitting to the specific malware families in the training set. Which improvement should the team implement first?

Accepted Answer

Engineer features that capture generic behavioral patterns. The core issue is that the model has overfitted to the specific malware families in the training set, causing poor generalization to unseen zero-day variants. Engineering features that capture generic behavioral patterns (e.g., API call sequences, file system interactions, network connection anomalies) reduces reliance on family-specific signatures, improving detection of novel malware. This directly addresses the root cause of the 30% detection rate drop without introducing new model complexity or data imbalance issues.

Answer

Use a boosting ensemble instead of bagging

Answer

Collect more malware samples from the same families

Answer

Replace the random forest with a deep neural network

Question 3

A retail company wants to implement a recommendation system using collaborative filtering. The dataset contains user-item interactions (ratings) for 10,000 users and 5,000 products. The matrix is very sparse (99% missing values). The team plans to use matrix factorization to predict missing ratings. However, the training time is excessively long, and the model is not converging. The data engineer suggests using a smaller learning rate and more iterations. Which additional technique should the team apply to speed up training and improve convergence?

Accepted Answer

Add L2 regularization to the loss function. The correct answer is A because adding L2 regularization to the loss function helps prevent overfitting and improves convergence in matrix factorization, especially with extremely sparse data (99% missing). Regularization penalizes large latent factor weights, which stabilizes the optimization process and allows the model to generalize better, reducing the risk of divergence during training.

Answer

Increase the minibatch size

Answer

Reduce the number of latent factors

Answer

Switch to the Adam optimizer

Question 4

An e-commerce company uses a machine learning model to recommend products to users. The model is retrained weekly and deployed to production. For the past three weeks, the model's click-through rate (CTR) has been stable except on Mondays, when it drops by 15%. Analysis reveals that the training data is extracted on Sundays and includes only weekday behavior. On Mondays, user behavior shifts due to weekend browsing patterns not captured in the training data. The team wants to maintain a weekly retraining cadence but fix the Monday performance drop. Which solution best addresses the Monday CTR drop without changing the retraining frequency?

Accepted Answer

Modify the data pipeline to include the full week (including the past weekend) in each retraining. Option B is correct because it directly addresses the root cause: the training data excludes weekend behavior, causing the model to be blind to Monday patterns. By modifying the data pipeline to include the full week (including the past weekend) in each retraining, the model learns from weekend browsing patterns and can generalize to Monday user behavior without changing the weekly retraining cadence. This ensures the training distribution matches the inference distribution on Mondays, stabilizing CTR.

Answer

Deploy a separate model specifically for Monday predictions

Answer

Serve the previous week's model on Mondays to use older but stable patterns

Answer

Change to daily retraining to include weekend data more promptly

Question 5

A logistics company uses a machine learning model to predict delivery times based on historical data. The model was performing well, but recently it started making inaccurate predictions, especially for routes that have experienced new traffic patterns and road closures. The data engineering team receives an alert that the model's accuracy has dropped by 15% over the last week. They suspect data drift. The team has access to the original training data and a continuous stream of new data. What is the most appropriate first step for the team to take?

Accepted Answer

Compare the distributions of key features between the training data and the recent data to quantify data drift.. Option B is correct because the first step in diagnosing a suspected data drift is to statistically compare the distributions of key features between the training data and the recent streaming data. This quantifies whether the input data distribution has changed, which directly explains the accuracy drop. Without this analysis, any corrective action (like retraining or rollback) would be premature and could mask the root cause.

Answer

Roll back the model to the previous stable version and schedule a full audit of the data pipeline.

Answer

Immediately retrain the model using the most recent data to adapt to the new patterns.

Answer

Add more features to the model to capture the new traffic patterns and road closures.

Question 6

You are an AI engineer at a financial services firm. The company has deployed a gradient boosting model to predict loan default risk. The model takes features such as credit score, debt-to-income ratio, loan amount, and employment length. In production, the model processes about 10,000 predictions per day with an average latency of 50ms. Recently, the accuracy has dropped from 92% to 85%. You also notice that the average credit score of applicants has increased significantly because the marketing team launched a campaign targeting prime borrowers. The model was originally trained on data from the past three years, which included a mix of prime and subprime borrowers. You need to restore model performance while minimizing downtime and retraining cost. Which action should you take first?

Accepted Answer

Retrain the model using the last three months of production data with labels.. The drop in accuracy is due to data drift—the production data now has a different distribution (higher credit scores) than the training data. Retraining on the most recent three months of production data with labels directly addresses this shift by adapting the model to the new population, and it minimizes downtime because it uses existing infrastructure and avoids complex architectural changes.

Answer

Add a regularization term to penalize high credit scores.

Answer

Deploy an ensemble of the original model and a neural network.

Answer

Reject all predictions where the confidence score is below 0.9.

Question 7

An AI engineer trains a deep learning model for image classification. After training, the training accuracy is 99% but validation accuracy is 85%. Which technique would best address this discrepancy?

Accepted Answer

Add dropout layers. The high training accuracy (99%) and lower validation accuracy (85%) indicate overfitting, where the model memorizes training data but fails to generalize. Dropout layers randomly deactivate neurons during training, forcing the network to learn more robust features and reducing overfitting. This technique directly addresses the discrepancy by improving validation performance without sacrificing training capacity.

Answer

Increase data augmentation

Answer

Decrease the learning rate

Answer

Increase the number of layers

Question 8

An AI model for detecting fraudulent transactions has high precision but low recall. Which business impact is most likely?

Accepted Answer

Many fraudulent transactions go undetected. High precision means that when the model flags a transaction as fraudulent, it is very likely correct. However, low recall indicates that the model misses a significant proportion of actual fraudulent transactions. Therefore, the most likely business impact is that many fraudulent transactions go undetected, leading to financial losses.

Answer

The model has no impact on fraud detection

Answer

The model detects all fraudulent transactions

Answer

Many legitimate transactions are flagged as fraud

Question 9

An organization wants to classify support tickets into categories (billing, technical, etc.). Which type of machine learning is most suitable?

Accepted Answer

Supervised learning. Supervised learning is the correct choice because the organization has labeled historical support tickets (e.g., 'billing' or 'technical') and wants to train a model to map new tickets to these predefined categories. This is a classic classification task, where the algorithm learns from input-output pairs to predict the correct label for unseen data.

Answer

Unsupervised learning

Answer

Reinforcement learning

Answer

Regression

Question 10

A deep learning model for image classification is overfitting the training data. The team has already tried data augmentation and dropout. Which additional technique should they implement to reduce overfitting?

Accepted Answer

Early stopping. Early stopping (Option D) is the correct additional technique because it halts training when validation performance stops improving, directly preventing the model from memorizing noise in the training data. Since data augmentation and dropout are already in use, early stopping provides a complementary regularization effect by limiting the number of training iterations before overfitting occurs.

Answer

Batch normalization

Answer

Increase number of epochs

Answer

Gradient clipping