AI0-001 Practice Exam 4 — 20 Questions

Question 1

A data engineer is reviewing an S3 bucket policy for a machine learning project. The policy is intended to allow access to training data only from the corporate network (10.0.0.0/16). However, users in the corporate network report access denied. Which issue is most likely causing the problem?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

The policy does not include s3:ListBucket action, which is needed to list objects.. The condition key uses "aws:SourceIp" but the correct key for IP address condition is "aws:SourceIp". However, the exhibit shows "aws:SourceIp" which is correct? Wait, the exhibit shows "aws:SourceIp" — that is correct. But the problem might be that the policy uses "GetObject" but the users might be trying to list objects (s3:ListBucket). Option C says the action does not include s3:ListBucket, which is often needed first. Option A is wrong because the resource is correct. Option B is wrong because the policy allows access from 10.0.0.0/16. Option D is wrong because the effect is Allow.

Answer

The policy is missing a Deny statement.

Answer

The resource ARN is incorrect.

Answer

The IP address condition is not matching because the corporate network uses a different CIDR.

Question 2

A hospital uses an AI system to prioritize patient triage based on vital signs and medical history. During a trial, the system consistently assigns lower urgency to elderly patients with chronic conditions, even when their symptoms suggest high risk. Which approach best addresses this bias?

Accepted Answer

Audit the training data for representation of elderly patients and retrain with balanced data. The bias originates from the training data underrepresenting elderly patients with chronic conditions, causing the model to learn skewed urgency patterns. Auditing the data for representation and retraining with balanced data directly addresses the root cause by ensuring the model learns from a fair distribution of cases, which is a standard bias mitigation technique in AI systems.

Answer

Use a different dataset from a similar hospital without checking demographics

Answer

Manually increase the weight of age-related features in the model

Answer

Replace the neural network with a decision tree to simplify decision logic

Question 3

Which three techniques are commonly used to mitigate overfitting in neural networks? (Choose three.)

Accepted Answer

Adding L2 regularization. Adding L2 regularization (also known as weight decay) penalizes large weights by adding a term proportional to the squared magnitude of the weights to the loss function. This forces the network to keep weights small, reducing the model's sensitivity to noise in the training data and preventing it from fitting spurious patterns, which is a direct and effective method to combat overfitting.

Answer

Increasing training data

Answer

Reducing number of layers

Question 4

A company wants to deploy a machine learning model that requires continuous learning as new data arrives. The model must be able to adapt to changing patterns without retraining from scratch. Which approach should be used?

Accepted Answer

Online learning. Online learning (also called incremental learning) updates the model incrementally as each new data point arrives, without requiring full retraining. This makes it ideal for scenarios where data arrives continuously and patterns shift over time, as the model can adapt its parameters on the fly.

Answer

Transfer learning

Answer

Batch learning

Answer

Unsupervised learning

Question 5

Which THREE factors are common causes of bias in AI systems?

Accepted Answer

Lack of diversity in the development team. A lack of diversity in the development team leads to homogeneity of thought, which can cause blind spots in identifying potential biases in data, features, or model behavior. When the team does not represent the full spectrum of end users, the AI system may inadvertently encode assumptions that disadvantage underrepresented groups, resulting in biased outcomes.

Answer

Cross-validation

Answer

High regularization

Question 6

A machine learning team is deploying a sentiment analysis model for customer reviews. The model was trained on reviews from an e-commerce site but will be used for a social media platform. The team observes a drop in accuracy. Which concept best explains this issue?

Accepted Answer

Data drift. Data drift occurs when the statistical properties of the input data change between the training and production environments. Here, the model was trained on e-commerce reviews but is now processing social media posts, which have different vocabulary, tone, and structure, causing a mismatch in the input distribution and leading to accuracy degradation.

Answer

Concept drift

Answer

Bias-variance tradeoff

Answer

Overfitting

Question 7

A data engineer needs to design a data pipeline for a real-time fraud detection system. The system requires low-latency processing of streaming transactions. Which architecture is most appropriate?

Accepted Answer

Stream processing with Apache Kafka and Flink. Apache Kafka provides a distributed, fault-tolerant event streaming platform that ingests high-throughput transaction data with low latency, while Apache Flink offers true stream processing with exactly-once semantics and sub-second event-time processing. Together, they enable real-time fraud detection by analyzing transactions as they arrive, without the delays inherent in batch or micro-batch approaches.

Answer

Data lake with Apache Spark

Answer

Batch processing with Apache Hadoop

Answer

Microservices architecture with REST APIs

Question 8

An operations team sees the log entries above for a production ML model. What is the MOST likely root cause of the latency spike?

Accepted Answer

A memory leak in the model serving container causing gradual slowdown.. The log entries show a gradual increase in latency over time, which is characteristic of a memory leak in the model serving container. As memory consumption grows, garbage collection pauses become more frequent and longer, eventually causing request processing to slow down. This pattern is distinct from a sudden spike caused by resource contention or network issues.

Answer

A scheduled training job consuming GPU resources on the same node.

Answer

A network outage between the model server and the client.

Answer

A bug in the model's preprocessing code causing incorrect predictions.

Question 9

A machine learning engineer is deploying a model to production. Which TWO practices are essential for ensuring reproducibility of model predictions?

Accepted Answer

Version-control the model artifact (e.g., using MLflow or DVC).. Version-controlling the model artifact (D) is essential because it allows you to reproduce the exact model binary that generated a prediction, ensuring that any changes to the model code, hyperparameters, or training data do not silently alter outputs. Tools like MLflow or DVC store the model along with its metadata, enabling rollback and auditability in production.

Answer

Increase the number of training epochs to ensure convergence.

Answer

Use the same GPU hardware for both training and inference.

Answer

Use parallel data loading to speed up inference.

Question 10

Based on the exhibit, what is the most likely cause of the accuracy drop?

Accepted Answer

Data drift in the 'income' feature has caused the model to become less accurate.. The exhibit shows a sudden and sustained drop in model accuracy coinciding with a shift in the distribution of the 'income' feature. This is a classic symptom of data drift, where the statistical properties of the input feature change over time, causing the model's learned patterns to no longer match the production data. Option B correctly identifies this as the most likely cause because the model was trained on a prior income distribution and is now encountering values outside that range.

Answer

A required feature is missing from the production data pipeline.

Answer

The model was overfitted to the training data.

Answer

The model's confidence threshold needs to be adjusted.

Question 11

An autonomous vehicle system uses a deep reinforcement learning agent to navigate. The agent's reward function gives +1 for reaching the destination and -0.1 for each time step. After training, the agent learns to circle the block repeatedly without reaching the destination. Which modification is most likely to fix this behavior?

Accepted Answer

Increase the time penalty to -1 per step. The agent learns to circle the block because the cumulative penalty for each time step (-0.1) is too small relative to the reward for reaching the destination (+1). By increasing the time penalty to -1 per step, the agent will incur a much larger cost for delaying, making it optimal to reach the destination quickly rather than looping indefinitely. This directly addresses the reward structure imbalance that causes the undesirable behavior.

Answer

Increase the reward for reaching the destination to +10

Answer

Use a discount factor closer to 0

Answer

Add a penalty for each turn the vehicle makes

Question 12

A data scientist trains a deep neural network for image classification. The training loss decreases but validation loss starts increasing after 50 epochs. What should the data scientist do to improve generalization?

Accepted Answer

Apply dropout and early stopping. The increasing validation loss while training loss decreases is a classic sign of overfitting. Dropout randomly deactivates neurons during training, which prevents co-adaptation and forces the network to learn more robust features. Early stopping halts training when validation performance stops improving, directly addressing the overfitting by selecting the model with the best generalization before it degrades.

Answer

Decrease batch size

Answer

Add more hidden layers

Answer

Increase learning rate

Question 13

A company wants to deploy a chatbot that uses natural language understanding (NLU) to answer customer queries. Which AI technique is most suitable for understanding the intent of user input?

Accepted Answer

Sequence-to-sequence model with attention. Sequence-to-sequence models with attention are specifically designed to handle variable-length input sequences (like user queries) and map them to output sequences (like intent labels or responses). The attention mechanism allows the model to focus on the most relevant parts of the input when determining intent, which is critical for understanding nuanced or long user queries in NLU tasks.

Answer

K-means clustering

Answer

Linear regression

Answer

Decision tree

Question 14

A data scientist is preparing a dataset for a classification task. The dataset contains 10,000 rows and 50 features, but many features have missing values. Which approach should the scientist take first to address the missing data?

Accepted Answer

Analyze the pattern and proportion of missing values to choose an appropriate imputation strategy.. The first step in handling missing data is to understand the pattern and proportion of missingness (e.g., MCAR, MAR, MNAR) to select an appropriate imputation method. Blindly applying imputation or deletion without analysis can introduce bias or reduce model performance. This diagnostic step ensures the chosen strategy aligns with the data's underlying structure and the classification task's requirements.

Answer

Use a deep learning model to predict missing values without preprocessing.

Answer

Remove all rows with any missing values to ensure a clean dataset.

Answer

Replace missing values with the mean of each feature immediately.

Question 15

Refer to the exhibit. The data scientist notices that the model achieves 98% accuracy on the training set but only 72% on the test set. Which change to the model parameters is most likely to reduce this gap?

Accepted Answer

Reduce max_depth to 3.. The model is overfitting: 98% training accuracy vs. 72% test accuracy. Reducing max_depth to 3 limits the depth of each decision tree, preventing them from memorizing noise and forcing them to learn more generalizable patterns. This is a standard regularization technique for tree-based ensembles.

Answer

Increase n_estimators to 500.

Answer

Set max_depth to None to allow trees to grow fully.

Answer

Switch from RandomForest to a linear model like LogisticRegression.

Question 16

A data scientist wants to group customers into segments based on purchasing behavior without predefined labels. Which type of machine learning is most appropriate?

Accepted Answer

Unsupervised learning. Unsupervised learning is the correct choice because the data scientist has no predefined labels and wants to discover natural groupings in customer purchasing behavior. Clustering algorithms, such as K-means or DBSCAN, are used in unsupervised learning to segment data based on inherent patterns without any target variable.

Answer

Reinforcement learning

Answer

Supervised learning

Answer

Semi-supervised learning

Question 17

A team is training a deep learning model for natural language processing using a large corpus. They notice the model has a very high number of parameters and training is slow. Which technique can reduce the number of parameters without significant performance loss?

Accepted Answer

Apply embedding compression. Embedding compression reduces the dimensionality of the embedding layer, which often contains the majority of the model's parameters in NLP tasks. By using techniques like low-rank factorization or pruning, the model retains most of its representational power while significantly decreasing the parameter count and training time.

Answer

Add more dropout layers

Answer

Use a larger batch size

Answer

Increase learning rate

Question 18

A company wants to use AI to analyze customer reviews and determine sentiment (positive, negative, neutral). Which AI subfield is most directly applicable?

Accepted Answer

Natural language processing. Natural language processing (NLP) is the AI subfield that enables machines to understand, interpret, and generate human language. Analyzing customer reviews for sentiment requires processing text, extracting meaning, and classifying it as positive, negative, or neutral, which is a core NLP task called sentiment analysis.

Answer

Reinforcement learning

Answer

Computer vision

Answer

Robotics

Question 19

A research team is training a deep neural network for image classification. The training loss decreases rapidly for the first few epochs but then plateaus, while validation loss starts to increase after epoch 10. Which action would best address this issue?

Accepted Answer

Implement early stopping based on validation loss to prevent further overfitting.. The training loss decreasing rapidly then plateauing while validation loss increases after epoch 10 is a classic sign of overfitting. Early stopping monitors validation loss and halts training when it begins to rise, preventing the model from memorizing noise in the training data. This directly addresses the overfitting issue without requiring architectural or hyperparameter changes that could destabilize training.

Answer

Reduce the batch size to introduce more noise during training.

Answer

Increase the learning rate to help the model escape the plateau.

Answer

Add more convolutional layers to increase model capacity.

Question 20

A data scientist is deploying a machine learning model to production. The model was trained on an imbalanced dataset. Which technique should be used during deployment to mitigate bias without retraining the model?

Accepted Answer

Apply post-processing calibration to adjust decision thresholds. Post-processing calibration adjusts the decision threshold of the model to account for the class imbalance present in the training data. This technique modifies the output probabilities or classification boundary without requiring access to the original training data or retraining the model, making it suitable for deployment scenarios where the model is already fixed.

Answer

Use an ensemble of models trained on balanced subsets

Answer

Rebalance the dataset using SMOTE before inference

Answer

Remove sensitive features from the input data