AI0-001 Practice Test 3 — 25 Questions

Question 1

Refer to the exhibit. An auditor reports that the model's fairness check was bypassed in a recent deployment. Based on the policy, what is the most likely cause?

Accepted Answer

Data scientist role has deploy permission, allowing deployment without fairness validation. (Data scientist role has deploy permission, allowing deployment without fairness validation) is correct. The policy shows fairness_check required, but if the deployment process does not enforce it, the data scientist could bypass it. Option A (Auditor lacks evaluate) is unrelated to deployment. Option C (Fairness threshold low) does not cause bypass. Option D (External user inference) is unrelated.

Answer

The auditor role lacks 'evaluate' permission

Answer

Fairness check threshold is set to 0.8, which is too low

Answer

External_user role can perform inference, which triggers unfair predictions

Question 2

Which neural network architecture is specifically designed to handle sequential data and mitigate the vanishing gradient problem?

Accepted Answer

Long Short-Term Memory (LSTM) network. LSTM (Long Short-Term Memory) is a type of RNN designed with gating mechanisms to prevent vanishing gradients in long sequences. CNNs are for spatial data; vanilla RNNs suffer from vanishing gradients; transformers use attention but are not specifically designed to mitigate vanishing gradients (they use residual connections).

Answer

Convolutional Neural Network (CNN)

Answer

Transformer

Answer

Vanilla Recurrent Neural Network (RNN)

Question 3

An MLOps team automates model deployment with a CI/CD pipeline. A performance regression is detected after deploying a new model version. The team needs to automatically roll back to the previous version. Which approach best enables safe automated rollback?

Accepted Answer

Use a blue/green deployment with automated health checks and traffic switching. Blue/green deployment with automated health checks and traffic switching is the best approach because it allows the team to instantly route all traffic back to the previous (green) environment if the new (blue) version fails health checks. This ensures zero-downtime rollback without manual intervention, directly addressing the need for safe automated rollback in a CI/CD pipeline.

Answer

Maintain a manual rollback script that the operations team can run

Answer

Deploy new models as canary releases and monitor for 24 hours

Answer

Automatically keep the previous model version in storage for later use

Question 4

Refer to the exhibit. A team created an access policy for a fraud detection model endpoint. An intern reports being unable to access the model for testing. Reviewing the policy, what is the most likely cause?

Accepted Answer

The intern's role is explicitly denied in the policy. The exhibit shows an explicit `Deny` effect for the intern's role in the policy. In AWS IAM (or similar cloud provider) access policies, an explicit deny overrides any allow, so even if the intern's role is listed in allowed roles, the explicit deny will block access. This is a fundamental principle of IAM policy evaluation logic.

Answer

The intern's role is not included in the allowed roles

Answer

The policy JSON has a syntax error

Answer

The endpoint path is incorrect

Question 5

An operations team monitors a classification model in production. The confusion matrix for the model shows the following values: TP=1500, FN=500, FP=600, TN=2400. Which metric should the team calculate to assess the model's ability to avoid false positives?

Accepted Answer

Precision. Precision (TP / (TP + FP)) directly measures the proportion of positive identifications that were actually correct, making it the ideal metric to assess the model's ability to avoid false positives. With TP=1500 and FP=600, precision is 1500/(1500+600)=0.714, indicating that 71.4% of predicted positives are true positives, while 28.6% are false positives. The question explicitly asks about avoiding false positives, which is the inverse of precision's focus on the correctness of positive predictions.

Answer

Accuracy

Answer

F1-score

Answer

Recall

Question 6

A company deploys an LLM-based chatbot that retrieves data from external databases. An attacker embeds malicious instructions in a database record. When the chatbot retrieves that record, it executes the instructions, overriding its system prompt. Which type of attack is this?

Accepted Answer

Indirect prompt injection. This is an indirect prompt injection attack because the malicious instructions are embedded in a third-party data source (the database record) rather than being sent directly by the user. When the LLM retrieves and processes that record, the injected instructions override the system prompt, causing the chatbot to behave contrary to its intended design.

Answer

Model inversion attack

Answer

Direct prompt injection

Answer

Membership inference attack

Question 7

A data scientist is building a classification model to detect fraudulent transactions. The dataset is highly imbalanced with only 1% fraudulent cases. Which approach should the scientist use to evaluate model performance most effectively?

Accepted Answer

F1 score. In highly imbalanced datasets like fraud detection (1% positive class), accuracy is misleading because a model that predicts all transactions as legitimate would achieve 99% accuracy yet fail to detect any fraud. The F1 score (harmonic mean of precision and recall) is the most effective metric because it balances both false positives and false negatives, providing a single score that reflects the model's ability to correctly identify the minority class without being skewed by class imbalance.

Answer

Accuracy

Answer

Recall

Answer

Precision

Question 8

An AI system used for hiring has been found to exhibit racial bias against certain candidates. Which step should the organization take to mitigate this?

Accepted Answer

Regularly audit model predictions across demographic groups and retrain with fairness constraints.. Bias in AI systems is often embedded in training data or model behavior, not just in feature selection. Regularly auditing predictions across demographic groups and retraining with fairness constraints (e.g., demographic parity or equalized odds) allows the organization to detect and correct disparate impact without sacrificing model performance. This aligns with the AI0-001 focus on continuous monitoring and iterative improvement in AI operations.

Answer

Remove all demographic features from the model.

Answer

Use a different algorithm that is inherently unbiased.

Answer

Hire more diverse data scientists.

Question 9

An e-commerce company deploys a recommendation system using collaborative filtering. After launch, the system shows high accuracy for popular items but fails to recommend niche products to users who would likely buy them. Which technique should the team implement to improve recommendations for long-tail items?

Accepted Answer

Switch to a hybrid filtering approach that incorporates item metadata. Collaborative filtering relies on user-item interactions, which are sparse for niche products (the long tail). A hybrid filtering approach that incorporates item metadata (e.g., category, description, attributes) can bridge the gap by using content-based signals to recommend niche items even when interaction data is limited. This directly addresses the cold-start and sparsity problems for long-tail items.

Answer

Apply matrix factorization with higher latent factors

Answer

Increase the weight of popular items in the recommendation score

Answer

Collect more user interaction data over time

Question 10

Which THREE of the following are key components of an AI governance framework?

Accepted Answer

Regular auditing and monitoring for compliance.. Regular auditing and monitoring for compliance (A) is a key component of an AI governance framework because it ensures that AI systems operate within legal, ethical, and organizational policies over time. Continuous monitoring detects drift, bias, or security violations, while audits provide evidence of adherence to standards such as ISO/IEC 42001 or internal governance rules. Without this, governance becomes a static policy with no enforcement or verification.

Answer

Cloud-based deployment for scalability.

Answer

Model accuracy thresholds for production deployment.

Question 11

A data engineer is reviewing an S3 bucket policy for a machine learning project. The policy is intended to allow access to training data only from the corporate network (10.0.0.0/16). However, users in the corporate network report access denied. Which issue is most likely causing the problem?

Accepted Answer

The policy does not include s3:ListBucket action, which is needed to list objects.. The condition key uses "aws:SourceIp" but the correct key for IP address condition is "aws:SourceIp". However, the exhibit shows "aws:SourceIp" which is correct? Wait, the exhibit shows "aws:SourceIp" — that is correct. But the problem might be that the policy uses "GetObject" but the users might be trying to list objects (s3:ListBucket). Option C says the action does not include s3:ListBucket, which is often needed first. Option A is wrong because the resource is correct. Option B is wrong because the policy allows access from 10.0.0.0/16. Option D is wrong because the effect is Allow.

Answer

The policy is missing a Deny statement.

Answer

The resource ARN is incorrect.

Answer

The IP address condition is not matching because the corporate network uses a different CIDR.

Question 12

A hospital uses an AI system to prioritize patient triage based on vital signs and medical history. During a trial, the system consistently assigns lower urgency to elderly patients with chronic conditions, even when their symptoms suggest high risk. Which approach best addresses this bias?

Accepted Answer

Audit the training data for representation of elderly patients and retrain with balanced data. The bias originates from the training data underrepresenting elderly patients with chronic conditions, causing the model to learn skewed urgency patterns. Auditing the data for representation and retraining with balanced data directly addresses the root cause by ensuring the model learns from a fair distribution of cases, which is a standard bias mitigation technique in AI systems.

Answer

Use a different dataset from a similar hospital without checking demographics

Answer

Manually increase the weight of age-related features in the model

Answer

Replace the neural network with a decision tree to simplify decision logic

Question 13

Which three techniques are commonly used to mitigate overfitting in neural networks? (Choose three.)

Accepted Answer

Adding L2 regularization. Adding L2 regularization (also known as weight decay) penalizes large weights by adding a term proportional to the squared magnitude of the weights to the loss function. This forces the network to keep weights small, reducing the model's sensitivity to noise in the training data and preventing it from fitting spurious patterns, which is a direct and effective method to combat overfitting.

Answer

Increasing training data

Answer

Reducing number of layers

Question 14

A company wants to deploy a machine learning model that requires continuous learning as new data arrives. The model must be able to adapt to changing patterns without retraining from scratch. Which approach should be used?

Accepted Answer

Online learning. Online learning (also called incremental learning) updates the model incrementally as each new data point arrives, without requiring full retraining. This makes it ideal for scenarios where data arrives continuously and patterns shift over time, as the model can adapt its parameters on the fly.

Answer

Transfer learning

Answer

Batch learning

Answer

Unsupervised learning

Question 15

Which THREE factors are common causes of bias in AI systems?

Accepted Answer

Lack of diversity in the development team. A lack of diversity in the development team leads to homogeneity of thought, which can cause blind spots in identifying potential biases in data, features, or model behavior. When the team does not represent the full spectrum of end users, the AI system may inadvertently encode assumptions that disadvantage underrepresented groups, resulting in biased outcomes.

Answer

Cross-validation

Answer

High regularization

Question 16

A machine learning team is deploying a sentiment analysis model for customer reviews. The model was trained on reviews from an e-commerce site but will be used for a social media platform. The team observes a drop in accuracy. Which concept best explains this issue?

Accepted Answer

Data drift. Data drift occurs when the statistical properties of the input data change between the training and production environments. Here, the model was trained on e-commerce reviews but is now processing social media posts, which have different vocabulary, tone, and structure, causing a mismatch in the input distribution and leading to accuracy degradation.

Answer

Concept drift

Answer

Bias-variance tradeoff

Answer

Overfitting

Question 17

A data engineer needs to design a data pipeline for a real-time fraud detection system. The system requires low-latency processing of streaming transactions. Which architecture is most appropriate?

Accepted Answer

Stream processing with Apache Kafka and Flink. Apache Kafka provides a distributed, fault-tolerant event streaming platform that ingests high-throughput transaction data with low latency, while Apache Flink offers true stream processing with exactly-once semantics and sub-second event-time processing. Together, they enable real-time fraud detection by analyzing transactions as they arrive, without the delays inherent in batch or micro-batch approaches.

Answer

Data lake with Apache Spark

Answer

Batch processing with Apache Hadoop

Answer

Microservices architecture with REST APIs

Question 18

An operations team sees the log entries above for a production ML model. What is the MOST likely root cause of the latency spike?

Accepted Answer

A memory leak in the model serving container causing gradual slowdown.. The log entries show a gradual increase in latency over time, which is characteristic of a memory leak in the model serving container. As memory consumption grows, garbage collection pauses become more frequent and longer, eventually causing request processing to slow down. This pattern is distinct from a sudden spike caused by resource contention or network issues.

Answer

A scheduled training job consuming GPU resources on the same node.

Answer

A network outage between the model server and the client.

Answer

A bug in the model's preprocessing code causing incorrect predictions.

Question 19

A machine learning engineer is deploying a model to production. Which TWO practices are essential for ensuring reproducibility of model predictions?

Accepted Answer

Version-control the model artifact (e.g., using MLflow or DVC).. Version-controlling the model artifact (D) is essential because it allows you to reproduce the exact model binary that generated a prediction, ensuring that any changes to the model code, hyperparameters, or training data do not silently alter outputs. Tools like MLflow or DVC store the model along with its metadata, enabling rollback and auditability in production.

Answer

Increase the number of training epochs to ensure convergence.

Answer

Use the same GPU hardware for both training and inference.

Answer

Use parallel data loading to speed up inference.

Question 20

Based on the exhibit, what is the most likely cause of the accuracy drop?

Accepted Answer

Data drift in the 'income' feature has caused the model to become less accurate.. The exhibit shows a sudden and sustained drop in model accuracy coinciding with a shift in the distribution of the 'income' feature. This is a classic symptom of data drift, where the statistical properties of the input feature change over time, causing the model's learned patterns to no longer match the production data. Option B correctly identifies this as the most likely cause because the model was trained on a prior income distribution and is now encountering values outside that range.

Answer

A required feature is missing from the production data pipeline.

Answer

The model was overfitted to the training data.

Answer

The model's confidence threshold needs to be adjusted.