AI0-001 Practice Test 6 — 10 Questions

Question 1

Refer to the exhibit. An auditor reports that the model's fairness check was bypassed in a recent deployment. Based on the policy, what is the most likely cause?

Accepted Answer

Data scientist role has deploy permission, allowing deployment without fairness validation. (Data scientist role has deploy permission, allowing deployment without fairness validation) is correct. The policy shows fairness_check required, but if the deployment process does not enforce it, the data scientist could bypass it. Option A (Auditor lacks evaluate) is unrelated to deployment. Option C (Fairness threshold low) does not cause bypass. Option D (External user inference) is unrelated.

Answer

The auditor role lacks 'evaluate' permission

Answer

Fairness check threshold is set to 0.8, which is too low

Answer

External_user role can perform inference, which triggers unfair predictions

Question 2

Which neural network architecture is specifically designed to handle sequential data and mitigate the vanishing gradient problem?

Accepted Answer

Long Short-Term Memory (LSTM) network. LSTM (Long Short-Term Memory) is a type of RNN designed with gating mechanisms to prevent vanishing gradients in long sequences. CNNs are for spatial data; vanilla RNNs suffer from vanishing gradients; transformers use attention but are not specifically designed to mitigate vanishing gradients (they use residual connections).

Answer

Convolutional Neural Network (CNN)

Answer

Transformer

Answer

Vanilla Recurrent Neural Network (RNN)

Question 3

An MLOps team automates model deployment with a CI/CD pipeline. A performance regression is detected after deploying a new model version. The team needs to automatically roll back to the previous version. Which approach best enables safe automated rollback?

Accepted Answer

Use a blue/green deployment with automated health checks and traffic switching. Blue/green deployment with automated health checks and traffic switching is the best approach because it allows the team to instantly route all traffic back to the previous (green) environment if the new (blue) version fails health checks. This ensures zero-downtime rollback without manual intervention, directly addressing the need for safe automated rollback in a CI/CD pipeline.

Answer

Maintain a manual rollback script that the operations team can run

Answer

Deploy new models as canary releases and monitor for 24 hours

Answer

Automatically keep the previous model version in storage for later use

Question 4

Refer to the exhibit. A team created an access policy for a fraud detection model endpoint. An intern reports being unable to access the model for testing. Reviewing the policy, what is the most likely cause?

Accepted Answer

The intern's role is explicitly denied in the policy. The exhibit shows an explicit `Deny` effect for the intern's role in the policy. In AWS IAM (or similar cloud provider) access policies, an explicit deny overrides any allow, so even if the intern's role is listed in allowed roles, the explicit deny will block access. This is a fundamental principle of IAM policy evaluation logic.

Answer

The intern's role is not included in the allowed roles

Answer

The policy JSON has a syntax error

Answer

The endpoint path is incorrect

Question 5

An operations team monitors a classification model in production. The confusion matrix for the model shows the following values: TP=1500, FN=500, FP=600, TN=2400. Which metric should the team calculate to assess the model's ability to avoid false positives?

Accepted Answer

Precision. Precision (TP / (TP + FP)) directly measures the proportion of positive identifications that were actually correct, making it the ideal metric to assess the model's ability to avoid false positives. With TP=1500 and FP=600, precision is 1500/(1500+600)=0.714, indicating that 71.4% of predicted positives are true positives, while 28.6% are false positives. The question explicitly asks about avoiding false positives, which is the inverse of precision's focus on the correctness of positive predictions.

Answer

Accuracy

Answer

F1-score

Answer

Recall

Question 6

A company deploys an LLM-based chatbot that retrieves data from external databases. An attacker embeds malicious instructions in a database record. When the chatbot retrieves that record, it executes the instructions, overriding its system prompt. Which type of attack is this?

Accepted Answer

Indirect prompt injection. This is an indirect prompt injection attack because the malicious instructions are embedded in a third-party data source (the database record) rather than being sent directly by the user. When the LLM retrieves and processes that record, the injected instructions override the system prompt, causing the chatbot to behave contrary to its intended design.

Answer

Model inversion attack

Answer

Direct prompt injection

Answer

Membership inference attack

Question 7

A data scientist is building a classification model to detect fraudulent transactions. The dataset is highly imbalanced with only 1% fraudulent cases. Which approach should the scientist use to evaluate model performance most effectively?

Accepted Answer

F1 score. In highly imbalanced datasets like fraud detection (1% positive class), accuracy is misleading because a model that predicts all transactions as legitimate would achieve 99% accuracy yet fail to detect any fraud. The F1 score (harmonic mean of precision and recall) is the most effective metric because it balances both false positives and false negatives, providing a single score that reflects the model's ability to correctly identify the minority class without being skewed by class imbalance.

Answer

Accuracy

Answer

Recall

Answer

Precision

Question 8

An AI system used for hiring has been found to exhibit racial bias against certain candidates. Which step should the organization take to mitigate this?

Accepted Answer

Regularly audit model predictions across demographic groups and retrain with fairness constraints.. Bias in AI systems is often embedded in training data or model behavior, not just in feature selection. Regularly auditing predictions across demographic groups and retraining with fairness constraints (e.g., demographic parity or equalized odds) allows the organization to detect and correct disparate impact without sacrificing model performance. This aligns with the AI0-001 focus on continuous monitoring and iterative improvement in AI operations.

Answer

Remove all demographic features from the model.

Answer

Use a different algorithm that is inherently unbiased.

Answer

Hire more diverse data scientists.

Question 9

An e-commerce company deploys a recommendation system using collaborative filtering. After launch, the system shows high accuracy for popular items but fails to recommend niche products to users who would likely buy them. Which technique should the team implement to improve recommendations for long-tail items?

Accepted Answer

Switch to a hybrid filtering approach that incorporates item metadata. Collaborative filtering relies on user-item interactions, which are sparse for niche products (the long tail). A hybrid filtering approach that incorporates item metadata (e.g., category, description, attributes) can bridge the gap by using content-based signals to recommend niche items even when interaction data is limited. This directly addresses the cold-start and sparsity problems for long-tail items.

Answer

Apply matrix factorization with higher latent factors

Answer

Increase the weight of popular items in the recommendation score

Answer

Collect more user interaction data over time

Question 10

Which THREE of the following are key components of an AI governance framework?

Accepted Answer

Regular auditing and monitoring for compliance.. Regular auditing and monitoring for compliance (A) is a key component of an AI governance framework because it ensures that AI systems operate within legal, ethical, and organizational policies over time. Continuous monitoring detects drift, bias, or security violations, while audits provide evidence of adherence to standards such as ISO/IEC 42001 or internal governance rules. Without this, governance becomes a static policy with no enforcement or verification.

Answer

Cloud-based deployment for scalability.

Answer

Model accuracy thresholds for production deployment.