AI0-001 AI Implementation and Operations Practice Test 6 — 15 Questions

Question 1

An AI system used for hiring has been found to exhibit racial bias against certain candidates. Which step should the organization take to mitigate this?

Accepted Answer

Regularly audit model predictions across demographic groups and retrain with fairness constraints.. Bias in AI systems is often embedded in training data or model behavior, not just in feature selection. Regularly auditing predictions across demographic groups and retraining with fairness constraints (e.g., demographic parity or equalized odds) allows the organization to detect and correct disparate impact without sacrificing model performance. This aligns with the AI0-001 focus on continuous monitoring and iterative improvement in AI operations.

Answer

Remove all demographic features from the model.

Answer

Use a different algorithm that is inherently unbiased.

Answer

Hire more diverse data scientists.

Question 2

A company operating in the EU must comply with GDPR. An AI model processes personal data for customer segmentation. Which of the following ensures compliance?

Accepted Answer

Implement data anonymization and allow users to request deletion.. GDPR mandates that personal data must be processed lawfully, with data minimization and the right to erasure. Implementing data anonymization removes personally identifiable information (PII) so the data is no longer considered personal data under GDPR, and allowing users to request deletion directly satisfies the 'right to be forgotten' (Article 17). This approach ensures compliance by both protecting individual privacy and providing a mechanism for data subjects to exercise their legal rights.

Answer

Obtain explicit consent once and use data indefinitely.

Answer

Store personal data permanently for model improvement.

Answer

Use only aggregated data without any individual records.

Question 3

Based on the exhibit, what is the most likely cause of the pod failure and its solution?

Accepted Answer

The container memory limit is too low; increase the memory limit in the pod spec.. The pod failure is caused by an OOMKilled (Out of Memory) error, as indicated by the pod status in the exhibit. When a container exceeds its memory limit, Kubernetes terminates it with an OOMKilled exit code. Increasing the memory limit in the pod spec allows the container to allocate more memory, resolving the failure.

Answer

The node has insufficient CPU; add more CPU.

Answer

The pod is configured with wrong GPU drivers; update drivers.

Answer

The model is too large; use a smaller model.

Question 4

Based on the exhibit, which action is most likely to resolve the memory issue?

Accepted Answer

Reduce the batch size.. The exhibit shows an out-of-memory (OOM) error during training. Reducing the batch size decreases the memory footprint per iteration, allowing the model to fit within available GPU memory. This directly resolves the memory issue without altering the model architecture or data.

Answer

Add more training data.

Answer

Increase the learning rate.

Answer

Switch to a CPU.

Question 5

Which TWO deployment strategies allow for testing a new model version before fully rolling it out?

Accepted Answer

Canary deployment. Canary deployment is correct because it routes a small percentage of live traffic to the new model version while the majority continues using the stable version. This allows real-world validation of the new model's performance and error rates under production load before a full rollout, minimizing blast radius if issues arise.

Answer

Shadow deployment

Answer

Direct cutover

Answer

Blue-Green deployment

Question 6

Which THREE components are essential in an MLOps pipeline?

Accepted Answer

Data versioning. Data versioning (A) is essential in an MLOps pipeline because it ensures reproducibility and traceability of datasets used for training, validation, and testing. Without versioning, changes to data cannot be tracked, leading to inconsistent model behavior and difficulty in debugging. Tools like DVC or Git LFS enable precise snapshotting of data, which is critical for auditing and rollback in production AI systems.

Answer

Manual code review

Answer

Hardware procurement

Question 7

A data science team deployed a model for real-time predictions. After two weeks, the model's accuracy dropped from 92% to 80%. The monitoring system shows no data drift in features, but the target variable distribution has shifted. Which approach should the team use to detect this issue?

Accepted Answer

Monitor the distribution of the predicted target variable over time. Monitoring the distribution of the predicted target variable directly detects concept drift, which occurs when the relationship between features and the target changes. Since the monitoring system shows no data drift in features, the accuracy drop is likely due to a shift in the target variable's distribution, and tracking predictions over time reveals this shift. This approach aligns with MLOps best practices for detecting concept drift without requiring immediate retraining.

Answer

Schedule manual weekly reviews of model predictions

Answer

Retrain the model immediately with new data

Answer

Monitor input feature distributions using a KS test

Question 8

A company is deploying a fraud detection model that must return predictions within 100ms to avoid transaction delays. The team is deciding between batch and real-time inference. Which factor most strongly supports a real-time inference architecture?

Accepted Answer

The application requires immediate feedback for each transaction. Real-time inference is required when the application must return predictions within strict latency bounds (e.g., 100ms) to avoid transaction delays. The need for immediate feedback per transaction directly aligns with a real-time architecture, where each request is processed individually as it arrives, rather than waiting for a batch window. Batch inference would introduce unacceptable latency because it processes groups of records on a schedule, not on-demand.

Answer

The model requires large amounts of historical data for each prediction

Answer

The infrastructure budget is limited and must be optimized

Answer

The model can be retrained weekly using gathered data

Question 9

An MLOps team uses a CI/CD pipeline to automate model retraining. The pipeline triggers on new labeled data, runs feature engineering, retrains the model, evaluates against a holdout set, and deploys if metrics exceed thresholds. Recently, a retrained model passed validation but caused a 5% accuracy drop in production. Which improvement best prevents this?

Accepted Answer

Implement canary deployment with shadow scoring to compare with current model. Canary deployment with shadow scoring allows the new model to serve predictions to a small subset of traffic while comparing its outputs against the current production model in real time, without affecting all users. This catches subtle data drift or concept drift that a static holdout set may miss, preventing the 5% accuracy drop from reaching full production.

Answer

Require manual approval before deployment

Answer

Use the entire production dataset for validation instead of a holdout set

Answer

Increase the amount of training data used in each retraining cycle

Question 10

Refer to the exhibit. A team created an access policy for a fraud detection model endpoint. An intern reports being unable to access the model for testing. Reviewing the policy, what is the most likely cause?

Accepted Answer

The intern's role is explicitly denied in the policy. The exhibit shows an explicit `Deny` effect for the intern's role in the policy. In AWS IAM (or similar cloud provider) access policies, an explicit deny overrides any allow, so even if the intern's role is listed in allowed roles, the explicit deny will block access. This is a fundamental principle of IAM policy evaluation logic.

Answer

The intern's role is not included in the allowed roles

Answer

The policy JSON has a syntax error

Answer

The endpoint path is incorrect

Question 11

A global retailer uses an AI model to forecast demand across thousands of stores. After deployment, the model's predictions become less accurate during holiday seasons. The training data included two years of holiday periods. What is the most effective operational strategy to handle this recurring seasonal drift?

Accepted Answer

Implement a scheduled retraining cycle just before each holiday period. Scheduled retraining just before each holiday season directly addresses the recurring seasonal drift by updating the model with the most recent holiday data patterns. This is the most effective operational strategy because it proactively aligns the model with the known, periodic shift in demand behavior, rather than reacting to errors or relying on static historical data.

Answer

Deploy an anomaly detection system to flag holiday prediction outliers

Answer

Use an ensemble of models trained on different time periods

Answer

Increase the volume of training data by including five years of history

Question 12

An organization deploys an AI model on edge devices for real-time image classification. Which metric is most important to monitor for ensuring the device's operational health?

Accepted Answer

Inference memory consumption. For edge devices with limited resources, inference memory consumption is the most critical operational health metric because exceeding available memory can cause the model to crash or the device to become unresponsive. Unlike accuracy or confidence, memory usage directly reflects whether the device can sustain real-time inference without resource exhaustion.

Answer

Model calibration error

Answer

Average prediction confidence

Answer

Model accuracy on local test data

Question 13

A healthcare company must deploy a diagnostic AI model that uses protected health information (PHI). To comply with HIPAA, the operations team needs to ensure data privacy during model inference. Which practice should be implemented?

Accepted Answer

Encrypt all PHI at rest and in transit within the inference pipeline. HIPAA mandates encryption of protected health information (PHI) both at rest and in transit to safeguard data confidentiality during model inference. Encrypting the entire inference pipeline ensures that even if data is intercepted or accessed without authorization, it remains unreadable. This practice directly addresses the compliance requirement for data privacy without relying on network location or partial obfuscation.

Answer

Run the model on-premises to avoid cloud data transmission

Answer

Mask sensitive fields in the input data before inference

Answer

Apply differential privacy during model training only

Question 14

An MLOps team automates model deployment with a CI/CD pipeline. A performance regression is detected after deploying a new model version. The team needs to automatically roll back to the previous version. Which approach best enables safe automated rollback?

Accepted Answer

Use a blue/green deployment with automated health checks and traffic switching. Blue/green deployment with automated health checks and traffic switching is the best approach because it allows the team to instantly route all traffic back to the previous (green) environment if the new (blue) version fails health checks. This ensures zero-downtime rollback without manual intervention, directly addressing the need for safe automated rollback in a CI/CD pipeline.

Answer

Maintain a manual rollback script that the operations team can run

Answer

Deploy new models as canary releases and monitor for 24 hours

Answer

Automatically keep the previous model version in storage for later use

Question 15

Which TWO are best practices for deploying AI models in a containerized production environment? (Select TWO.)

Accepted Answer

Use an orchestration platform like Kubernetes for scaling and health management. Orchestration platforms like Kubernetes provide automated scaling, self-healing, and rolling updates for containerized AI models. Kubernetes uses liveness and readiness probes to monitor model health and restart failed containers, ensuring high availability in production.

Answer

Always pull the latest image tag for automatic updates

Answer

Store model artifacts inside the container image for portability

Answer

Configure JVM heap arguments inside the container if using Java