AI0-001 AI Implementation and Operations Practice Test 6 — 15 Questions

Question 1

Which THREE components are essential for implementing a successful MLOps pipeline for a continuously deployed AI system?

Accepted Answer

Model registry for version control and metadata management. Option C is correct because a model registry provides centralized version control, lineage tracking, and metadata management (e.g., MLflow Model Registry, SageMaker Model Registry), which are essential for reproducible and auditable continuous deployments. Option D is correct because automated testing and validation of models and pipelines (unit tests, data validation, model performance checks, integration tests) are required to catch regressions before promotion in a CI/CD pipeline. Option E is correct because data and model versioning ensures that each deployed artifact can be traced back to the exact training data and model revision, enabling reproducibility and rollback. Option A is not essential because manual approval gates contradict the goal of continuous deployment and slow delivery; automation replaces them. Option B is not essential because canary deployment is a useful release technique but not a required component of every MLOps pipeline.

Answer

Manual approval gates for each deployment

Answer

Canary deployment strategy

Question 2

A company has developed a deep learning model for image classification. The team wants to deploy the model to production with high availability and scalability. Which approach should they use?

Accepted Answer

Use a containerized approach with Kubernetes.. Containerization with Kubernetes provides the orchestration, auto-scaling, and self-healing capabilities required for high availability and scalability in production. Kubernetes manages container lifecycles, distributes traffic across replicas via Services and Ingress controllers, and can automatically scale pods based on CPU/memory metrics or custom metrics, ensuring the deep learning model handles variable loads without downtime.

Answer

Run the model on a laptop during business hours.

Answer

Deploy the model as a monolithic application on a single server.

Answer

Embed the model directly into a mobile app.

Question 3

A financial institution needs to integrate an AI-based credit scoring model into an existing mainframe system that processes transactions in COBOL. The model is deployed as a REST API. What is the best strategy to ensure minimal disruption and maintain data integrity?

Accepted Answer

Use an API gateway with versioning and circuit breaker patterns.. An API gateway with versioning and circuit breaker patterns allows the COBOL mainframe to call the REST API without modifying its core transaction logic. The gateway handles protocol translation, rate limiting, and failover, ensuring minimal disruption to the existing mainframe system while maintaining data integrity through transactional consistency and graceful degradation.

Answer

Copy all transaction data to a cloud database for the model to access.

Answer

Rewrite the mainframe system in Java to directly call the model.

Answer

Install a GPU on the mainframe to run the model natively.

Question 4

During model training, the data science team discovers that many input features contain missing values. Which step should be taken to improve data quality?

Accepted Answer

Implement data validation checks to handle missing data appropriately (e.g., imputation).. Data validation checks, such as imputation (e.g., mean, median, or KNN imputation), directly address missing values by estimating plausible replacements based on the available data. This improves data quality and prevents bias or loss of information that could degrade model performance. In the context of AI implementation, handling missing data is a fundamental data preprocessing step to ensure robust model training.

Answer

Increase the model complexity to handle missing data.

Answer

Ignore missing values and train the model.

Answer

Remove all records with missing values.

Question 5

A healthcare AI system that diagnoses medical images must provide explanations for its predictions to comply with regulatory requirements. Which technique should the team implement?

Accepted Answer

Apply model interpretability methods such as SHAP or LIME.. SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-agnostic Explanations) are established model interpretability techniques that provide per-prediction explanations, which are essential for regulatory compliance in healthcare AI. These methods generate feature attribution scores or local surrogate models to explain why a specific diagnosis was made, meeting transparency requirements without sacrificing model performance.

Answer

Reduce the model's accuracy to make it simpler.

Answer

Only deploy rule-based systems.

Answer

Use a more complex deep learning model.

Question 6

A team of data scientists and engineers is working on multiple AI projects. They often struggle to reproduce experiments and manage model versions. Which tool or practice should they adopt?

Accepted Answer

Use an MLOps platform that provides version control, tracking, and reproducibility.. An MLOps platform (e.g., MLflow, Kubeflow, or Vertex AI) provides integrated version control for code, data, and models, along with experiment tracking and reproducibility. This directly addresses the team's struggle to reproduce experiments and manage model versions by automating lineage capture and enabling consistent environment recreation.

Answer

Document experiments in a shared Word document.

Answer

Share code via email attachments.

Answer

Keep all models in a shared network drive.

Question 7

An AI system used for hiring has been found to exhibit racial bias against certain candidates. Which step should the organization take to mitigate this?

Accepted Answer

Regularly audit model predictions across demographic groups and retrain with fairness constraints.. Bias in AI systems is often embedded in training data or model behavior, not just in feature selection. Regularly auditing predictions across demographic groups and retraining with fairness constraints (e.g., demographic parity or equalized odds) allows the organization to detect and correct disparate impact without sacrificing model performance. This aligns with the AI0-001 focus on continuous monitoring and iterative improvement in AI operations.

Answer

Remove all demographic features from the model.

Answer

Use a different algorithm that is inherently unbiased.

Answer

Hire more diverse data scientists.

Question 8

Based on the exhibit, what is the most likely cause of the pod failure and its solution?

Accepted Answer

The container memory limit is too low; increase the memory limit in the pod spec.. The pod failure is caused by an OOMKilled (Out of Memory) error, as indicated by the pod status in the exhibit. When a container exceeds its memory limit, Kubernetes terminates it with an OOMKilled exit code. Increasing the memory limit in the pod spec allows the container to allocate more memory, resolving the failure.

Answer

The node has insufficient CPU; add more CPU.

Answer

The pod is configured with wrong GPU drivers; update drivers.

Answer

The model is too large; use a smaller model.

Question 9

Based on the exhibit, which action is most likely to resolve the memory issue?

Accepted Answer

Reduce the batch size.. The exhibit shows an out-of-memory (OOM) error during training. Reducing the batch size decreases the memory footprint per iteration, allowing the model to fit within available GPU memory. This directly resolves the memory issue without altering the model architecture or data.

Answer

Add more training data.

Answer

Increase the learning rate.

Answer

Switch to a CPU.

Question 10

Which TWO of the following are best practices for monitoring AI models in production?

Accepted Answer

Set up alerts for prediction latency and error rates.. Option A is correct because production monitoring must include operational health metrics such as prediction latency and error rates, which surface service degradation, timeouts, and failed inferences before they impact users. Option E is correct because tracking input data distribution and comparing it against the training data detects data drift and covariate shift, which are leading indicators that model accuracy will degrade even when infrastructure metrics look healthy. Together, A and E cover both system-level reliability and statistical/data-quality monitoring, which are the two core pillars of effective ML observability. Option B is not a best practice because accuracy measured only at deployment time cannot reveal post-deployment degradation caused by drift or changing real-world conditions. Option C is wrong because retraining without validating performance can silently deploy a worse model and provides no monitoring signal. Option D is wrong because freezing the model version does not address monitoring needs and prevents necessary updates when drift or performance decay is detected.

Answer

Monitor model accuracy only at deployment time.

Answer

Regularly retrain without checking performance.

Answer

Freeze the model version once deployed to avoid changes.

Question 11

Which THREE components are essential in an MLOps pipeline?

Accepted Answer

Data versioning. Data versioning (A) is essential in an MLOps pipeline because machine learning outcomes depend on the exact dataset used, so tools like DVC or MLflow must track dataset and feature versions to make training reproducible and auditable. Deployment automation (C) is essential because MLOps requires continuous delivery of retrained models to serving infrastructure via CI/CD pipelines, enabling repeatable, low-risk releases rather than manual handoffs. Automated model testing (E) is essential because models must be validated automatically for accuracy, bias, and regression against baselines before promotion, which is a core MLOps quality gate. Manual code review (B) is a good practice but not an essential MLOps component, since pipelines rely on automated checks, and hardware procurement (D) is an infrastructure/procurement activity outside the MLOps pipeline itself.

Answer

Manual code review

Answer

Hardware procurement

Question 12

A company is deploying a fraud detection model that must return predictions within 100ms to avoid transaction delays. The team is deciding between batch and real-time inference. Which factor most strongly supports a real-time inference architecture?

Accepted Answer

The application requires immediate feedback for each transaction. Real-time inference is required when the application must return predictions within strict latency bounds (e.g., 100ms) to avoid transaction delays. The need for immediate feedback per transaction directly aligns with a real-time architecture, where each request is processed individually as it arrives, rather than waiting for a batch window. Batch inference would introduce unacceptable latency because it processes groups of records on a schedule, not on-demand.

Answer

The model requires large amounts of historical data for each prediction

Answer

The infrastructure budget is limited and must be optimized

Answer

The model can be retrained weekly using gathered data

Question 13

An MLOps team uses a CI/CD pipeline to automate model retraining. The pipeline triggers on new labeled data, runs feature engineering, retrains the model, evaluates against a holdout set, and deploys if metrics exceed thresholds. Recently, a retrained model passed validation but caused a 5% accuracy drop in production. Which improvement best prevents this?

Accepted Answer

Implement canary deployment with shadow scoring to compare with current model. Canary deployment with shadow scoring allows the new model to serve predictions to a small subset of traffic while comparing its outputs against the current production model in real time, without affecting all users. This catches subtle data drift or concept drift that a static holdout set may miss, preventing the 5% accuracy drop from reaching full production.

Answer

Require manual approval before deployment

Answer

Use the entire production dataset for validation instead of a holdout set

Answer

Increase the amount of training data used in each retraining cycle

Question 14

Refer to the exhibit. The monitoring dashboard for a deployed churn prediction model shows a drift detected flag. However, the error rate and latency are within acceptable ranges. What is the most appropriate immediate action?

Accepted Answer

Investigate the type and severity of drift before deciding. When drift is detected but performance metrics like error rate and latency are still acceptable, it is important to investigate the type and severity of drift before taking any action. Drift may be benign or may indicate a shift that will eventually degrade performance. Option A is wrong because automatic retraining could be risky if the drift is temporary or benign. Option B is wrong because rolling back immediately discards potential improvements and could be unnecessary. Option C is wrong because ignoring drift may lead to future degradation.

Answer

Trigger automatic retraining using the latest data

Answer

Roll back to the previous model version immediately

Answer

Ignore the drift since performance metrics are stable

Question 15

A global retailer uses an AI model to forecast demand across thousands of stores. After deployment, the model's predictions become less accurate during holiday seasons. The training data included two years of holiday periods. What is the most effective operational strategy to handle this recurring seasonal drift?

Accepted Answer

Implement a scheduled retraining cycle just before each holiday period. Scheduled retraining just before each holiday season directly addresses the recurring seasonal drift by updating the model with the most recent holiday data patterns. This is the most effective operational strategy because it proactively aligns the model with the known, periodic shift in demand behavior, rather than reacting to errors or relying on static historical data.

Answer

Deploy an anomaly detection system to flag holiday prediction outliers

Answer

Use an ensemble of models trained on different time periods

Answer

Increase the volume of training data by including five years of history