AI0-001 AI Implementation and Operations Practice Test 5 — 15 Questions

Question 1

A company uses an AI model to predict equipment failures. The model outputs a probability of failure. To minimize false alarms, the operations team wants a high precision. Which deployment strategy should they implement?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Increase the decision threshold for positive classification. To minimize false alarms and achieve high precision, the operations team should increase the decision threshold for positive classification. A higher threshold means the model only predicts a failure when it is very confident, reducing the number of false positives (false alarms) at the cost of potentially missing some true failures (lower recall). This directly controls the precision-recall trade-off without changing the underlying model.

Answer

Retrain the model on more recent data

Answer

Decrease the decision threshold

Answer

Use an ensemble of models with voting

Question 2

A team is implementing an ML pipeline using a feature store. Which benefit does a feature store primarily provide in an AI operations context?

Accepted Answer

Consistency of feature computation between training and inference. A feature store ensures that feature engineering logic is stored, versioned, and reused consistently across both training and inference pipelines. This eliminates training-serving skew, a common cause of model degradation in production, by guaranteeing that the same transformations are applied to data regardless of when or where it is computed.

Answer

Automated scaling of inference endpoints

Answer

Real-time monitoring of model performance

Answer

Automatic model versioning and rollback

Question 3

Which TWO actions should be taken to ensure an AI model complies with GDPR requirements when processing personal data?

Accepted Answer

Limit data collection to only what is necessary for the model. Option A is correct because GDPR's data minimization principle (Article 5(1)(c)) requires that personal data be adequate, relevant, and limited to what is necessary for the purposes for which it is processed, so restricting collection to only what the model needs directly supports compliance. Option E is correct because GDPR grants data subjects the right to erasure (Article 17, the 'right to be forgotten'), so implementing user data deletion upon request is a mandatory capability for any system processing personal data. Option B is not required by GDPR, which focuses on transparency about processing purposes and logic rather than mandating a full explanation of every model prediction (that concern relates more to interpretability and AI-specific regulation). Option C is wrong because GDPR's storage limitation principle requires data to be kept no longer than necessary, so a 10-year minimum retention period would violate the regulation. Option D is not strictly required because GDPR permits processing of personal data with a lawful basis; anonymization is one way to reduce risk but is not a universal prerequisite, and true anonymization is often impractical for model training.

Answer

Provide a full explanation of model predictions

Answer

Store all user data for a minimum of 10 years

Answer

Anonymize all personal data before use

Question 4

Which THREE factors are most critical to consider when designing a continuous integration/continuous deployment (CI/CD) pipeline for machine learning?

Accepted Answer

Data quality and schema validation. Option A (Data quality and schema validation) is critical because ML pipelines depend on input data distributions and formats; without validating schema, ranges, and drift, training and inference can silently break or degrade. Option C (Automated model performance benchmarking) is essential because a CI/CD pipeline for ML must gate deployments on metrics such as accuracy, F1, RMSE, or latency against a baseline, not just on code tests. Option E (Versioning of datasets, models, and training code) is required for reproducibility and rollback, since ML artifacts are non-deterministic and must be traceable across data, code, hyperparameters, and model binaries. Option B is useful for post-deployment experimentation but is not one of the three most critical pipeline design factors, and Option D, while important for general software CI, is insufficient for ML-specific concerns like data validation, model metrics, and artifact lineage.

Answer

A/B testing framework for comparing models

Answer

Automated unit testing of application code

Question 5

An AI system is being implemented in a healthcare setting. Which TWO ethical considerations should be prioritized?

Accepted Answer

Ensuring the model does not exhibit racial or gender bias. Option A is correct because in a healthcare AI system, ensuring the model does not exhibit racial or gender bias is a core ethical requirement: biased training data or features can produce discriminatory diagnostic or treatment recommendations that harm protected patient groups, violating fairness and equity principles in clinical care. Option C is correct because providing explainable predictions to doctors supports transparency, accountability, and informed clinical decision-making; clinicians must understand the basis of AI recommendations to validate them, obtain patient consent, and meet medical-legal and regulatory obligations. Option B is not an ethical consideration but a financial/business objective, and cost reduction does not justify compromising patient welfare. Option D is not appropriate because replacing human judgment entirely with AI removes clinician oversight and accountability, which is ethically and legally unacceptable in healthcare. Option E is also a cost/licensing concern rather than an ethical priority, and using open-source models does not by itself address fairness, transparency, or patient safety.

Answer

Maximizing cost reduction for the hospital

Answer

Replacing human judgment entirely with AI

Answer

Using open-source models to reduce licensing costs

Question 6

A company deploys a deep learning model for real-time image classification. After deployment, they notice high inference latency exceeding the 100ms SLA. Which action would most likely reduce latency without significantly impacting accuracy?

Accepted Answer

Apply model quantization. Model quantization reduces the precision of the model's weights and activations (e.g., from 32-bit floating point to 8-bit integer), which significantly decreases memory bandwidth and computational requirements during inference. This directly lowers latency without fundamentally altering the model's learned representations, so accuracy degradation is typically minimal (often <1-2%).

Answer

Add more training data to improve model robustness

Answer

Replace the model with a simpler logistic regression model

Answer

Increase batch size for inference

Question 7

An AI system for fraud detection shows a gradual decline in precision over several weeks, though recall remains stable. Which type of model drift is most likely occurring?

Accepted Answer

Concept drift. Concept drift occurs when the statistical relationship between input features and the target variable changes over time, causing the model's decision boundary to become less accurate. In this scenario, precision is declining while recall remains stable, indicating that the model is producing more false positives even though it still catches the same proportion of true positives. This is a classic sign of concept drift, where the underlying definition of fraud has shifted, not the data distribution itself.

Answer

Data drift

Answer

Covariate shift

Answer

Label drift

Question 8

A data science team uses a CI/CD pipeline for ML models. They need to ensure that each model version is traceable back to the exact training data and hyperparameters. Which practice should be implemented?

Accepted Answer

Use a model registry with metadata tracking (e.g., MLflow). A model registry, such as MLflow, serves as a centralized repository that tracks model versions along with metadata like training data snapshots and hyperparameters, ensuring full traceability. Git LFS (Option B) only handles large files, not metadata. Storing artifacts in blob storage with timestamped filenames (Option C) lacks structured tracking and query capabilities. A shared spreadsheet (Option D) is error-prone and not integrated into the CI/CD pipeline.

Answer

Use Git LFS for model files

Answer

Store model artifacts in blob storage with timestamped filenames

Answer

Record hyperparameters in a shared spreadsheet

Question 9

A batch inference pipeline fails intermittently with out-of-memory errors when processing large datasets. The pipeline uses pandas DataFrames and feeds a pre-trained model. Which change would most effectively reduce memory consumption?

Accepted Answer

Split the data into smaller chunks and process sequentially. Splitting a large dataset into smaller chunks and processing them sequentially directly addresses the root cause of the out-of-memory error: the entire dataset is loaded into memory at once via pandas DataFrames. By processing data in batches, each chunk fits within the available RAM, preventing memory exhaustion while still allowing the pipeline to complete the full inference workload.

Answer

Increase the instance size of the compute node

Answer

Use a database instead of CSV files

Answer

Convert the model to use half-precision

Question 10

A company wants to roll out a new recommendation model to production. They decide to run an A/B test where 10% of users see the new model and 90% see the old model. After one week, the new model shows a 5% improvement in click-through rate. What is the next best action?

Accepted Answer

Increase the testing percentage gradually while monitoring performance metrics and guardrails. A 5% improvement observed over only one week with a 10% traffic split is insufficient to confirm statistical significance or rule out novelty effects, data drift, or seasonal bias. The recommended best practice in AI deployment is to gradually increase the testing percentage (e.g., 10% → 25% → 50% → 100%) while continuously monitoring performance metrics and guardrails (e.g., click-through rate, conversion rate, latency, and error rates) to ensure the new model generalizes safely across the full user population.

Answer

Immediately roll out the new model to 100% of users

Answer

Revert to the old model because the improvement is minimal

Answer

Run the test for another month to ensure statistical significance

Question 11

A CI/CD pipeline for a computer vision model uses canary deployment. After deploying a new version to 5% of traffic, the pipeline automatically rolls back due to a spike in error rate. The new model's inference time is 20% higher than the previous version. The operations team finds that the error is caused by timeout in the inference service. Which action should be taken to prevent future rollbacks?

Accepted Answer

Optimize the model using TensorRT or ONNX Runtime before deployment. The root cause of the timeout is the 20% higher inference time of the new model. Optimizing the model using TensorRT or ONNX Runtime reduces inference latency directly, addressing the performance bottleneck that causes timeouts. This prevents the spike in error rate and subsequent rollback without masking the underlying issue.

Answer

Increase the timeout threshold for inference requests

Answer

Implement a fallback to the previous model when timeout occurs

Answer

Reduce the canary percentage to 1% to minimize impact

Question 12

A model serving endpoint is tested using curl commands. Based on the exhibit, what is the most likely issue?

Accepted Answer

The model is experiencing intermittent high latency leading to timeouts. The exhibit shows that the first curl request succeeds (HTTP 200), but subsequent requests fail with 'curl: (28) Operation timed out' after the default timeout of 30 seconds. This pattern of intermittent success followed by timeouts is characteristic of a model experiencing high latency spikes, not a persistent server error or configuration issue. The server is reachable and the model responds correctly some of the time, ruling out deployment or malformed input issues.

Answer

The server is returning HTTP 500 errors

Answer

The input features are malformed

Answer

The model is not deployed on the server

Question 13

Refer to the exhibit. A machine learning pipeline configuration is shown. During a deployment, the model evaluation passes with accuracy 0.86 and precision 0.79. However, the pipeline proceeds to deploy. What is the most likely reason for this behavior?

Accepted Answer

The deployment only checks the accuracy threshold for rollback condition. The pipeline configuration shows a rollback condition that only checks the accuracy metric (accuracy < 0.85). Since the model achieved accuracy 0.86, which is above the threshold, the condition is not triggered, and the pipeline proceeds to deploy regardless of the precision value. The precision metric is not part of the rollback evaluation logic in this configuration.

Answer

The precision metric is not included in the evaluation script

Answer

The deployment target is set to staging instead of production

Answer

The operator manually overrode the threshold

Question 14

Which TWO actions are most appropriate for managing model drift in a production AI system?

Accepted Answer

Periodically retrain the model on recent data. Option C is correct because periodically retraining the model on recent data directly addresses model drift by updating the model's learned parameters to reflect the current data distribution, which is the standard remediation for both data drift and concept drift in production AI systems. Option E is correct because implementing automated monitoring to detect drift indicators (such as statistical divergence in input feature distributions, changes in prediction distributions, or declining accuracy/latency metrics) provides the early-warning capability needed to trigger retraining or rollback before business impact occurs. Option A is incorrect because freezing the model prevents any adaptation and guarantees that drift will progressively degrade performance over time. Option B, while a reasonable incident-response tactic, is not a drift management action in itself since rollback only restores a prior state that will also drift and does not address the underlying distribution change. Option D is incorrect because manually reviewing all predictions is operationally infeasible at production scale and does not systematically detect or correct drift.

Answer

Freeze the model to prevent any changes

Answer

Roll back to a previous model version if performance degrades

Answer

Manually review all model predictions

Question 15

Which TWO techniques should be considered when optimizing a deep learning model for deployment on edge devices with limited computational resources?

Accepted Answer

Model quantization. Model quantization (B) is correct because it reduces the numerical precision of weights and activations (e.g., from FP32 to INT8), shrinking model size and memory bandwidth while enabling faster integer arithmetic on resource-constrained edge hardware. Knowledge distillation (D) is correct because it trains a smaller 'student' model to mimic a larger 'teacher' model, yielding a compact network with far fewer parameters and FLOPs suitable for edge deployment. Adversarial training (A) is a robustness technique against adversarial examples and does not reduce compute or memory footprint. Using a GPU for inference (C) increases power, cost, and hardware requirements, which is counterproductive on constrained edge devices. Increasing the number of layers (E) enlarges the model and raises computational and memory demands, the opposite of optimization.

Answer

Apply adversarial training

Answer

Use a GPU for inference

Answer

Increase the number of layers