AAIR AI Lifecycle Risk Management Practice Test 2 — 15 Questions

Question 1

When managing AI lifecycle risk for a model in a regulated industry, which artifact serves as the most important audit trail for the model's provenance?

Accepted Answer

The end-to-end model lineage and version control logs.. Model lineage/provenance trackers record the exact data versions and training parameters used for a specific model version.

Answer

The user access logs for the dashboard.

Answer

The model's current latency metrics.

Answer

The cloud provider's billing statement.

Question 2

What is the primary risk objective of 'Model Versioning' in the AI lifecycle?

Accepted Answer

To ensure auditability, reproducibility, and the ability to roll back to a known stable state.. Version control is essential for reproducibility and rollback, minimizing the risk of unrecoverable failures.

Answer

To prevent unauthorized users from viewing the code.

Answer

To reduce the amount of disk space used.

Answer

To increase the model's speed in production.

Question 3

You are assessing risk for an AI model that uses 'Transfer Learning'. What is the most critical risk to manage regarding the pre-trained base model?

Accepted Answer

The base model may have been trained on data that contains inherent, unidentifiable biases.. Transfer learning risks include the inheritance of latent biases from the pre-trained weights.

Answer

The base model cannot be used with custom datasets.

Answer

The base model will always run out of memory.

Answer

The base model requires a proprietary operating system.

Question 4

A team notices that an AI model's performance decreases when the input data contains abbreviations that were not present in the training set. This is a risk associated with which lifecycle stage?

Accepted Answer

Data preprocessing and training design.. This is a Data Quality/Data Representation risk, where the model's understanding of data is limited by the training corpus.

Answer

Infrastructure provisioning.

Answer

Monitoring phase.

Answer

Deployment phase.

Question 5

When a 'Data Drift' alert is triggered in a production environment, what is the first step in the risk management lifecycle?

Accepted Answer

Perform a root cause analysis to verify if the shift is statistical noise or a genuine change in input patterns.. The first step is always to validate the alert to ensure it's not a false positive before taking drastic action.

Answer

Immediately retrain the model.

Answer

Delete all current production logs.

Answer

Roll back to the previous model version.

Question 6

A company is integrating an AI model that uses 'Online Inference'. What is the most significant risk regarding model security?

Accepted Answer

The risk of model inversion attacks on the inference endpoint.. Online inference endpoints are exposed to the public/network, creating surface area for adversarial attacks.

Answer

The risk of the training data being corrupted by the user.

Answer

The risk of high database storage costs.

Answer

The risk of the Python interpreter crashing.

Question 7

A team is designing an AI lifecycle monitoring system. Which metric is most effective for detecting 'Out-of-Distribution' (OOD) risks?

Accepted Answer

Anomaly scores derived from the model's embedding space or activation layers.. OOD detection identifies inputs that are fundamentally different from the distribution the model was trained on.

Answer

Total number of users accessing the model.

Answer

Average request latency.

Answer

The number of lines of code in the model file.

Question 8

In the context of the 'AI Lifecycle', what is the risk of 'Model Decay'?

Accepted Answer

The model's predictions become less accurate because the underlying environment or user behavior changes.. Model decay (or obsolescence) occurs when the environment changes such that the model's learned patterns are no longer valid.

Answer

The model physically degrades over time.

Answer

The model's code becomes deprecated due to language updates.

Answer

The training hardware becomes too slow to run.

Question 9

Which of the following is a primary risk during the 'Deployment' stage of the AI lifecycle?

Accepted Answer

Unexpected performance degradation due to infrastructure differences between development and production.. Deployment involves the risk of performance degradation, infrastructure failure, or unexpected interactions with other systems.

Answer

Cleaning the initial dataset.

Answer

Writing the initial research paper.

Answer

Choosing the wrong programming language.

Question 10

Which THREE factors contribute to 'Data Quality Risk' during the training phase?

Accepted Answer

Incomplete datasets with many missing values.. Incomplete data, selection bias, and incorrect labeling all directly degrade the model's foundation.

Answer

The model is too large for the GPU memory.

Answer

Using the wrong cloud vendor.

Question 11

To mitigate 'Training-Serving Skew' in the AI lifecycle, what is the best practice for data processing pipelines?

Accepted Answer

Use a feature store to ensure consistent feature engineering logic for both stages.. Using a unified feature store ensures that the exact same transformation logic is used for both training and inference.

Answer

Write separate code for training and inference to optimize for speed.

Answer

Use only raw data for both training and inference.

Answer

Train the model on the production server directly.

Question 12

During the 'Training' phase, why is 'Data Splitting' (train/validation/test) crucial for risk management?

Accepted Answer

To evaluate the model's generalization capabilities and mitigate the risk of overfitting.. Data splitting prevents overfitting and provides an unbiased estimate of the model's performance on unseen data.

Answer

To save disk space on the server.

Answer

To increase the training speed.

Answer

To make the model easier to read.

Question 13

A practitioner is managing AI risk in a CI/CD pipeline. What should be the final gate before model promotion to production?

Accepted Answer

Automated performance validation against a hold-out test set with defined threshold gates.. Automated validation of performance metrics against a 'golden dataset' ensures the model meets the required threshold.

Answer

Increasing the memory of the production server.

Answer

Updating the project's documentation.

Answer

A peer review of the training code.

Question 14

Which TWO actions should be taken when a model exhibits significant drift?

Accepted Answer

Perform a root cause analysis to determine the nature of the drift.. The model should be assessed for retraining and the production environment should be audited.

Answer

Disable all logging to improve performance.

Answer

Change the model architecture to something simpler.

Answer

Immediately increase the compute resources.

Question 15

You are auditing a model's lifecycle and discover that the training data distribution changes every time the model retrains. What is the biggest risk here?

Accepted Answer

The model's behavior will be inconsistent and difficult to reproduce, making debugging impossible.. Non-deterministic training data results in unstable models where performance can fluctuate unpredictably.

Answer

The model will require more compute power.

Answer

The model will be too secure.

Answer

The model will be too small.