You are utilizing Azure Machine Learning to manage a deployment. You detect a sudden drop in model performance due to 'concept drift'. Which specific configuration in the Azure ML Model Monitoring dashboard should be adjusted to better detect this?
Which AI lifecycle stage is most susceptible to the risk of 'data leakage' where training data inadvertently contains information from the future/target?
A practitioner is setting up a model monitoring service in AWS SageMaker Model Monitor. They observe that the ground truth data is significantly delayed. What action ensures risk identification remains effective?
A financial institution uses an AI model to approve loans. After deployment, they notice the model is rejecting loan applications from a specific region at a rate 30% higher than historical human benchmarks. What is the most appropriate next step in the risk lifecycle?
In the context of the Google Cloud Vertex AI Model Registry, what is the best approach to mitigate the risk associated with a model update that performs poorly on edge cases?
During the design phase of a machine learning model, a practitioner identifies that the training dataset has significant underrepresentation of a minority demographic. What is the most effective proactive risk mitigation strategy?
A practitioner is reviewing the 'Model Card' for an AI system. What is the primary purpose of this artifact in the AI lifecycle risk management process?
When managing AI lifecycle risk for a model in a regulated industry, which artifact serves as the most important audit trail for the model's provenance?
A team notices that an AI model's performance decreases when the input data contains abbreviations that were not present in the training set. This is a risk associated with which lifecycle stage?
You are auditing a model's lifecycle and discover that the training data distribution changes every time the model retrains. What is the biggest risk here?
A retail bank's credit-scoring AI was validated on 2023 applicant data and deployed in early 2024. By Q4 2024, portfolio default rates among approved loans have crept up while the model's input feature distributions remain statistically unchanged. The risk team wants to isolate the most probable lifecycle cause before retraining. Which risk management activity best addresses this situation?
An insurer deploys a claims-triage model built by an external vendor. The contract grants the insurer use rights but the vendor refuses to disclose training data composition or feature engineering logic, citing trade secrets. Internal audit must document residual risk before the model enters production. Which action best fulfills the AI risk management obligation given these constraints?
A retail bank's credit-scoring AI was trained on three years of historical loan data. During an ISACA AAIR-aligned risk review, the risk practitioner discovers that the model's training dataset included the final repayment outcomes of loans that were still open at the time of data extraction. Which risk is most directly introduced by this dataset construction?
A hospital deploys a sepsis-prediction model. The AI risk manager learns that the vendor retrained the model on new patient data but the hospital's integration still calls the same endpoint, and no notification was issued. Which lifecycle risk control failure does this most directly represent?
An insurance firm's fraud-detection model was approved after validation on a held-out test set. Six months later, investigators find the model performs poorly on claims submitted through a newly launched mobile channel. Which lifecycle risk management activity should have identified this gap before it affected production?
An AI risk practitioner is designing the human oversight component for a generative AI assistant used by customer service agents. The assistant drafts responses that agents may send after review. Which TWO controls most directly reduce the risk of harmful or non-compliant outputs reaching customers? (Choose two.)
A government agency uses an AI system to triage benefit applications. The risk register lists 'automation bias' as a concern. Which monitoring metric would most directly evidence whether this risk is materialising in practice?