AAIR Practice Exam 2 — 20 Questions

Question 1

Which THREE items should be included in an AI 'Risk Assessment' report for a new project?

Accepted Answer

Identification of potential failure modes and their impact.. A complete report covers the risk identification, the impact analysis, and the control strategy.

Answer

The favorite color of the lead developer.

Answer

A list of all competitors currently using the same software.

Question 2

You are performing a 'Model Drift' analysis. Which metric is most indicative of performance degradation without access to real-time ground truth?

Accepted Answer

Kullback-Leibler (KL) Divergence between training and inference feature distributions.. Statistical distribution shifts (like KL Divergence) in input data serve as a proxy for performance degradation.

Answer

The number of concurrent API requests.

Answer

The memory consumption of the container.

Answer

Model accuracy on historical data.

Question 3

When managing AI lifecycle risk for a model in a regulated industry, which artifact serves as the most important audit trail for the model's provenance?

Accepted Answer

The end-to-end model lineage and version control logs.. Model lineage/provenance trackers record the exact data versions and training parameters used for a specific model version.

Answer

The user access logs for the dashboard.

Answer

The model's current latency metrics.

Answer

The cloud provider's billing statement.

Question 4

Which of the following is a primary risk during the 'Deployment' stage of the AI lifecycle?

Accepted Answer

Unexpected performance degradation due to infrastructure differences between development and production.. Deployment involves the risk of performance degradation, infrastructure failure, or unexpected interactions with other systems.

Answer

Cleaning the initial dataset.

Answer

Writing the initial research paper.

Answer

Choosing the wrong programming language.

Question 5

Which TWO of the following scenarios represent 'Data Quality Risk'?

Accepted Answer

Training data is from a 5-year-old dataset that is no longer representative.. Inconsistent formatting and lack of temporal relevance are clear data quality issues.

Answer

The model is deployed on a slow network.

Answer

The model is written in a new programming language.

Answer

The model uses a popular open-source library.

Question 6

A retail company uses an AI model for dynamic pricing. The model's risk score recently exceeded the 'Moderate' threshold. As per the AI Governance framework, what is the mandatory next step?

Accepted Answer

Perform an mandatory AI model risk assessment and escalate to the Governance Committee.. When an AI risk score crosses a predefined threshold, escalation to the risk committee or manual oversight is required.

Answer

Automatically disable the model.

Answer

Continue operation while monitoring for additional errors.

Answer

Update the training data set to improve the score.

Question 7

An organization is using a centralized AI Governance structure. What is the biggest risk of this approach compared to a decentralized one?

Accepted Answer

Operational bottlenecks and delayed AI project timelines.. Centralization can create 'bottlenecks' that slow down innovation and delay deployment.

Answer

Higher infrastructure costs.

Answer

Lack of standardized policy.

Answer

Increased risk of shadow AI.

Question 8

When integrating AI risk into the corporate GRC (Governance, Risk, and Compliance) platform, what is the best practice for handling 'AI Model Drift' alerts?

Accepted Answer

Integrate drift alerts as risk indicators in the GRC platform for automated tracking.. Model drift alerts should be categorized as risk indicators and integrated into the GRC's automated incident response or reporting workflow.

Answer

Send all alerts to the help desk.

Answer

Ignore drift alerts until a manual audit happens annually.

Answer

Disable the alerts to prevent 'alert fatigue'.

Question 9

When an AI model is updated (e.g., retrained on new data), what action is required from an AI Risk Governance perspective?

Accepted Answer

The model should be re-validated to ensure it still meets risk thresholds.. Any significant change to an AI model triggers a re-validation or reassessment to ensure the new version is still within risk thresholds.

Answer

The model should be renamed to show it is a new version.

Answer

No action is needed as the underlying architecture is unchanged.

Answer

The model should be automatically deployed without review.

Question 10

Why is 'Model Validation' (distinct from testing) essential in an AI Governance framework?

Accepted Answer

To provide independent assurance that the model performs as expected and within risk thresholds.. Validation is the independent verification that a model meets its intended purpose and risk performance requirements.

Answer

To ensure the developers have followed the coding standards.

Answer

To save money on cloud hosting.

Answer

To speed up the coding process.

Question 11

Which document should a practitioner review to determine the organization's threshold for acceptable AI model bias?

Accepted Answer

The Enterprise Risk Appetite Statement.. The Risk Appetite Statement is the formal document approved by the board or senior management that defines the level of risk the organization is willing to accept in pursuit of objectives, including AI-specific tolerances.

Answer

The vendor's Service Level Agreement (SLA).

Answer

The software's End User License Agreement (EULA).

Answer

The AI development team's sprint backlog.

Question 12

Which THREE risks are associated with 'Automated Deployment' of AI models without a human-in-the-loop?

Accepted Answer

Rapid propagation of faulty or biased models to production.. Without human checks, bad models can propagate quickly, causing cascading failures and security gaps.

Answer

The deployment takes too long to run.

Answer

Increased use of disk space.

Question 13

A company is deploying an AI system that interacts with human users. According to the AI RMF, what should be the focus of the 'Map' function in the risk governance process?

Accepted Answer

Identifying stakeholders, intended use, and potential human impacts.. Mapping involves understanding the context, intended use, and the human-AI interaction points to identify potential harms.

Answer

Choosing the most efficient algorithm.

Answer

Selecting the cloud service provider.

Answer

Calculating the total budget for the project.

Question 14

A board of directors requests a dashboard view of AI model drift. Which metric is most appropriate for a board-level risk report?

Accepted Answer

Feature drift threshold violations. The board requires high-level risk indicators rather than granular performance metrics like F1 scores.

Answer

Mean Squared Error (MSE)

Answer

GPU utilization percentage

Answer

Latency per inference request

Question 15

Which document is the primary reference for defining an organization's AI Risk Governance structure?

Accepted Answer

The AI Governance Charter/Policy.. The AI Governance Policy or Charter establishes the roles, responsibilities, and decision-making authorities for AI risk.

Answer

The IT hardware inventory report.

Answer

The employee handbook.

Answer

The AI project development backlog.

Question 16

Which TWO of the following are considered 'High-Risk' AI use cases that require enhanced oversight by the Governance Committee?

Accepted Answer

AI-powered biometric identification for facility access.. AI systems impacting physical safety or fundamental rights require the highest level of governance oversight.

Answer

Basic spell-checking software.

Answer

Email auto-complete features.

Answer

AI systems used for internal cafeteria menu suggestions.

Question 17

Which of the following is an example of 'Data Quality Risk' in the AI lifecycle?

Accepted Answer

High rates of mislabeled training data.. Data quality risk includes issues like missing values, noisy data, or incorrect labeling that degrade model performance.

Answer

Setting a high learning rate.

Answer

Using Python instead of R.

Answer

Using a GPU that is two generations old.

Question 18

In the context of the 'AI Lifecycle', what is the risk of 'Model Decay'?

Accepted Answer

The model's predictions become less accurate because the underlying environment or user behavior changes.. Model decay (or obsolescence) occurs when the environment changes such that the model's learned patterns are no longer valid.

Answer

The model physically degrades over time.

Answer

The model's code becomes deprecated due to language updates.

Answer

The training hardware becomes too slow to run.

Question 19

You are auditing a model's lifecycle and discover that the training data distribution changes every time the model retrains. What is the biggest risk here?

Accepted Answer

The model's behavior will be inconsistent and difficult to reproduce, making debugging impossible.. Non-deterministic training data results in unstable models where performance can fluctuate unpredictably.

Answer

The model will require more compute power.

Answer

The model will be too secure.

Answer

The model will be too small.

Question 20

Which THREE artifacts should be reviewed during a post-incident AI risk analysis?

Accepted Answer

The original Model Card and documentation.. Model lineage, inference logs, and the original model card are critical for understanding *what* happened.

Answer

The employee training certificates.

Answer

The building access logs for the data center.