AI0-001 Practice Test 19 — 15 Questions

Question 1

A company's AI governance board requires each model to have a model card documenting intended use, performance metrics, and limitations. What is the primary purpose of a model card?

Accepted Answer

To provide transparent documentation of model capabilities and limitations. A model card is a standardized documentation framework that provides transparent, concise information about a machine learning model's intended use, performance metrics, and limitations. This transparency enables stakeholders to understand the model's capabilities and potential biases, ensuring responsible deployment and governance as required by AI ethics and governance frameworks.

Answer

To specify the exact training algorithm and hyperparameters

Answer

To outline a complete risk assessment framework

Answer

To serve as a legal contract between developers and users

Question 2

A data science team is developing a churn prediction model. Which TWO data preparation best practices are MOST important to prevent overfitting and ensure generalization?

Accepted Answer

Split data into training and test sets before any preprocessing. Option A is correct because splitting into training and test sets before any preprocessing prevents data leakage: statistics such as means, standard deviations, or encodings must be learned only from the training set and then applied to the test set, otherwise the model indirectly sees test data and overfitting goes undetected. Option C is correct because cross-validation (e.g., k-fold) tunes hyperparameters on multiple training/validation splits, giving a more reliable estimate of generalization performance and reducing the chance of selecting hyperparameters that overfit a single validation split. Option B is not appropriate because normalizing with statistics computed from the entire dataset leaks test-set information into training; normalization statistics should come from the training fold only. Option D is not appropriate because removing outliers based on the full dataset distribution also leaks test information and can distort the true data distribution; outlier handling should be based on training data. Option E is not appropriate because target encoding on the full dataset leaks the target variable into the features, a classic cause of overfitting; target encoding must be fit within training folds, ideally with smoothing or out-of-fold encoding.

Answer

Normalize all features using the entire dataset's statistics

Answer

Remove outliers based on the full dataset distribution

Answer

Encode categorical variables with target encoding on the full dataset

Question 3

A batch inference pipeline fails intermittently with out-of-memory errors when processing large datasets. The pipeline uses pandas DataFrames and feeds a pre-trained model. Which change would most effectively reduce memory consumption?

Accepted Answer

Split the data into smaller chunks and process sequentially. Splitting a large dataset into smaller chunks and processing them sequentially directly addresses the root cause of the out-of-memory error: the entire dataset is loaded into memory at once via pandas DataFrames. By processing data in batches, each chunk fits within the available RAM, preventing memory exhaustion while still allowing the pipeline to complete the full inference workload.

Answer

Increase the instance size of the compute node

Answer

Use a database instead of CSV files

Answer

Convert the model to use half-precision

Question 4

A team is building a recommendation system for an e-commerce platform. They want to use collaborative filtering but have a cold-start problem for new users. Which hybrid approach BEST addresses cold start while leveraging collaborative signals?

Accepted Answer

Implement a hybrid model that combines content-based features with collaborative filtering via a weighted ensemble. A weighted ensemble hybrid combines content-based features (which can profile a brand-new user from their stated preferences, demographics, or first-item interactions) with collaborative filtering signals (which capture behavioral patterns from similar users). This directly mitigates cold start because the content-based component can generate recommendations before enough interaction data exists for collaborative filtering, while the collaborative component takes over as behavioral data accumulates. Pure collaborative filtering fails for new users because there is no interaction history to compute similarities.

Answer

Apply user clustering based on demographic data and then use collaborative filtering within clusters

Answer

Use only content-based filtering for all users

Answer

Use matrix factorization with implicit feedback only

Question 5

A machine learning team is deploying a model that predicts customer churn. They notice that the model's predictions are highly sensitive to small changes in input features, leading to inconsistent outputs. Which technique should the team apply to improve model stability?

Accepted Answer

Regularization. Regularization (Option C) is the correct technique because it adds a penalty term to the loss function (e.g., L1 or L2 regularization), which constrains the model's weights. This reduces variance and prevents overfitting to noise in the training data, directly addressing the high sensitivity to small input changes (brittleness). By shrinking coefficients, regularization forces the model to learn more general patterns, improving stability and consistency in predictions.

Answer

Increase learning rate

Answer

Feature scaling

Answer

Cross-validation

Question 6

An organization is deploying a machine learning model that classifies loan applications. They want to prevent an attacker from reconstructing individual customer records from the model's predictions. Which type of attack should they defend against?

Accepted Answer

Model inversion. Model inversion attacks allow an attacker to reconstruct the original training data by analyzing the model's predictions. In this scenario, the attacker could use the model's outputs to infer sensitive details about individual loan applicants, such as income or credit history, violating privacy. Defending against model inversion is critical when predictions can be used to reverse-engineer private training records.

Answer

Membership inference

Answer

Data poisoning

Answer

Adversarial example

Question 7

During a security audit of an AI system, the auditor applies the STRIDE threat model. Which threat category is MOST relevant to an attacker manipulating the training data to cause the model to misbehave on specific inputs?

Accepted Answer

Tampering. Tampering refers to unauthorized modification of data or code. Data poisoning is a form of tampering with the training dataset.

Answer

Spoofing

Answer

Repudiation

Answer

Information disclosure

Question 8

A team is training a image classification model. They split the dataset into training, validation, and test sets. After training, the model achieves 98% accuracy on the training set but only 72% on the test set. Which step in the AI project lifecycle should the team focus on?

Accepted Answer

Model selection – use regularization or reduce model complexity. The 98% training accuracy versus 72% test accuracy is a classic signature of overfitting — the model has memorized the training data rather than learning generalizable patterns. The appropriate lifecycle response is to address model complexity through regularization (L1/L2, dropout, early stopping) or by reducing the number of parameters/layers. This directly targets the generalization gap rather than the data pipeline or deployment.

Answer

Data acquisition – collect more data

Answer

Deployment – re-deploy with a different serving framework

Answer

Data preparation – check for train/test leakage

Question 9

A company uses linear regression to predict sales based on advertising spend. The model's residuals show a pattern of increasing variance as spend increases. Which assumption of linear regression is violated?

Accepted Answer

Homoscedasticity. The pattern of increasing residual variance with higher advertising spend violates the assumption of homoscedasticity, which requires constant variance of errors across all levels of the independent variable. In linear regression, heteroscedasticity like this can lead to inefficient coefficient estimates and unreliable confidence intervals, often detected via a Breusch-Pagan test or residual plot analysis.

Answer

Normality

Answer

Linearity

Answer

Independence

Question 10

Which THREE components are essential for implementing a successful MLOps pipeline for a continuously deployed AI system?

Accepted Answer

Model registry for version control and metadata management. Option C is correct because a model registry provides centralized version control, lineage tracking, and metadata management (e.g., MLflow Model Registry, SageMaker Model Registry), which are essential for reproducible and auditable continuous deployments. Option D is correct because automated testing and validation of models and pipelines (unit tests, data validation, model performance checks, integration tests) are required to catch regressions before promotion in a CI/CD pipeline. Option E is correct because data and model versioning ensures that each deployed artifact can be traced back to the exact training data and model revision, enabling reproducibility and rollback. Option A is not essential because manual approval gates contradict the goal of continuous deployment and slow delivery; automation replaces them. Option B is not essential because canary deployment is a useful release technique but not a required component of every MLOps pipeline.

Answer

Manual approval gates for each deployment

Answer

Canary deployment strategy

Question 11

Which TWO are characteristics of supervised learning?

Accepted Answer

Requires labeled data. Option B is correct because supervised learning fundamentally requires a labeled dataset, where each training example is paired with a known target (ground-truth) value that the model learns to map inputs to. Option E is correct because supervised models are trained to predict an output that is either continuous (regression, e.g., predicting a price) or categorical (classification, e.g., predicting a class label). Option A is incorrect because the absence of a target variable describes unsupervised learning, not supervised learning. Option C is incorrect because reinforcement signals (rewards/penalties from an environment) characterize reinforcement learning, a separate paradigm. Option D is incorrect because clustering is an unsupervised task that discovers structure without labeled targets.

Answer

Does not require target variable

Answer

Uses reinforcement signals

Answer

Learns to cluster data

Question 12

A logistics company uses a machine learning model to predict delivery times based on historical data. The model was performing well, but recently it started making inaccurate predictions, especially for routes that have experienced new traffic patterns and road closures. The data engineering team receives an alert that the model's accuracy has dropped by 15% over the last week. They suspect data drift. The team has access to the original training data and a continuous stream of new data. What is the most appropriate first step for the team to take?

Accepted Answer

Compare the distributions of key features between the training data and the recent data to quantify data drift.. The first step in diagnosing a suspected data drift is to statistically compare the distributions of key features between the training data and the recent streaming data. This quantifies whether the input data distribution has changed, which directly explains the accuracy drop. Without this analysis, any corrective action (like retraining or rollback) would be premature and could mask the root cause.

Answer

Roll back the model to the previous stable version and schedule a full audit of the data pipeline.

Answer

Immediately retrain the model using the most recent data to adapt to the new patterns.

Answer

Add more features to the model to capture the new traffic patterns and road closures.

Question 13

A company using an AI-based hiring tool receives a candidate request for explanation of an automated rejection. Which GDPR principle is most directly relevant?

Accepted Answer

Right to explanation. GDPR Article 22 grants individuals the right not to be subject to a decision based solely on automated processing that produces legal or similarly significant effects, and Recital 71 explicitly references the right to obtain an explanation of such decisions. A hiring rejection is a significant decision, so the candidate's request for explanation maps directly to the right to explanation (often framed as part of Article 22 safeguards).

Answer

Right to erasure

Answer

Right to data portability

Answer

Right to access

Question 14

A company is implementing a guardrail system for their LLM chatbot. Which of the following is an example of a guardrail?

Accepted Answer

Rejecting requests that ask for illegal advice. A guardrail in an LLM system is a safety constraint that filters or rejects harmful inputs and outputs. Rejecting requests for illegal advice directly enforces policy compliance and prevents the model from generating prohibited content, which is the core function of a guardrail.

Answer

Using a larger context window

Answer

Increasing the model's temperature parameter

Answer

Enabling caching for frequent queries

Question 15

A team is designing an AI system for autonomous driving. They need to decide between an end-to-end deep learning approach versus a modular pipeline (perception, planning, control). Which is a key advantage of the modular approach?

Accepted Answer

Each module can be validated separately.. The modular pipeline approach decomposes the autonomous driving task into distinct components (e.g., perception, planning, control), each of which can be independently developed, tested, and validated. This separation allows engineers to verify the correctness of each module against its own specification, which is critical for safety-critical systems like autonomous driving. In contrast, end-to-end deep learning models treat the entire system as a black box, making it difficult to isolate and validate individual behaviors.

Answer

It typically has lower inference latency.

Answer

It handles novel scenarios better due to joint training.

Answer

It requires less engineering effort.