AAIA AI Operations Practice Test 6 — 15 Questions

Question 1

Which THREE factors influence 'AI Pipeline' latency?

Accepted Answer

Model parameter size. Option B (Model parameter size) is correct because larger models require more computation per inference, increasing processing time and thus pipeline latency. Option C (Network transfer speed) is correct because AI pipelines often move data between storage, preprocessing, and inference services, and slower bandwidth or higher latency links directly add to end-to-end delay. Option D (Data preprocessing complexity) is correct because heavy operations such as tokenization, resizing, normalization, or feature engineering consume CPU/GPU cycles before inference, extending total pipeline latency. Options A (Company CEO name) and E (Office building height) are irrelevant metadata that have no technical effect on compute, transfer, or processing time in an AI pipeline.

Answer

Company CEO name

Answer

Office building height

Question 2

What is the goal of an AI 'Rollout' plan?

Accepted Answer

Controlled deployment to users. An AI rollout plan governs the controlled deployment of a model to users, typically through phased stages such as pilot, limited release, and general availability. The goal is to manage risk, gather feedback, and ensure readiness before full-scale exposure. It is fundamentally a deployment governance artifact, not a resource optimization or training activity.

Answer

Reducing disk space

Answer

Deleting logs

Answer

Increasing training time

Question 3

When auditing an AI system, how do you verify 'Model Reproducibility'?

Accepted Answer

Verifying pipeline run with identical inputs. Model reproducibility is verified by re-running the pipeline with identical inputs and confirming that the same outputs, metrics, and artifacts are produced. This demonstrates that the model's behavior is deterministic and traceable given fixed data, code, and environment. Auditors rely on this re-execution evidence rather than documentation or verbal assurances.

Answer

Asking the team

Answer

Checking cloud bills

Answer

Reading the documentation

Question 4

In an AI Audit, what does 'Model Lineage' demonstrate?

Accepted Answer

Provenance of the final model. Model lineage is the documented, traceable record of a model's provenance — the datasets, code, hyperparameters, training runs, and transformations that produced the final artifact. In an AI audit, it demonstrates end-to-end traceability: which data trained the model, which code version was used, who approved each stage, and how the model evolved. This chain of custody is what allows auditors to verify reproducibility, detect unauthorized changes, and satisfy regulatory requirements.

Answer

The cloud provider's stock

Answer

The developer's name

Answer

The model's name

Question 5

You are managing an Azure Machine Learning workspace and need to ensure that model training jobs are reproducible across environments. Which feature should be configured to capture the exact environment state, including Python packages and system dependencies?

Accepted Answer

Environment objects. Azure ML Environment objects are the mechanism designed to capture and version the exact runtime state of a training job — including the Python interpreter version, pip/conda packages, environment variables, and Docker base image. When an Environment is registered and referenced by a job, Azure ML rebuilds the identical containerized context on any compute target, which is what makes training reproducible across environments. Datasets, registries, and compute targets do not encapsulate package or system dependencies.

Answer

Azure ML Datasets

Answer

Model Registries

Answer

Compute Targets

Question 6

An organization using AWS SageMaker is experiencing model drift in production. You need to implement automated monitoring to trigger alerts when the distribution of input data deviates from the baseline. Which tool should be configured?

Accepted Answer

SageMaker Model Monitor. SageMaker Model Monitor is the purpose-built service for detecting data drift, model quality drift, bias drift, and feature attribution drift in deployed endpoints. It compares incoming inference data against a baseline statistics and constraints file, and can emit CloudWatch metrics that trigger alarms. This directly addresses the requirement for automated monitoring of input distribution deviation.

Answer

AWS CloudWatch Alarms

Answer

SageMaker Clarify

Answer

SageMaker Pipelines

Question 7

In a GCP Vertex AI pipeline, you want to ensure that every model artifact is associated with the specific training data and code version used. Which component provides this lineage tracking?

Accepted Answer

Vertex AI Metadata. Vertex AI Metadata tracks the lineage of artifacts throughout the lifecycle.

Answer

Feature Store

Answer

Vertex AI Pipelines

Answer

Vertex AI Experiments

Question 8

You are configuring a CI/CD pipeline for ML using GitHub Actions to deploy to a Kubernetes cluster. To ensure sensitive credentials for your container registry are not exposed in logs, what is the best practice?

Accepted Answer

Store credentials in GitHub Secrets. Using GitHub Secrets is the standard way to inject sensitive data into CI/CD pipelines securely.

Answer

Use environment variables in the workflow file

Answer

Hardcode credentials in the Dockerfile

Answer

Commit a .env file to the repository

Question 9

Which THREE of the following are essential components of an MLOps maturity model for ensuring operational stability?

Accepted Answer

Centralized model registry and artifact management. Option B is correct because a centralized model registry and artifact management system provides versioning, lineage, and governance for models and their artifacts, which is essential for reproducible deployments and operational stability in MLOps. Option C is correct because automated retraining pipelines enable consistent, repeatable model updates in response to data drift or performance degradation, reducing manual error and keeping models reliable in production. Option E is correct because real-time monitoring and alerting for model performance detects drift, degradation, and anomalies promptly, allowing teams to respond before business impact occurs. Option A is not appropriate because storing raw data directly in the model repository conflates data and model artifacts, harming governance, reproducibility, and storage management. Option D is not essential because manual model validation processes do not scale and undermine the automation and consistency that MLOps maturity models require for operational stability.

Answer

Storing raw data directly in the model repository

Answer

Manual model validation processes

Question 10

You are performing an audit on an ML project utilizing Kubeflow. The team is using Katib for hyperparameter tuning. Which configuration step is critical to ensure that individual trials do not starve the production inference service of resources?

Accepted Answer

Implementing Kubernetes ResourceQuotas. Kubernetes ResourceQuotas let administrators cap aggregate CPU, memory, and object counts within a namespace, ensuring that Katib experiment trials running in that namespace cannot consume unbounded cluster resources and starve the production inference service. By scoping quotas to the tuning namespace, the platform team guarantees a resource floor for production workloads. This is the standard Kubernetes-native mechanism for multi-tenant resource isolation.

Answer

Increasing node count on the master node

Answer

Disabling auto-scaling on the cluster

Answer

Setting the Katib algorithm to random search

Question 11

When setting up a containerized deployment of an AI model using Docker, what is the primary purpose of a 'multi-stage build'?

Accepted Answer

To reduce the final image size and attack surface. The primary purpose of a multi-stage build in Docker is to reduce the final image size and attack surface by separating the build environment from the runtime environment. Build tools, compilers, and intermediate dependencies are used in an early stage but are not copied into the final image, leaving only the necessary runtime artifacts. This results in a leaner, more secure production image.

Answer

To run multiple versions of the model simultaneously

Answer

To train the model during the container startup

Answer

To automatically scale the deployment based on traffic

Question 12

A company uses MLflow for model registry and tracking. You need to transition a model from the 'Staging' environment to 'Production' only after it passes an automated integration test. How is this state transition managed in MLflow?

Accepted Answer

Using the 'transition_model_version_stage' API. Transitioning model versions in the MLflow Model Registry is done via the 'transition_model_version_stage' API or UI.

Answer

Updating the 'version' tag in the git repo

Answer

Deleting the model in Staging and re-uploading to Production

Answer

Manually copying files in the S3 bucket

Question 13

Which TWO of the following are primary benefits of implementing a Model Registry in an AI production environment?

Accepted Answer

Enables versioning and lifecycle management of models. Model registries ensure version control and facilitate collaboration.

Answer

Allows for direct modification of training data

Answer

Increases the hardware utilization of GPUs

Answer

Automatically deletes old training instances

Question 14

When auditing a model deployment pipeline, which TWO aspects are critical to verify to ensure compliance with AI governance frameworks?

Accepted Answer

Validation of data processing against privacy policies. Option B is correct because AI governance frameworks require that data processing be validated against privacy policies, ensuring that personal data is collected, processed, and stored in line with regulations such as GDPR or CCPA and internal data-handling standards. Option C is correct because a complete audit trail of model lineage provides traceability from training data through model versions to deployment, which is essential for accountability, reproducibility, and regulatory audits under governance frameworks. The unmarked options do not belong: the choice of cloud provider (A) is a deployment detail, not a governance requirement; training job speed (D) is a performance metric unrelated to compliance; and using only proprietary algorithms (E) is neither required nor sufficient for AI governance compliance.

Answer

Whether the team uses a specific cloud provider

Answer

The speed of the training job

Answer

Usage of proprietary algorithms only

Question 15

An AI audit team is evaluating a bank's production ML system that processes loan applications. The system uses an automated pipeline that retrains the model every month. The audit team needs to verify that the retraining process does not introduce unintended bias. Which operational control should the audit team examine first?

Accepted Answer

The model validation gate that includes fairness metrics before deployment. The most direct operational control for verifying that retraining does not introduce bias is a validation gate that enforces fairness metrics before deployment. Such a gate acts as a preventive control, ensuring that any model failing bias thresholds is blocked from production. Auditors should examine the gate's design, the fairness metrics selected, and the approval process to confirm it operates effectively.

Answer

The data drift detection thresholds configured for the pipeline

Answer

The logging of model predictions for post-hoc analysis

Answer

The version control system used for model artifacts