AI Operations

You are managing an Azure Machine Learning workspace and need to ensure that model training jobs are reproducible across environments. Which feature should be configured to capture the exact environment state, including Python packages and system dependencies?

In SageMaker, what is the role of an 'Endpoint Configuration'?

Which THREE components are critical to monitor in an AI pipeline to ensure operational availability?

When designing an AI governance framework, which THREE roles should have oversight responsibility?

Which metric would best detect 'Label Drift' in a production model?

Which THREE documents are typically required for an AI Audit trail?

What is the purpose of 'Containerization' (e.g., Docker) in MLOps?

In an AI Audit, what does 'Model Lineage' demonstrate?

Which of the following is an example of an 'operational metric' for an AI system?

What is 'Shadow Deployment' in AI MLOps?

During an audit of an LLM pipeline, you discover that 'System Prompt' versioning is missing. What is the operational risk?

When auditing an AI model, what does 'Concept Drift' signify to an operational team?

When auditing an ML pipeline, what does the 'DAG' (Directed Acyclic Graph) represent?

What is the risk of 'Feature Skew' in an AI pipeline?

Which operational process is required to ensure 'Data Privacy' when using user-generated data for model retraining?

For a production LLM deployment, which operational metric is most critical to monitor to identify 'hallucination' or grounding failure in real-time?

What is the primary purpose of a 'Champion-Challenger' deployment pattern in MLOps?

An organization using AWS SageMaker is experiencing model drift in production. You need to implement automated monitoring to trigger alerts when the distribution of input data deviates from the baseline. Which tool should be configured?

When auditing a Kubernetes-based AI deployment, what does a 'Pod Disruption Budget' (PDB) ensure?

An auditor finds that a model's 'input feature importance' has changed significantly after a retrain. What is the most appropriate action?

Which THREE items should be tracked in a 'Model Registry' for audit readiness?

Which TWO are key 'AI Operational' documentation artifacts?

Which security control is most effective against 'Prompt Injection' attacks in a deployed LLM?

When auditing Kubeflow pipelines, which configuration file is used to define the resource requests for individual pipeline steps?

When auditing an AI pipeline, where should 'Environment Variables' be stored to ensure security?

During an audit of a model inference endpoint, you observe that 'Model Explanation' logs are missing. Which library or tool was likely omitted from the deployment?

Which environment should be used to perform 'Model Validation' before moving to production?

When setting up a containerized deployment of an AI model using Docker, what is the primary purpose of a 'multi-stage build'?

Which THREE items must be included in a 'Model Card' to comply with regulatory model risk management standards?

Which TWO are common 'AI Security' threats that require operational oversight?

What is the function of a 'Circuit Breaker' in a microservice-based AI architecture?

An organization experiences 'Data Leakage' in a machine learning project. What is the most likely cause during the training process?

What is the primary function of a 'Version Control System' (like Git) in an MLOps team?

When using DVC (Data Version Control) in an AI project, what is the best practice to ensure the 'data version' is immutable for audit purposes?

What is the primary objective of a 'Model Inventory' in an enterprise AI audit?

Which AWS SageMaker feature allows auditors to verify that a model was trained on encrypted data?

When an AI system utilizes a 'Feature Store', how does it ensure consistency between training and inference?

In a GCP Vertex AI pipeline, you want to ensure that every model artifact is associated with the specific training data and code version used. Which component provides this lineage tracking?

When auditing a model deployment pipeline, which TWO aspects are critical to verify to ensure compliance with AI governance frameworks?

When deploying an AI model on a public cloud, what is the best practice for 'Secret Management' of API keys?

What is the most effective way to audit 'Data Lineage' in a complex AI ecosystem?

You are performing an audit on an ML project utilizing Kubeflow. The team is using Katib for hyperparameter tuning. Which configuration step is critical to ensure that individual trials do not starve the production inference service of resources?

In an AI Audit, what does 'Model Fairness' assessment typically involve?

What does a 'Model Approval' workflow ensure?

When auditing an AI system, how do you verify 'Model Reproducibility'?

In a CI/CD pipeline for AI, where should the 'Model Validation' gate be located?

What is the primary function of an 'AI Pipeline Orchestrator' like Kubeflow or Airflow?

Which THREE of the following are essential components of an MLOps maturity model for ensuring operational stability?

In the context of 'AI Pipelines', what is the role of a 'Model Registry'?

In an AI Audit, what does an 'Input Feature Schema' define?

Which TWO of the following are considered 'Model Metadata' that should be tracked in a registry?

Which of these is a valid reason to 'Roll Back' a model deployment?

You are configuring a CI/CD pipeline for ML using GitHub Actions to deploy to a Kubernetes cluster. To ensure sensitive credentials for your container registry are not exposed in logs, what is the best practice?

Which TWO of the following are primary benefits of implementing a Model Registry in an AI production environment?

Which of the following is a key component of 'MLOps Maturity'?

Which THREE factors influence 'AI Pipeline' latency?

What is the purpose of 'Performance Monitoring' in AI?

What is the primary function of a 'Canary Deployment' in AI model release?

A company uses MLflow for model registry and tracking. You need to transition a model from the 'Staging' environment to 'Production' only after it passes an automated integration test. How is this state transition managed in MLflow?

What is the consequence of 'Pipeline Staleness' in an AI system?

What is the role of an 'A/B Test' in AI production?

In the context of AI regulatory compliance, what is the 'Model Risk Management' (MRM) framework mainly concerned with?

In the context of AI Operations, what does 'CI/CD' stand for?

Which THREE tasks are required for a 'Model Decommissioning' workflow?

What is 'Model Versioning' used for in an AI project?

Which TWO are standard practices for securing AI model endpoints?

Which TWO are common 'AI Operational' challenges?

What is the main benefit of 'Automated Retraining'?

Why must you conduct a 'Bias Audit' on a model that has been fine-tuned on new data?

In Google Vertex AI Pipelines, which mechanism prevents 'training-serving skew' when deploying a custom container model?

What is the most effective way to address 'Adversarial Input' during inference?

In SageMaker, what does 'Model Monitor' specifically detect?

Which THREE criteria are essential when selecting an AI deployment strategy?

What does a 'Backtesting' report verify in an AI Audit?

What is the role of a 'Deployment Pipeline' in MLOps?

Which TWO items should be included in an automated 'Deployment Log'?

Which TWO are common types of 'AI Model Drift'?

An organization uses MLflow for model tracking. To ensure auditability of model lineage, what must be captured in the 'mlflow.log_artifact' call?

An auditor notices high 'latency' in an online model deployment. Which component should be inspected first?

What is the function of a 'Feature Store' in an MLOps pipeline?

Which TWO of the following are essential for ensuring 'Model Observability' in an enterprise production environment?

Which of the following is a symptom of 'Overfitting' during the training phase?

What is the primary function of an 'AI Model Gateway'?

What is the purpose of an 'AI Audit trail'?

In Azure Machine Learning, which component should an auditor verify to ensure model registry access is restricted to authorized CI/CD service principals?

If an AI pipeline fails, which component provides the best 'log' to diagnose the failure?

What is the goal of an AI 'Rollout' plan?

If a model's performance drops, and the input data distribution has changed, what operational process must be triggered?

When implementing drift detection in AWS SageMaker Model Monitor, which metric should be monitored to detect feature attribution shift for structured data?