14 of 89 questions · Page 2/2 · AI Operations · Answers revealed
Which TWO items should be included in an automated 'Deployment Log'?
Provenance requirement.
Why this answer
Logs must provide the 'who, when, and what' of the deployment.
Which TWO are common types of 'AI Model Drift'?
Relationship shift.
Why this answer
Drift is split between inputs (data) and outputs (concept).
An organization uses MLflow for model tracking. To ensure auditability of model lineage, what must be captured in the 'mlflow.log_artifact' call?
This links code state to the model artifact.
Why this answer
Capturing the specific code version (git hash) and data snapshot ID ensures reproducibility.
An auditor notices high 'latency' in an online model deployment. Which component should be inspected first?
CPU/RAM bottlenecks cause latency.
Why this answer
The inference container resource allocation or the request preprocessing overhead is the common bottleneck.
What is the function of a 'Feature Store' in an MLOps pipeline?
Ensures consistency between training and serving.
Why this answer
A Feature Store provides a centralized repository for standardized feature definitions and storage for both training and inference.
Which TWO of the following are essential for ensuring 'Model Observability' in an enterprise production environment?
Essential for SLA compliance.
Why this answer
Observability requires both performance metrics and input monitoring (drift).
Which of the following is a symptom of 'Overfitting' during the training phase?
Classic sign of overfitting.
Why this answer
Overfitting happens when the model performs well on training data but poorly on unseen test data.
What is the primary function of an 'AI Model Gateway'?
Standard API gateway function.
Why this answer
A gateway acts as a security and management layer for AI requests, providing throttling, logging, and authentication.
What is the purpose of an 'AI Audit trail'?
Key compliance requirement.
Why this answer
To provide a transparent, verifiable record of all actions taken on an AI system.
In Azure Machine Learning, which component should an auditor verify to ensure model registry access is restricted to authorized CI/CD service principals?
RBAC controls access to the workspace registry.
Why this answer
Access to the Model Registry is governed by Azure RBAC and specifically Managed Identities/Service Principals assigned to the workspace.
If an AI pipeline fails, which component provides the best 'log' to diagnose the failure?
Shows the point of failure.
Why this answer
The pipeline orchestrator's task logs indicate specifically which step failed and why.
What is the goal of an AI 'Rollout' plan?
Risk management.
Why this answer
To manage the deployment of a model to users in a controlled way.
If a model's performance drops, and the input data distribution has changed, what operational process must be triggered?
Adapts model to new data patterns.
Why this answer
Data distribution change triggers model retraining using updated data samples.
When implementing drift detection in AWS SageMaker Model Monitor, which metric should be monitored to detect feature attribution shift for structured data?
This directly measures shift in SHAP values.
Why this answer
Feature attribution drift monitors how the model's reliance on specific input features changes over time.
Ready to test yourself?
Try a timed practice session using only AI Operations questions.