Be able to deploy a model to a managed online endpoint, configure a parallel batch scoring job, set up monitoring and retraining triggers, and secure training data at rest. The single most important thing: know which object owns each setting, especially deployment-level compute versus endpoint-level configuration.
Start practicing
ML Model Lifecycle And Operations — choose a session length
Free · No account required
Domain overview
This domain covers the operational half of the ML lifecycle on Azure Machine Learning: deploying models, scoring at scale, monitoring for drift, and retraining. Questions are scenario-based, asking where a setting lives (deployment vs. endpoint), which config property to change, or which metric signals a need to act.
Exam objectives
Choosing instance_type and instance_count on a managed online deployment, not the endpoint itself
Tuning ParallelRunConfig properties such as mini_batch_size and max_concurrency_per_instance for batch scoring
Selecting monitoring signals like data drift and model performance metrics to trigger retraining
Configuring encryption at rest using Microsoft-managed keys or customer-managed keys in Key Vault
Setting instance type on the managed online endpoint instead of on the individual deployment, which is where compute is defined
Confusing data drift with prediction drift, or monitoring only infrastructure metrics instead of model quality signals
Assuming Blob Storage is encrypted by default with customer keys; you must configure a customer-managed key explicitly
Click any question to see the full explanation and answer options, or start a focused practice session above.
You need to implement a retraining trigger based on performance degradation. Which TWO metrics should you monitor to decide when to retrain?
2You are configuring a CI/CD pipeline for model deployment. Which THREE actions must you perform to ensure model traceability?
3You are building an Azure Machine Learning pipeline. You need to ensure that the pipeline components are reusable and versioned independently. What should you use?
4You need to monitor the data drift of a model deployed in Azure ML. What is the first step you must take?
5Your team needs to share a model across different workspaces. What is the most efficient way to achieve this in Azure Machine Learning?
6You are implementing a retraining trigger for a demand forecasting model. You want to trigger a pipeline execution only when the drift metric for the 'Price' feature exceeds a predefined threshold. Which service should you integrate with Azure Machine Learning?
7You are deploying a model via a Managed Online Endpoint. You want to implement a Canary deployment where 10% of traffic is sent to a new model version. How do you configure this?
8You are configuring a batch scoring job. You need to ensure that the job processes data in parallel to reduce completion time. What property should you adjust in the 'ParallelRunConfig'?
9You are using MLflow to track experiments in Azure Machine Learning. You need to log a custom metric that is calculated every 100 iterations. Which MLflow function should you use?
10You are defining an Azure Machine Learning environment for a training job. The environment requires a specific set of Python libraries. What is the best practice for defining these dependencies?
11You are moving a model from a local environment to Azure Machine Learning. Which file is required to define the entry script for the model inference?
12You need to ensure that training data is encrypted at rest in the Blob Storage linked to your Azure Machine Learning workspace. How do you ensure this?
13What is the primary purpose of a 'Labeling Project' in Azure Machine Learning?
14You are deploying a model that requires a high-memory compute for inference. You are using a 'Managed Online Endpoint'. Where do you specify the instance type for this deployment?
15What is the purpose of a 'Datastore' in Azure Machine Learning?
16Which Azure Machine Learning resource provides a pre-configured environment for development?
17You are automating model registration using the Azure ML CLI. You need to ensure the registration only happens if the model accuracy is above 0.9. How do you implement this condition?
18Which service allows you to track ML models and their associated artifacts?
19What is the 'Workspace' in Azure Machine Learning?
20What is the benefit of using 'Azure Machine Learning Datasets' (or Data Assets) over raw storage paths?
21You have an automated model training pipeline that is failing intermittently due to compute availability. What should you configure to ensure the pipeline is more resilient?
22You are implementing a custom container for model training. You need to push the image to the 'Azure Container Registry' (ACR) linked to your workspace. What is the correct command?
23You need to ensure that your model inference code has access to the latest secret keys without hardcoding them. What is the recommended integration?
24You are managing model lifecycle security. Which THREE actions are recommended to secure your ML models?
25You are creating a 'Pipeline' and want to share a dataset across multiple steps. What is the most efficient way to access this data?
26Which THREE components are required to define a 'Managed Online Deployment'?
27Which TWO types of compute can be used for training in Azure Machine Learning?
28You are configuring a 'Managed Online Endpoint' for production. You want to ensure high availability. What should you configure?
29You are optimizing your Azure ML pipeline performance. Which THREE steps should you take to reduce execution time?
30You are preparing a model for deployment. Which THREE items should you include in the model package?
31Which THREE metrics can be logged during training to track performance in Azure ML?
32Which TWO actions can you perform in the Azure Machine Learning studio?
33You are troubleshooting a deployment. Which THREE logs are most helpful to check?
34Which TWO resources are created inside an Azure Machine Learning workspace?
35Which THREE security features are essential for a production Azure ML deployment?
36Which THREE items are captured in the experiment lineage in Azure Machine Learning?
37You are an MLOps engineer at a financial services company. Your team trains a fraud detection model weekly using an Azure Machine Learning pipeline. Compliance requires that every model registered in the workspace is traceable to the exact training run, dataset version, and code commit that produced it. You need to ensure this lineage is automatically captured for every registered model without manual documentation. What should you do?
38You manage a managed online endpoint in Azure Machine Learning that serves a recommendation model. The model was trained months ago, and you now need to deploy a new version trained on recent data with zero downtime. You must be able to send a small percentage of live traffic to the new version to validate it before full rollout. What should you do?
39You are an MLOps engineer preparing to retrain a demand forecasting model on a schedule. The training data resides in an Azure Machine Learning datastore backed by Azure Blob Storage. You need the training job to run automatically every night at 02:00 UTC without manual intervention. What should you create?
40You are responsible for monitoring a deployed model on an Azure Machine Learning managed online endpoint. The model's input feature distribution has drifted from the training baseline, and you need to detect this automatically and act on it. Which two actions should you take? (Choose two.)
Be able to deploy a model to a managed online endpoint, configure a parallel batch scoring job, set up monitoring and retraining triggers, and secure training data at rest. The single most important thing: know which object owns each setting, especially deployment-level compute versus endpoint-level configuration.
The Courseiva AI-300 question bank contains 40 questions in the ML Model Lifecycle And Operations domain. Click any question to see the full explanation and answer breakdown.
Start with a 10-question focused session to identify your baseline accuracy in this domain. Read every explanation — even for questions you answer correctly — to understand the reasoning. Once you score consistently above 80%, move to a 20–30 question session to confirm depth before moving to the next domain.
Yes — the session launcher on this page draws questions exclusively from the ML Model Lifecycle And Operations domain. Choose 10, 20, 30, or 50 questions for a focused session, or click individual questions to review them one by one.
Save your results, see per-domain analytics, and get readiness scores — free, for every certification.
Sign Up FreeFree forever · Every certification included