AI-300 ML Model Lifecycle And Operations — Timed 15 Questions

Question 1

You are orchestrating a multi-step ML pipeline in Azure Machine Learning. You need to ensure that a downstream step only executes if the upstream model training step finishes successfully, while allowing the pipeline to continue even if a non-critical logging step fails. Which configuration should you use?

15 minute time limit — choose an answer to begin.

Accepted Answer

Configure pipeline run settings with 'continue_on_step_failure' set to True for the logging step.. In Azure Machine Learning pipelines, the 'continue_on_step_failure' setting on a step (or at the pipeline run level) allows the pipeline to proceed even when that step fails. By setting it to True specifically for the non-critical logging step, the pipeline continues past a logging failure, while the default behavior (False) for the training step ensures downstream steps only run if training succeeds. This gives the exact conditional execution behavior required.

Answer

Configure a 'WaitStep' to monitor the training job status.

Answer

Set the 'PipelineParameter' to execute only on success.

Answer

Use an 'Estimator' class with 'allow_reuse' set to False.

Question 2

You are deploying a model to an Azure Kubernetes Service (AKS) cluster. You need to ensure that the deployment handles traffic spikes by scaling based on GPU usage. Which setting must be enabled in the inference configuration?

Accepted Answer

Set 'autoscale_enabled' to True and 'target_utilization' for GPU metrics.. To scale based on GPU usage, you must define an 'autoscale' configuration within the 'InferenceConfig' that references 'target_utilization' for custom metrics like GPU.

Answer

Use 'enable_gpu' in the 'DeploymentConfig'.

Answer

Configure 'max_concurrent_requests'.

Answer

Enable 'cluster_purpose' as 'FastProd'.

Question 3

You need to ensure that your Azure ML models are deployed with high availability across multiple regions. Which deployment strategy should you configure?

Accepted Answer

Managed Online Endpoints with multiple deployments. Managed Online Endpoints support multi-region traffic distribution by using managed deployments behind a single endpoint.

Answer

Kubernetes Online Endpoints

Answer

Batch Endpoints

Answer

Azure Container Instances (ACI)

Question 4

You are managing model versioning in Azure Machine Learning Registry. You need to promote a model from 'Staging' to 'Production' without creating a new asset version. Which command or action should you perform?

Accepted Answer

Update the model asset by adding a 'Production' tag via the SDK or CLI.. In Azure Machine Learning Registry, model versions are immutable assets; you cannot change a version's stage by editing the version itself. Instead, you promote a model by updating its tags — specifically adding or updating a 'Production' tag on the existing model version via the SDK or CLI. This preserves the version number and lineage while signaling the new stage.

Answer

Change the 'run_id' in the model metadata.

Answer

Delete the old version and re-register as 'Production'.

Answer

Run 'az ml model create' with a new version number.

Question 5

A team uses Azure Machine Learning to track experiments. You need to ensure that every run is associated with a specific git commit hash to ensure reproducibility. Where should this be configured?

Accepted Answer

Within the 'experiment.start_logging()' call using the 'tags' parameter.. The 'tags' parameter in the experiment logging call (e.g., via MLflow's start_run or Azure ML's experiment.start_logging) allows arbitrary key-value metadata to be attached to a run, including the git commit hash. This makes the commit hash queryable and visible in the Azure ML studio run details, ensuring reproducibility. Configuring it here ties the metadata directly to the run object rather than to workspace or environment configuration.

Answer

In the 'workspace.json' file.

Answer

By modifying the compute cluster configuration.

Answer

Inside the 'conda_dependencies.yml' file.

Question 6

You are troubleshooting a model deployment failure where the container fails to start due to missing environment variables. Where do you find the logs to identify the cause?

Accepted Answer

The 'get-logs' command for the online deployment.. In Azure Machine Learning, when a model deployment fails due to container startup issues such as missing environment variables, the deployment logs are retrieved using the 'get-logs' command for the online deployment. This command provides container logs that include startup errors and environment variable issues.

Answer

The Key Vault access logs.

Answer

The pipeline run history.

Answer

The workspace diagnostic logs in Azure Monitor.

Question 7

You want to enforce a policy that all models must be registered before being deployed. Which feature should you use to implement this constraint?

Accepted Answer

Azure Policy definitions.. Azure Policy definitions are the native governance mechanism in Azure for enforcing organizational rules such as 'all models must be registered before deployment.' A policy definition with a deny effect can block deployments that reference unregistered models, and it can be assigned at management group, subscription, or resource group scope. This provides the centralized, auditable enforcement that the scenario requires.

Answer

Virtual Network peering.

Answer

Role-Based Access Control (RBAC).

Answer

Compute Instance quotas.

Question 8

A model is exhibiting data drift. You have created a drift monitor. What is the next step to automate the retraining?

Accepted Answer

Configure an Event Grid subscription to trigger a pipeline.. After creating a monitor, you set up an 'Event Grid' subscription to notify an Azure Function or Logic App to trigger the pipeline.

Answer

Update the dataset version.

Answer

Manually restart the compute cluster.

Answer

Create a 'RetrainingTrigger' in the model registry.

Question 9

You are running a distributed training job using the 'PyTorch' framework on Azure Machine Learning. You need to configure the 'DistributionConfiguration'. Which setting is mandatory for multi-node training?

Accepted Answer

'process_count' or 'node_count' in the configuration.. For multi-node distributed training in Azure ML with PyTorch, the DistributionConfiguration must specify either process_count (processes per node) or node_count (number of nodes) so the job knows how to shard across the cluster. Without these, the job cannot coordinate multi-node execution. The framework field is set to 'pytorch', not TensorFlow, and shm_size/GPU flags are optional tuning parameters.

Answer

'framework' set to 'TensorFlow'.

Answer

'shm_size' set to 1GB.

Answer

'enable_gpu' set to False.

Question 10

You are configuring an 'Azure Machine Learning Compute Cluster' for a heavy training job. You want to ensure it shuts down automatically when no jobs are running. What setting should you configure?

Accepted Answer

'min_nodes' set to 0.. The 'idle_seconds_before_scaledown' property in the compute configuration determines how long the cluster waits before removing idle nodes.

Answer

'max_nodes' set to 0.

Answer

'cluster_priority' to 'LowPriority'.

Question 11

You have an Azure Machine Learning pipeline that uses 'PipelineData' to pass information between steps. You want to share data between a training step and a scoring step. What is the recommended way to persist this data?

Accepted Answer

Use an 'OutputDataBinding' to a registered Datastore.. 'PipelineData' allows intermediate data passing, but 'OutputDataBindings' are preferred for persisting artifacts that need to be accessed later, such as model files.

Answer

Embed the data in the run metadata.

Answer

Write the file to the local temp directory.

Answer

Use an environment variable to pass the file path.

Question 12

You are reviewing the 'Run History' in Azure Machine Learning. You want to compare the training time of two different experiments. Which UI feature should you use?

Accepted Answer

The 'Experiments' tab, then 'Compare' button.. The 'Charts' or 'Metrics' comparison view in the Azure ML Studio allows you to visualize and compare metrics across multiple runs.

Answer

The 'Models' registry list.

Answer

The 'Endpoints' dashboard.

Answer

The 'Notebooks' file browser.

Question 13

You are debugging an Azure ML pipeline. You want to see the stdout of a specific step that failed. How do you access this?

Accepted Answer

Run 'az ml job get-logs' with the job ID.. You can access the logs for each step by clicking on the 'Outputs + logs' tab of that specific step run in the Azure ML Studio interface.

Answer

Check the 'Experiment' dashboard settings.

Answer

Download the 'run.json' file.

Answer

Look in the 'Workspace' logs folder.

Question 14

You have an Azure ML environment that needs to access a private Azure SQL database. How should you configure the connection?

Accepted Answer

Use a Managed Identity for the compute cluster.. You should use a 'Datastore' that stores the credentials in Azure Key Vault to securely access the SQL database from the compute environment.

Answer

Enable public access for the SQL database.

Answer

Hardcode the connection string in the script.

Question 15

You are configuring a 'Managed Online Endpoint' with SSL termination. Where do you manage the SSL certificates?

Accepted Answer

Via the Azure front-end load balancer/gateway service.. The SSL certificates are managed at the Azure 'Front Door' or 'Application Gateway' level, or by using the built-in certificate management if using Azure-provided domains for endpoints.

Answer

In the 'Python' score script.

Answer

Inside the Endpoint configuration YAML.

Answer

In the 'workspace.json' file.