AI-300 ML Model Lifecycle And Operations Practice Test 4 — 15 Questions

Question 1

You need to ensure that your model inference code has access to the latest secret keys without hardcoding them. What is the recommended integration?

Accepted Answer

Use the workspace Key Vault to store and retrieve secrets.. You should integrate your scoring script with Azure Key Vault using the workspace 'get_default_keyvault()' function to retrieve secrets at runtime.

Answer

Store keys as environment variables in the Dockerfile.

Answer

Use a configuration file on the VM.

Answer

Pass them as arguments to the 'init()' function.

Question 2

You are managing model lifecycle security. Which THREE actions are recommended to secure your ML models?

Accepted Answer

Store secrets in Azure Key Vault.. Option C is correct because storing secrets (storage account keys, connection strings, service principal credentials) in Azure Key Vault keeps them out of notebooks, scripts, and source control, and lets the workspace retrieve them via its managed identity rather than hard-coded values. Option D is correct because Azure RBAC enforces least-privilege access to the workspace, compute, datastores, and models, ensuring only authorized identities can read, train, deploy, or manage ML assets. Option E is correct because private endpoints place the workspace and its associated resources (such as storage, Key Vault, and container registry) on a private IP within your VNet, removing public internet exposure and blocking exfiltration. Option A is not recommended because allowing all traffic in NSGs defeats network segmentation and exposes the workspace to unauthorized access. Option B is not recommended because making datastores public exposes training data and model artifacts to anonymous or unauthenticated access, violating data-protection requirements.

Answer

Allow all traffic in NSGs.

Answer

Make all Datastores public.

Question 3

You are creating a 'Pipeline' and want to share a dataset across multiple steps. What is the most efficient way to access this data?

Accepted Answer

Use a 'Dataset' input object that mounts the storage.. You should define the dataset as an 'Input' to the pipeline or use a 'Dataset' object that can be mounted by the compute for each step.

Answer

Download the data to each step's local directory.

Answer

Pass the file path as a string argument.

Answer

Copy the data between steps.

Question 4

Which THREE components are required to define a 'Managed Online Deployment'?

Accepted Answer

An environment definition.. A Managed Online Deployment in Azure Machine Learning requires an environment definition (B), which specifies the Docker image and dependencies (e.g., conda.yaml) used to build the scoring container. It also requires an inference script (C), typically score.py, that defines the init() and run() functions to load the model and handle scoring requests. A registered model (D) is also required, since the deployment must reference a model asset (by name and version) from the workspace registry to serve predictions. A GPU compute instance (A) is not mandatory because managed online endpoints can run on CPU SKUs, and a training dataset (E) is irrelevant to inference-time deployment.

Answer

A GPU compute instance.

Answer

A training dataset.

Question 5

Which TWO types of compute can be used for training in Azure Machine Learning?

Accepted Answer

Compute Cluster.. Compute Cluster (B) is correct because it is Azure Machine Learning's managed, scalable multi-node compute target designed specifically for training and batch scoring jobs, supporting autoscaling and GPU/CPU SKUs. Compute Instance (C) is also correct because it is a managed single-node cloud workstation that can run training scripts and notebooks interactively, making it suitable for development and smaller training workloads. Key Vault (A) is a secrets-management service, not a compute resource, so it cannot train models. Web App (D) is a PaaS hosting service for web applications, and Azure SQL (E) is a managed relational database, neither of which provides the compute environment for ML training.

Answer

Key Vault.

Answer

Web App.

Answer

Azure SQL.

Question 6

You are configuring a 'Managed Online Endpoint' for production. You want to ensure high availability. What should you configure?

Accepted Answer

Set the 'instance_count' to at least 2.. To ensure high availability, you should configure the 'instance_count' to be greater than 1, spanning multiple availability zones if supported.

Answer

Use 'LowPriority' compute.

Answer

Set the 'instance_count' to 1.

Answer

Enable 'Auto-scaling' only.

Question 7

You are optimizing your Azure ML pipeline performance. Which THREE steps should you take to reduce execution time?

Accepted Answer

Mount datasets instead of downloading them.. Option C is correct because mounting a dataset exposes it as a FUSE-based virtual filesystem (e.g., /mnt/azureml/...) so the compute target reads only the files it needs on demand, avoiding the full download-and-copy overhead that inflates startup and I/O time. Option D is correct because enabling step run reuse lets Azure ML skip re-executing a pipeline step when its code, inputs, parameters, and environment are unchanged, returning the cached output and eliminating redundant compute. Option E is correct because ParallelRunStep partitions a batch workload across multiple nodes/processes of the cluster and runs them concurrently, cutting wall-clock time for large-scale scoring or data processing. Option A is not appropriate because adding workspaces only multiplies management boundaries and does not speed up a single pipeline's execution. Option B is not appropriate because undersized clusters for every step cause throttling, longer runtimes, and possible out-of-memory failures rather than faster execution.

Answer

Increase the number of workspaces.

Answer

Use smaller compute clusters for everything.

Question 8

You are preparing a model for deployment. Which THREE items should you include in the model package?

Accepted Answer

Model weights (pickle/onnx).. The model package must contain the serialized model artifact itself, so option C (Model weights in pickle/onnx format) is correct because this is the trained artifact that will be loaded to produce predictions. Option D (Inference script, score.py) is correct because the deployment service needs an entry point that defines init() and run() to load the model and handle scoring requests. Option E (Environment file, conda.yaml) is correct because it declares the exact Python and library dependencies required to recreate the runtime environment so the model executes consistently. Option A (Training dataset) is not included because the package is for inference, not retraining, and shipping raw training data is unnecessary and often a privacy/compliance risk. Option B (Pipeline definition) is not included because a pipeline describes the training/retraining workflow, not the deployable scoring artifact.

Answer

Training dataset.

Answer

Pipeline definition.

Question 9

Which THREE metrics can be logged during training to track performance in Azure ML?

Accepted Answer

Model accuracy.. Model accuracy (A) is a standard evaluation metric that can be logged during training via mlflow.log_metric or Run.log in Azure ML to track how well the model predicts correct labels. Custom metrics (C) are explicitly supported through the Azure ML SDK and MLflow APIs, allowing you to log any domain-specific numeric value (e.g., F1 score, AUC, business KPIs) with log_metric or log_row. Training loss (E) is a core optimization metric that is routinely logged per epoch or step to monitor convergence and detect overfitting. The unmarked options do not belong because a compute instance IP address (B) is infrastructure metadata, not a performance metric, and a workspace subscription ID (D) is an Azure resource identifier used for billing and access control, not a training performance measurement.

Answer

Compute instance IP address.

Answer

Workspace subscription ID.

Question 10

Which TWO actions can you perform in the Azure Machine Learning studio?

Accepted Answer

View run history.. Option C (View run history) is correct because the Azure Machine Learning studio provides an Experiments and Runs interface where you can inspect each run's metrics, logs, and outputs for tracking and comparison. Option E (Register a new dataset) is correct because the studio's Data section (Datastores/Datasets) lets you create and register datasets from datastores, local files, or web URLs for reuse in experiments and pipelines. Options A (Modify global azure subscriptions) and D (Configure networking in the tenant) are incorrect because subscription-level and tenant-wide networking settings are managed in the Azure portal or Microsoft Entra admin center, not in the ML studio. Option B (Manage office 365 users) is incorrect because Office 365 user administration is handled through the Microsoft 365 admin center, not Azure Machine Learning studio.

Answer

Modify global azure subscriptions.

Answer

Manage office 365 users.

Answer

Configure networking in the tenant.

Question 11

You are troubleshooting a deployment. Which THREE logs are most helpful to check?

Accepted Answer

Deployment status logs.. Deployment status logs (A) are essential because they show the orchestration-level events and errors from the deployment controller, such as failed rollouts, image pull errors, or readiness probe failures, directly indicating why the deployment did not succeed. Application output logs (B), typically captured from stdout/stderr, reveal runtime errors, exceptions, and startup failures inside the deployed containers that would not appear in orchestration logs. Container build logs (D) are critical when the failure originates during image construction, showing failed build steps, dependency errors, or Dockerfile issues before the image ever reaches the deployment stage. User browser logs (C) reflect client-side rendering or network issues and are not authoritative for server-side deployment failures, while Azure billing logs (E) only track cost and usage data and provide no diagnostic value for a failed deployment.

Answer

User browser logs.

Answer

Azure billing logs.

Question 12

Which TWO resources are created inside an Azure Machine Learning workspace?

Accepted Answer

Compute cluster.. Option B (Compute cluster) is correct because an Azure Machine Learning workspace hosts managed compute resources such as compute clusters (AmlCompute), which are used to run training pipelines and jobs and are created as child resources of the workspace. Option E (Datastore) is correct because a datastore is a workspace-level resource that stores connection information to Azure storage services (Blob, File, Data Lake, SQL) so experiments can access data without embedding credentials. Option A (External website) is not a workspace resource; a workspace does not create or manage public websites. Option C (Microsoft Entra ID) is incorrect because Microsoft Entra ID (Azure AD) is a tenant-level identity service that exists independently and is only associated with the workspace for authentication, not created inside it. Option D (Office 365 tenant) is incorrect because an Office 365 tenant is a separate Microsoft 365 organizational boundary unrelated to Azure Machine Learning workspace resources.

Answer

External website.

Answer

Azure Active Directory.

Answer

Office 365 tenant.

Question 13

Which THREE security features are essential for a production Azure ML deployment?

Accepted Answer

Key Vault integration.. Key Vault integration (A) is essential because it securely stores and centrally manages secrets, keys, and certificates used by the Azure ML workspace, compute, and endpoints, keeping credentials out of code and configuration files. Managed Identity (B) is essential because it gives the workspace and its compute resources an automatically managed identity in Microsoft Entra ID, enabling passwordless, least-privilege access to Key Vault, Storage, and ACR without embedding credentials. Virtual Network (VNet) (D) is essential because it provides network isolation for the workspace, compute clusters/instances, and private endpoints, restricting traffic to approved subnets and preventing exposure over the public internet. Opening inbound ports in the NSG (C) is not a security feature but a weakening of the perimeter, since production workloads should minimize inbound exposure and instead use private endpoints or Azure Bastion/JIT access. Public IP exposure (E) is not a security feature either, as assigning public IPs increases the attack surface and contradicts the private-networking posture expected in production.

Answer

Open inbound ports in NSG.

Answer

Public IP exposure.

Question 14

Which THREE items are captured in the experiment lineage in Azure Machine Learning?

Accepted Answer

Training code/snapshot.. In Azure Machine Learning, experiment lineage (reproducibility tracking) records the artifacts needed to reproduce a run: option B, the training code/snapshot, is captured because Azure ML stores a snapshot of the script/notebook submitted for the run in the experiment's output/artifact store. Option C, the used datasets, is captured because each run logs the input dataset references (name/version or datastore path) so the exact data used can be traced. Option D, the environment definition, is captured because the run records the Azure ML environment (Docker image, conda/pip dependencies, and environment version/hash) that executed the training. Option A, hardware manufacturer, is not tracked as lineage — Azure ML logs the compute SKU/size and node information, not the physical hardware vendor. Option E, number of team members, is not part of experiment lineage; it is workspace/identity metadata unrelated to run reproducibility.

Answer

Hardware manufacturer.

Answer

Number of team members.

Question 15

You are an MLOps engineer at a financial services company. Your team trains a fraud detection model weekly using an Azure Machine Learning pipeline. Compliance requires that every model registered in the workspace is traceable to the exact training run, dataset version, and code commit that produced it. You need to ensure this lineage is automatically captured for every registered model without manual documentation. What should you do?

Accepted Answer

Register the model using the output of the training pipeline step so Azure Machine Learning automatically records the run ID, dataset asset, and job context as model metadata.. Model lineage in Azure Machine Learning is captured automatically when a model is registered as the output of a job or pipeline step, because the service records the run ID, data assets, environment, and job context as model properties. Manual documentation, diagnostic logs, or naming conventions do not create that enforced association, so they cannot guarantee audit-ready traceability.

Answer

Store the training script and a CSV of metrics in the workspace's default datastore and reference the folder path in the model description field.

Answer

Create a Git tag in the repository after each pipeline run and name the registered model using the tag value so engineers can correlate them later.

Answer

Enable diagnostic settings on the Azure Machine Learning workspace and route all logs to a Log Analytics workspace for long-term retention.