AIP-C01 Operational Efficiency And Optimization — 20 Questions

Question 1

Your team is using Amazon SageMaker JumpStart to deploy a pre-trained model. To minimize the cost of storage for the model artifacts, which S3 storage class should you configure for the bucket?

Accepted Answer

S3 Standard-Infrequent Access. S3 Standard is generally used, but for long-term storage of model artifacts that are rarely accessed, S3 Standard-Infrequent Access is the correct cost-optimization choice.

Answer

S3 Standard

Answer

S3 Glacier Deep Archive

Answer

S3 Intelligent-Tiering

Question 2

Your Generative AI application uses a vector database on Amazon OpenSearch Service. You notice high CPU usage during ingestion. How can you optimize performance?

Accepted Answer

Use bulk requests with an optimized refresh interval. Increasing the number of dedicated primary shards or using a more performant instance type for the ingestion nodes are standard optimization patterns.

Answer

Reduce the index replication factor

Answer

Disable vector search

Answer

Increase the number of replica shards

Question 3

Which THREE techniques can improve the performance (latency) of an inference endpoint?

Accepted Answer

Model quantization. Model optimization, hardware-specific instance types, and batching are standard techniques for improving inference speed.

Answer

Moving model artifacts to S3 Standard

Answer

Increasing the number of replicas

Question 4

You are deploying a foundation model on Amazon SageMaker. To optimize inference costs for an application with unpredictable traffic patterns and significant idle periods, which deployment option should you select?

Accepted Answer

SageMaker Serverless Inference. Serverless Inference is the most cost-effective solution for unpredictable traffic as it eliminates the cost of idle instances by automatically scaling resources based on request volume.

Answer

Batch Transform

Answer

Real-time inference with provisioned Auto Scaling instances

Answer

Asynchronous Inference

Question 5

You need to ensure that your SageMaker inference endpoint does not exceed a specific monthly budget. Which AWS feature allows you to set up notifications when spending thresholds are crossed?

Accepted Answer

AWS Budgets. AWS Budgets allows you to set custom cost and usage budgets and receive email or SNS alerts when thresholds are approached or exceeded.

Answer

SageMaker Cost Explorer

Answer

CloudWatch Alarms on billing metrics

Answer

AWS Cost and Usage Reports

Question 6

You have a fleet of SageMaker endpoints. You want to implement an automatic cost reduction strategy during off-peak hours for specific endpoints. Which approach is most efficient?

Accepted Answer

Configuring Application Auto Scaling with scheduled actions. Using a scheduled Auto Scaling policy allows you to reduce the instance count to the minimum required during off-peak hours automatically.

Answer

Using spot instances for all endpoints

Answer

Deactivating the endpoint manually

Answer

Updating the endpoint configuration

Question 7

An application using Amazon Bedrock is experiencing high latency. You need to monitor the 'ModelInvocationLatency' metric to identify performance bottlenecks. Which AWS service provides the primary integration for this telemetry?

Accepted Answer

Amazon CloudWatch. Amazon CloudWatch is the service that collects and monitors metrics from Amazon Bedrock, including model invocation latency.

Answer

AWS CloudTrail

Answer

AWS X-Ray

Answer

Amazon OpenSearch Service

Question 8

You are tuning a Large Language Model on SageMaker and notice that GPU memory utilization is consistently low despite high latency. Which action is most appropriate to optimize performance?

Accepted Answer

Implementing dynamic batching in your inference handler. Increasing the batch size or throughput via model parallelism or optimizing the inference script allows better utilization of the GPU hardware.

Answer

Increasing the number of instances

Answer

Switching to a larger instance type

Answer

Moving the model to CPU instances

Question 9

To track the resource usage of a SageMaker training job, you should look at which CloudWatch metric?

Accepted Answer

GPUUtilization. SageMaker training jobs publish GPUUtilization, CPUUtilization, and MemoryUtilization to CloudWatch under the /aws/sagemaker/TrainingJobs namespace.

Answer

RequestCount

Answer

ModelLatency

Answer

Invocations

Question 10

You are optimizing a SageMaker inference endpoint for an LLM that requires high memory bandwidth. Which instance family should you choose to balance performance and cost?

Accepted Answer

inf2 instances. The inf2 instances are specifically optimized for cost-effective, high-performance generative AI inference.

Answer

g5 instances

Answer

m5 instances

Answer

p4d instances

Question 11

Which SageMaker feature allows you to observe model performance drifts over time?

Accepted Answer

SageMaker Model Monitor. SageMaker Model Monitor automatically detects data drift, concept drift, and model quality issues.

Answer

SageMaker Pipelines

Answer

SageMaker Data Wrangler

Answer

SageMaker Clarify

Question 12

You are deploying a model using SageMaker Multi-Model Endpoints (MME). What is the primary benefit of this strategy for operational efficiency?

Accepted Answer

Reducing the number of instances required. MME allows you to host multiple models on a single set of instances, reducing the total cost by sharing resources.

Answer

Increasing model accuracy

Answer

Lowering training time

Answer

Enabling faster model deployment

Question 13

When configuring an Amazon Bedrock Knowledge Base, which setting helps optimize the retrieval process for RAG applications?

Accepted Answer

Adjusting the chunk size and overlap. Selecting the appropriate embedding model and defining chunks size are key to optimizing retrieval quality and performance.

Answer

Increasing the number of input tokens

Answer

Deleting the data source

Answer

Disabling encryption

Question 14

You are troubleshooting a SageMaker inference endpoint and need to see the container logs. Which service stores these logs?

Accepted Answer

Amazon CloudWatch Logs. SageMaker writes container logs (stdout/stderr) to CloudWatch Logs under the /aws/sagemaker/Endpoints/ path.

Answer

Amazon S3

Answer

Amazon DynamoDB

Answer

AWS CloudTrail

Question 15

You notice that your SageMaker model endpoint experiences cold starts. Which feature can mitigate this?

Accepted Answer

Enabling Provisioned Concurrency. Provisioned Concurrency maintains a set number of initialized instances, eliminating cold starts for serverless inference.

Answer

Increasing the instance count

Answer

Changing the container image

Answer

Using a smaller model

Question 16

Your team uses SageMaker Pipelines for training. How can you optimize the storage costs of the artifacts generated by these runs?

Accepted Answer

Configuring S3 Lifecycle policies. Implementing an S3 Lifecycle policy automatically moves or deletes artifacts after a certain period, keeping storage costs controlled.

Answer

Disabling versioning on the S3 bucket

Answer

Using smaller instance types

Answer

Deleting logs every day

Question 17

Which AWS service is used to centralize and visualize costs for your various SageMaker projects?

Accepted Answer

AWS Cost Explorer. AWS Cost Explorer allows you to view, analyze, and visualize your AWS spending, including SageMaker usage.

Answer

CloudWatch Dashboards

Answer

SageMaker Studio Dashboard

Answer

AWS Trusted Advisor

Question 18

You are using Amazon Bedrock and need to ensure your application respects regional service quotas. Which service allows you to request a quota increase?

Accepted Answer

AWS Service Quotas. AWS Service Quotas is the centralized service for managing and requesting increases for AWS service limits.

Answer

AWS IAM

Answer

Amazon CloudWatch

Answer

AWS Support Center

Question 19

Which TWO of the following strategies are best for reducing the cost of SageMaker training jobs?

Accepted Answer

Using Managed Spot Training. Using Managed Spot Training and instance-appropriate types are standard methods for reducing training costs.

Answer

Keeping training clusters running

Answer

Increasing the number of instances

Answer

Enabling detailed logging for every epoch

Question 20

Which TWO metrics are critical for monitoring an Amazon SageMaker inference endpoint to ensure operational health?

Accepted Answer

Invocations. Invocations and ModelLatency are the most fundamental metrics to gauge load and performance.

Answer

NetworkPacketLoss

Answer

S3StorageUsage

Answer

IAMUserCount