AIP-C01 Practice Test 8 — 10 Questions

Question 1

You are building a RAG application. Which metadata field is most useful for filtering results during retrieval?

Accepted Answer

Creation date. Metadata filtering allows you to restrict retrieval to specific document types or categories.

Answer

Vector distance

Answer

Token count

Answer

Model ID

Question 2

Which SageMaker feature allows you to observe model performance drifts over time?

Accepted Answer

SageMaker Model Monitor. SageMaker Model Monitor automatically detects data drift, concept drift, and model quality issues.

Answer

SageMaker Pipelines

Answer

SageMaker Data Wrangler

Answer

SageMaker Clarify

Question 3

Which TWO of the following strategies are best for reducing the cost of SageMaker training jobs?

Accepted Answer

Using Managed Spot Training. Using Managed Spot Training and instance-appropriate types are standard methods for reducing training costs.

Answer

Keeping training clusters running

Answer

Increasing the number of instances

Answer

Enabling detailed logging for every epoch

Question 4

Your team uses SageMaker Pipelines for training. How can you optimize the storage costs of the artifacts generated by these runs?

Accepted Answer

Configuring S3 Lifecycle policies. Implementing an S3 Lifecycle policy automatically moves or deletes artifacts after a certain period, keeping storage costs controlled.

Answer

Disabling versioning on the S3 bucket

Answer

Using smaller instance types

Answer

Deleting logs every day

Question 5

Which AWS service is used to centralize and visualize costs for your various SageMaker projects?

Accepted Answer

AWS Cost Explorer. AWS Cost Explorer allows you to view, analyze, and visualize your AWS spending, including SageMaker usage.

Answer

CloudWatch Dashboards

Answer

SageMaker Studio Dashboard

Answer

AWS Trusted Advisor

Question 6

Which THREE metrics are best used for setting up auto-scaling policies on a SageMaker endpoint?

Accepted Answer

InvocationsPerInstance. InvocationsPerInstance, CPUUtilization, and GPUUtilization are the standard metrics to trigger scaling actions.

Answer

IAMUserLoginCount

Answer

S3RequestLatency

Question 7

Which THREE of the following are valid ways to monitor Amazon Bedrock model usage?

Accepted Answer

AWS CloudTrail logs.. CloudWatch metrics, AWS CloudTrail logs, and Usage billing reports are the primary ways to monitor usage.

Answer

AWS X-Ray service map.

Answer

Amazon S3 bucket logging.

Question 8

Which THREE factors should you consider when tuning your inference endpoint for cost-efficiency?

Accepted Answer

Auto Scaling policies based on custom metrics. Instance type, auto-scaling configuration, and model optimization (like quantization) are critical levers for cost efficiency.

Answer

CloudTrail log retention period

Answer

Number of S3 buckets used

Question 9

A developer is creating a test suite for an LLM application. Which THREE of the following metrics are commonly used to evaluate RAG system performance?

Accepted Answer

Answer Relevance. Faithfulness, answer relevance, and context precision are the key components of RAGAS evaluation.

Answer

Model Training Loss

Answer

Inference Latency

Question 10

Which THREE of the following are valid components of an Amazon Bedrock Agent test plan?

Accepted Answer

Validating the reasoning path of the agent.. Testing reasoning, tool invocation accuracy, and safety constraints are critical components of an agent test plan.

Answer

Verifying the S3 bucket encryption.

Answer

Measuring model training time.