AIF-C01 Applications of Foundation Models Practice Question

Exhibit

{
  "EndpointConfigName": "my-fm-endpoint-config",
  "ProductionVariants": [
    {
      "VariantName": "variant1",
      "ModelName": "my-fm-model",
      "InitialInstanceCount": 1,
      "InstanceType": "ml.g5.xlarge",
      "InitialVariantWeight": 1.0
    }
  ]
}

Refer to the exhibit. A data scientist created this endpoint config for a foundation model in Amazon SageMaker. However, the endpoint fails to scale under load. What is the most likely reason?

⚠ Common exam trap

AWS often tests the misconception that setting a higher InitialInstanceCount or choosing a larger instance type alone enables scaling, when in fact AutoScaling must be explicitly configured as a separate step.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Missing AutoScaling configuration

The endpoint fails to scale under load because the endpoint configuration shown lacks an AutoScaling policy. Without AutoScaling, SageMaker will not automatically adjust the number of instances based on traffic, so even if the initial instance count is 1, the endpoint cannot add more instances to handle increased load. AutoScaling must be explicitly configured via Application Auto Scaling to define scaling policies and target tracking metrics.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✓
Missing AutoScaling configuration
Why this is correct
Auto scaling policy is required to add instances under load.
✗
Variant weight is 1.0
Why it's wrong here
Weight of 1.0 is normal for a single variant.
✗
Instance type is too small
Why it's wrong here
Instance type affects capacity, but scaling is the missing piece.
✗
InitialInstanceCount is 1
Why it's wrong here
Initial count of 1 is fine; scaling would handle load.

Go deeper

AIF-C01 Applications of Foundation Models Practice Question

Exhibit

Why each option matters

Option-by-option breakdown

Related to this question