Techniques to Improve Generative AI Model Output →hardMultiple Choice

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

Exhibit

{
  "dedicatedEndpoints": 1,
  "machineType": "n1-standard-2",
  "minReplicaCount": 1,
  "maxReplicaCount": 5,
  "scaleTarget": 0.5
}

Refer to the exhibit. A Vertex AI endpoint configured with the above deployment is returning HTTP 429 (Too Many Requests) errors during peak traffic. The current CPU utilization reaches 80% consistently. What should the team adjust to resolve this?

⚠ Common exam trap

The Google Cloud Gen AI Leader exam often tests the distinction between scaling limits (min/maxReplicaCount) and scaling thresholds (scaleTarget), trapping candidates who confuse raising the scaling target with increasing capacity.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Increase maxReplicaCount to 10

Increasing maxReplicaCount to 10 allows the Vertex AI endpoint to scale out to more instances during peak traffic, distributing the load and reducing HTTP 429 errors. Since CPU utilization is at 80%, the current maxReplicaCount is insufficient to handle the demand, and raising this limit enables the horizontal pod autoscaler to add replicas up to the new maximum, directly addressing the capacity bottleneck.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✓
Increase maxReplicaCount to 10
Why this is correct
Correct: Higher max allows more replicas to handle traffic spikes.
✗
Increase scaleTarget to 0.9
Why it's wrong here
Higher target delays scaling, worsening the issue.
✗
Change machineType to n1-highmem-2
Why it's wrong here
Memory improvement does not address CPU-bound scaling.
✗
Increase minReplicaCount to 2
Why it's wrong here
This ensures at least 2 replicas but still limits maximum capacity.

Visual reference

Go deeper

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

Exhibit

Why each option matters

Option-by-option breakdown

Related to this question