Question 1hardmultiple choice
Read the full Design Applications explanation →Refer to the exhibit. An engineer is configuring a model serving endpoint. Based on the configuration, which outcome is expected during a sudden surge in traffic?
Exhibit
{
"model_name": "llama-3-8b",
"task": "chat",
"serving_endpoint": {
"min_cpu_cores": 4,
"max_cpu_cores": 16,
"auto_scaling": true
}
}