AI-102 • Practice Test 3 — 25 Questions
Free AI-102 practice test 3 — 25 questions with explanations. No signup required.
You are an AI engineer at a healthcare company. The company uses Azure Cognitive Services to process medical records. They have a Computer Vision resource deployed in the East US region. Recently, they implemented a custom vision model for detecting specific anomalies in X-ray images. The model was trained using the Custom Vision portal and exported as a TensorFlow model. They deployed the model to an Azure Kubernetes Service (AKS) cluster using a Docker container. The container runs the model and exposes a REST API endpoint for inference. The endpoint is used by a web application that is also hosted in the same AKS cluster. The web application is experiencing high latency when making inference requests. The latency spikes up to 10 seconds during peak hours. The AKS cluster has autoscaling enabled based on CPU metrics. The container's resource limits are set to 1 CPU core and 2 GB memory. The model's inference time on a single image is approximately 500 ms on the development machine. The team has not changed the model or the application code recently. The number of concurrent users has increased by 50% in the last month. What should you do to reduce inference latency?