You are optimizing resource allocation for a GPU-backed AI model deployment on AKS. Which THREE Kubernetes concepts or objects are essential for managing GPU resources effectively?
Trap 1: Node taints and tolerations for GPU node pools
GPU nodes are tainted to prevent non-GPU pods from scheduling, requiring tolerations.
Trap 2: Horizontal Pod Autoscaler based on Azure Load Balancer SNAT ports
SNAT ports do not govern GPU allocation.
Trap 3: Kubernetes persistent volume claims for GPU driver binaries
GPU drivers are installed on the host node via node image or operator, not mounted via PVCs.
- A
Node taints and tolerations for GPU node pools
Why wrong: GPU nodes are tainted to prevent non-GPU pods from scheduling, requiring tolerations.
- B
Horizontal Pod Autoscaler based on Azure Load Balancer SNAT ports
Why wrong: SNAT ports do not govern GPU allocation.
- C
Resource requests and limits specifying nvidia.com/gpu
Containers must request GPU resources using the specific device plugin resource name.
- D
Node selectors or node affinity to target GPU node pools
Node selectors ensure AI pods land on GPU-enabled virtual machine SKUs.
- E
Kubernetes persistent volume claims for GPU driver binaries
Why wrong: GPU drivers are installed on the host node via node image or operator, not mounted via PVCs.