AI0-001 AI Infrastructure and Technologies — 15 Questions

Question 1

A machine learning team is training a large transformer model on a text corpus. They need to reduce training time while maintaining model accuracy. Which hardware configuration would be MOST effective for this task?

Accepted Answer

Use a cluster of GPUs with data parallelism. GPUs are optimized for the parallel computations required in deep learning training, offering significant speedups over CPUs. TPUs are also effective but less accessible and more specialized. The question specifies 'most effective' for training a transformer model, which aligns with GPU acceleration.

Answer

Use a high-core-count CPU with large RAM

Answer

Use a single GPU with model parallelism

Answer

Use a single TPU with model parallelism

Question 2

An organization wants to integrate an AI-powered summarization feature into their existing web application. The AI service will be called via API. Which factor is MOST important to consider for cost management?

Accepted Answer

Token pricing of the AI model. Token pricing directly impacts cost because API calls are billed based on the number of tokens (input + output). Understanding token usage helps estimate and control expenses.

Answer

Authentication method (API key vs. OAuth)

Answer

Rate limits per minute

Answer

Network latency to the API endpoint

Question 3

A data science team is deploying a real-time fraud detection model on edge devices in retail stores. The model must infer under 10ms and fit within 50MB memory. Which combination of techniques should the team apply?

Accepted Answer

Model quantization to INT8 and pruning of low-weight connections. Quantization reduces model precision (e.g., FP32 to INT8) to shrink memory and speed up inference, while pruning removes redundant parameters. Distillation can further compress. These are standard for edge deployment.

Answer

Model parallelism and distributed inference

Answer

Increase batch size and use FP16 precision

Answer

Train a larger model and use distillation to transfer knowledge

Question 4

A company has a TensorFlow model trained on-premises and wants to deploy it on AWS SageMaker for scalable inference. What is the BEST way to package the model for deployment?

Accepted Answer

Package the model in a Docker container with a TensorFlow serving script and push to Amazon ECR. SageMaker expects models in a container format; the inference container should include the model artifacts and the serving code, allowing SageMaker to host it on scalable endpoints.

Answer

Convert the model to ONNX and upload to SageMaker

Answer

Upload the .h5 file to S3 and create a SageMaker endpoint directly

Answer

Use SageMaker Studio to train the model again from scratch

Question 5

A data engineer is building a pipeline to process streaming clickstream data and feed it into a real-time ML feature store. Which tool is BEST suited for the streaming ingestion?

Accepted Answer

Apache Kafka. Apache Kafka is the industry standard for high-throughput, fault-tolerant streaming data ingestion. It can handle real-time clickstream data and integrate with feature stores.

Answer

Amazon S3

Answer

Apache Airflow

Answer

Apache Spark (batch mode)

Question 6

A developer is building a mobile app that uses a pre-trained image classification model on-device. Which framework should they use to run the model on iOS devices?

Accepted Answer

Core ML. Core ML is Apple's framework for on-device machine learning inference on iOS. TensorFlow Lite is for mobile and embedded, but Core ML is native to iOS and optimized.

Answer

Hugging Face Transformers

Answer

TensorFlow Lite

Answer

PyTorch Mobile

Question 7

An ML team uses Kubeflow to orchestrate a pipeline that includes data preprocessing, model training, and evaluation. The pipeline runs on a Kubernetes cluster. After a cluster upgrade, the pipeline fails at the training step with an 'OOMKilled' error. What is the MOST likely cause?

Accepted Answer

The Kubernetes node's memory resources were not correctly allocated to the pod's resource requests or limits. OOMKilled indicates the container exceeded its memory limit. The resource requests/limits likely were not adjusted for the new cluster configuration, or the node's allocatable memory decreased after upgrade.

Answer

The training code has a memory leak

Answer

The pipeline definition is missing a step dependency

Answer

The training data is corrupted

Question 8

A security team needs to ensure that all data used for AI model training in the cloud is encrypted at rest and in transit. Which set of measures meets this requirement on AWS?

Accepted Answer

Enable S3 default encryption with SSE-S3 and use HTTPS for API calls. AWS provides KMS for at-rest encryption and TLS for in-transit encryption. These are standard practices to secure data across the AI pipeline.

Answer

Use Security Groups and Network ACLs

Answer

Use client-side encryption and store keys in AWS Secrets Manager

Answer

Enable VPC peering and use VPN connections

Question 9

A data scientist is using PyTorch to train a custom NLP model. The training is slow on a single GPU. They want to speed up training by using multiple GPUs on a single machine. Which PyTorch feature should they use?

Accepted Answer

torch.nn.DataParallel. DataParallel (or DistributedDataParallel) is PyTorch's built-in feature to split batches across multiple GPUs. It is straightforward for single-machine multi-GPU training.

Answer

TorchScript tracing

Answer

torch.optim.SGD

Answer

PyTorch Lightning's zero_grad function

Question 10

Which of the following is a key advantage of using ONNX (Open Neural Network Exchange) format for model deployment?

Accepted Answer

It enables framework interoperability for model inference. ONNX provides a standardized, open format for representing machine learning models, enabling seamless interoperability between different frameworks (e.g., PyTorch, TensorFlow, scikit-learn). This allows a model trained in one framework to be deployed for inference using a different runtime or hardware accelerator without requiring retraining or manual conversion, which is a key advantage in heterogeneous production environments.

Answer

It automatically quantizes models to INT8

Answer

It compresses model size by 90%

Answer

It reduces training time

Question 11

A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?

Accepted Answer

Enable batching of multiple queries into a single request. Batching multiple queries into a single request reduces the overhead of repeated gRPC connection setup, serialization, and network round trips for small payloads. This amortizes the fixed cost of each inference call across several queries, directly lowering per-query latency in high-throughput scenarios.

Answer

Convert the model to ONNX and use ONNX Runtime

Answer

Switch from gRPC to REST with HTTP/2

Answer

Use a larger instance type with more CPU

Question 12

An organization uses Azure Machine Learning to manage the ML lifecycle. They want to automatically retrain a model when new data arrives in Azure Blob Storage. Which Azure service should they integrate with Azure ML to trigger retraining?

Accepted Answer

Azure Event Grid. Azure Event Grid is the correct service because it provides a native event-driven architecture that can react to Blob Storage events (e.g., BlobCreated) and route them directly to Azure Machine Learning workspaces via webhooks or event subscriptions. This allows automatic retraining pipelines to be triggered as soon as new data lands in the storage container, without polling or custom code.

Answer

Azure Logic Apps

Answer

Azure Data Factory

Answer

Azure Functions

Question 13

A startup is building a recommendation system that requires low-latency similarity search over millions of product embeddings. They need a vector database that offers high performance and has a managed cloud option. Which TWO databases are best suited for this requirement?

Accepted Answer

Weaviate. Weaviate and Pinecone are both purpose-built vector databases that natively support high-performance approximate nearest neighbor (ANN) search using algorithms like HNSW (Weaviate) or proprietary indexing (Pinecone). They offer managed cloud services with automatic scaling, making them ideal for low-latency similarity search over millions of product embeddings without requiring manual infrastructure management.

Answer

Chroma

Answer

pgvector (PostgreSQL extension)

Answer

Amazon DynamoDB

Question 14

A financial services company needs to deploy an ML model for loan approval that must be explainable to regulators. The model is a gradient boosting ensemble. They need to track experiments, log model parameters, and serve the model with explanations. Which THREE tools from the MLOps ecosystem should they use?

Accepted Answer

Weights & Biases. Weights & Biases (W&B) is correct because it provides experiment tracking, hyperparameter logging, and model versioning, which are essential for the regulatory requirement of explainability and auditability. It integrates directly with gradient boosting frameworks like XGBoost and LightGBM to log parameters and metrics, enabling reproducible ML pipelines.

Answer

Apache Kafka

Answer

Docker Compose

Question 15

A data scientist wants to build a proof-of-concept chatbot using a large language model. They need to choose a cloud AI platform that provides easy access to pre-trained models via API, with built-in safety filters and prompt engineering tools. Which TWO platforms are best suited?

Accepted Answer

Azure OpenAI Service. Azure OpenAI Service (B) is correct because it provides direct API access to pre-trained models like GPT-4 with built-in content safety filters (e.g., Azure AI Content Safety) and integrated prompt engineering tools (e.g., Prompt Flow in Azure Machine Learning). This makes it ideal for quickly building a proof-of-concept chatbot with safety guardrails.

Answer

Amazon Bedrock

Answer

Amazon SageMaker

Answer

Hugging Face Hub