AI0-001 AI Infrastructure and Technologies — 50 Questions

Question 1

A machine learning team is training a large transformer model on a text corpus. They need to reduce training time while maintaining model accuracy. Which hardware configuration would be MOST effective for this task?

Accepted Answer

Use a cluster of GPUs with data parallelism. GPUs are optimized for the parallel computations required in deep learning training, offering significant speedups over CPUs. TPUs are also effective but less accessible and more specialized. The question specifies 'most effective' for training a transformer model, which aligns with GPU acceleration.

Answer

Use a high-core-count CPU with large RAM

Answer

Use a single GPU with model parallelism

Answer

Use a single TPU with model parallelism

Question 2

An organization wants to integrate an AI-powered summarization feature into their existing web application. The AI service will be called via API. Which factor is MOST important to consider for cost management?

Accepted Answer

Token pricing of the AI model. Token pricing directly impacts cost because API calls are billed based on the number of tokens (input + output). Understanding token usage helps estimate and control expenses.

Answer

Authentication method (API key vs. OAuth)

Answer

Rate limits per minute

Answer

Network latency to the API endpoint

Question 3

A data science team is deploying a real-time fraud detection model on edge devices in retail stores. The model must infer under 10ms and fit within 50MB memory. Which combination of techniques should the team apply?

Accepted Answer

Model quantization to INT8 and pruning of low-weight connections. Quantization reduces model precision (e.g., FP32 to INT8) to shrink memory and speed up inference, while pruning removes redundant parameters. Distillation can further compress. These are standard for edge deployment.

Answer

Model parallelism and distributed inference

Answer

Increase batch size and use FP16 precision

Answer

Train a larger model and use distillation to transfer knowledge

Question 4

A company has a TensorFlow model trained on-premises and wants to deploy it on AWS SageMaker for scalable inference. What is the BEST way to package the model for deployment?

Accepted Answer

Package the model in a Docker container with a TensorFlow serving script and push to Amazon ECR. SageMaker expects models in a container format; the inference container should include the model artifacts and the serving code, allowing SageMaker to host it on scalable endpoints.

Answer

Convert the model to ONNX and upload to SageMaker

Answer

Upload the .h5 file to S3 and create a SageMaker endpoint directly

Answer

Use SageMaker Studio to train the model again from scratch

Question 5

A data engineer is building a pipeline to process streaming clickstream data and feed it into a real-time ML feature store. Which tool is BEST suited for the streaming ingestion?

Accepted Answer

Apache Kafka. Apache Kafka is the industry standard for high-throughput, fault-tolerant streaming data ingestion. It can handle real-time clickstream data and integrate with feature stores.

Answer

Amazon S3

Answer

Apache Airflow

Answer

Apache Spark (batch mode)

Question 6

A developer is building a mobile app that uses a pre-trained image classification model on-device. Which framework should they use to run the model on iOS devices?

Accepted Answer

Core ML. Core ML is Apple's framework for on-device machine learning inference on iOS. TensorFlow Lite is for mobile and embedded, but Core ML is native to iOS and optimized.

Answer

Hugging Face Transformers

Answer

TensorFlow Lite

Answer

PyTorch Mobile

Question 7

An ML team uses Kubeflow to orchestrate a pipeline that includes data preprocessing, model training, and evaluation. The pipeline runs on a Kubernetes cluster. After a cluster upgrade, the pipeline fails at the training step with an 'OOMKilled' error. What is the MOST likely cause?

Accepted Answer

The Kubernetes node's memory resources were not correctly allocated to the pod's resource requests or limits. OOMKilled indicates the container exceeded its memory limit. The resource requests/limits likely were not adjusted for the new cluster configuration, or the node's allocatable memory decreased after upgrade.

Answer

The training code has a memory leak

Answer

The pipeline definition is missing a step dependency

Answer

The training data is corrupted

Question 8

A security team needs to ensure that all data used for AI model training in the cloud is encrypted at rest and in transit. Which set of measures meets this requirement on AWS?

Accepted Answer

Enable S3 default encryption with SSE-S3 and use HTTPS for API calls. AWS provides KMS for at-rest encryption and TLS for in-transit encryption. These are standard practices to secure data across the AI pipeline.

Answer

Use Security Groups and Network ACLs

Answer

Use client-side encryption and store keys in AWS Secrets Manager

Answer

Enable VPC peering and use VPN connections

Question 9

A data scientist is using PyTorch to train a custom NLP model. The training is slow on a single GPU. They want to speed up training by using multiple GPUs on a single machine. Which PyTorch feature should they use?

Accepted Answer

torch.nn.DataParallel. DataParallel (or DistributedDataParallel) is PyTorch's built-in feature to split batches across multiple GPUs. It is straightforward for single-machine multi-GPU training.

Answer

TorchScript tracing

Answer

torch.optim.SGD

Answer

PyTorch Lightning's zero_grad function

Question 10

Which of the following is a key advantage of using ONNX (Open Neural Network Exchange) format for model deployment?

Accepted Answer

It enables framework interoperability for model inference. ONNX provides a standardized, open format for representing machine learning models, enabling seamless interoperability between different frameworks (e.g., PyTorch, TensorFlow, scikit-learn). This allows a model trained in one framework to be deployed for inference using a different runtime or hardware accelerator without requiring retraining or manual conversion, which is a key advantage in heterogeneous production environments.

Answer

It automatically quantizes models to INT8

Answer

It compresses model size by 90%

Answer

It reduces training time

Question 11

A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?

Accepted Answer

Enable batching of multiple queries into a single request. Batching multiple queries into a single request reduces the overhead of repeated gRPC connection setup, serialization, and network round trips for small payloads. This amortizes the fixed cost of each inference call across several queries, directly lowering per-query latency in high-throughput scenarios.

Answer

Convert the model to ONNX and use ONNX Runtime

Answer

Switch from gRPC to REST with HTTP/2

Answer

Use a larger instance type with more CPU

Question 12

An organization uses Azure Machine Learning to manage the ML lifecycle. They want to automatically retrain a model when new data arrives in Azure Blob Storage. Which Azure service should they integrate with Azure ML to trigger retraining?

Accepted Answer

Azure Event Grid. Azure Event Grid is the correct service because it provides a native event-driven architecture that can react to Blob Storage events (e.g., BlobCreated) and route them directly to Azure Machine Learning workspaces via webhooks or event subscriptions. This allows automatic retraining pipelines to be triggered as soon as new data lands in the storage container, without polling or custom code.

Answer

Azure Logic Apps

Answer

Azure Data Factory

Answer

Azure Functions

Question 13

A startup is building a recommendation system that requires low-latency similarity search over millions of product embeddings. They need a vector database that offers high performance and has a managed cloud option. Which TWO databases are best suited for this requirement?

Accepted Answer

Weaviate. Weaviate and Pinecone are both purpose-built vector databases that natively support high-performance approximate nearest neighbor (ANN) search using algorithms like HNSW (Weaviate) or proprietary indexing (Pinecone). They offer managed cloud services with automatic scaling, making them ideal for low-latency similarity search over millions of product embeddings without requiring manual infrastructure management.

Answer

Chroma

Answer

pgvector (PostgreSQL extension)

Answer

Amazon DynamoDB

Question 14

A financial services company needs to deploy an ML model for loan approval that must be explainable to regulators. The model is a gradient boosting ensemble. They need to track experiments, log model parameters, and serve the model with explanations. Which THREE tools from the MLOps ecosystem should they use?

Accepted Answer

Weights & Biases. Weights & Biases (W&B) is correct because it provides experiment tracking, hyperparameter logging, and model versioning, which are essential for the regulatory requirement of explainability and auditability. It integrates directly with gradient boosting frameworks like XGBoost and LightGBM to log parameters and metrics, enabling reproducible ML pipelines.

Answer

Apache Kafka

Answer

Docker Compose

Question 15

A data scientist wants to build a proof-of-concept chatbot using a large language model. They need to choose a cloud AI platform that provides easy access to pre-trained models via API, with built-in safety filters and prompt engineering tools. Which TWO platforms are best suited?

Accepted Answer

Azure OpenAI Service. Azure OpenAI Service (B) is correct because it provides direct API access to pre-trained models like GPT-4 with built-in content safety filters (e.g., Azure AI Content Safety) and integrated prompt engineering tools (e.g., Prompt Flow in Azure Machine Learning). This makes it ideal for quickly building a proof-of-concept chatbot with safety guardrails.

Answer

Amazon Bedrock

Answer

Amazon SageMaker

Answer

Hugging Face Hub

Question 16

A data scientist needs to train a deep learning model on a large image dataset. Which hardware is most suitable for parallel matrix operations and faster training compared to a CPU?

Accepted Answer

GPU with thousands of CUDA cores. A GPU with thousands of CUDA cores is the most suitable hardware for parallel matrix operations because deep learning training involves massive matrix multiplications and tensor operations that can be decomposed into thousands of independent threads. CUDA cores execute these threads in a massively parallel SIMT (Single Instruction, Multiple Thread) fashion, achieving significantly higher throughput than a CPU for such workloads, which leads to faster training times.

Answer

TPU designed for TensorFlow

Answer

CPU with high clock speed

Answer

FPGA for reconfigurable logic

Question 17

An ML engineer wants to deploy a model as a REST API that can scale to handle thousands of inference requests per second. Which serving approach is most appropriate?

Accepted Answer

Deploy the model as a REST API endpoint using a containerized inference server. Option D is correct because deploying the model as a REST API endpoint using a containerized inference server (e.g., TensorFlow Serving, TorchServe, or NVIDIA Triton Inference Server) is the most appropriate approach for handling thousands of inference requests per second. These servers are designed for high-throughput, low-latency serving, support horizontal scaling via load balancers, and provide built-in batching and model versioning. REST APIs are stateless and can be easily integrated with existing web infrastructure, making them ideal for production-scale inference.

Answer

Export the model to ONNX format and use a batch processing pipeline

Answer

Use gRPC streaming for all inference requests

Answer

Run the model directly on the client device

Question 18

A team wants to deploy a large language model on edge devices with limited memory and compute. They need to reduce model size by at least 50% while preserving accuracy. Which combination of techniques is most effective?

Accepted Answer

Apply INT8 quantization and weight pruning. INT8 quantization reduces the precision of weights and activations from 32-bit to 8-bit, cutting memory usage by approximately 75% for those tensors, while weight pruning removes redundant connections, often achieving over 50% size reduction with minimal accuracy loss when combined. Together, they directly address the constraints of edge devices by shrinking the model footprint and computational requirements without requiring a complete architecture redesign.

Answer

Distill the model into a smaller architecture without quantization or pruning

Answer

Use FP32 precision and increase batch size

Answer

Use FP16 quantization and add more layers

Question 19

A company uses a vector database to store embeddings for a RAG application. Users report that some queries return irrelevant results. Which adjustment is most likely to improve relevance?

Accepted Answer

Change the similarity metric from cosine to dot product and use a different embedding model. Switching from cosine similarity to dot product and using a different embedding model can improve relevance because the choice of similarity metric must align with the embedding model's training objective. Many modern embedding models (e.g., text-embedding-ada-002) are optimized for dot product or cosine similarity, but if the current model was trained for cosine and the queries are not normalized, dot product may better capture magnitude and direction. A different model may also produce higher-quality embeddings that better represent semantic relationships, directly addressing irrelevant results.

Answer

Reduce the chunk size of documents

Answer

Switch from an HNSW index to a flat index

Answer

Increase the top-k retrieval count

Question 20

An AI team uses SageMaker Pipelines to orchestrate their ML workflow. They need to version the pipeline and track experiments across runs. Which complementary MLflow feature should they integrate?

Accepted Answer

MLflow Tracking. MLflow Tracking is the correct complementary feature because it provides a centralized API and UI for logging parameters, metrics, and artifacts (e.g., model checkpoints, datasets) from each SageMaker Pipeline run. This enables the team to version their pipeline executions and compare experiments across different runs, directly addressing the requirement for tracking and versioning.

Answer

MLflow Models

Answer

MLflow Projects

Answer

MLflow Model Registry