AI0-001 AI Infrastructure and Technologies Practice Test 5 — 15 Questions

Question 1

A machine learning engineer needs to train a deep neural network on a large image dataset. Which hardware component is specifically optimized for this task due to its high parallel processing capability and is commonly used in AI training?

Accepted Answer

Graphics Processing Unit (GPU). Option C is correct because Graphics Processing Units (GPUs) are specifically optimized for the parallel processing required in deep neural network training. Their architecture contains thousands of smaller cores designed to handle multiple matrix operations simultaneously, which is the core computation in backpropagation and forward passes of neural networks. This makes GPUs the standard choice for training large image datasets in AI.

Answer

Central Processing Unit (CPU)

Answer

Neural Processing Unit (NPU)

Answer

Tensor Processing Unit (TPU)

Question 2

A data scientist needs to deploy a PyTorch model to production with low-latency inference. The model must be served as a REST API and should support GPU acceleration. Which combination of tools is MOST suitable for this task?

Accepted Answer

Docker container with a FastAPI application and Nvidia GPU support. Option C is correct because it combines Docker containerization with FastAPI for a lightweight REST API and NVIDIA GPU support (via nvidia-docker or NVIDIA Container Toolkit) to enable low-latency GPU-accelerated inference. This stack directly meets the requirements of low-latency inference, REST API serving, and GPU acceleration without unnecessary overhead.

Answer

ONNX runtime with a gRPC endpoint on a CPU-only node

Answer

Apache Spark with MLlib to serve the model in batch mode

Answer

Kubeflow Pipelines to deploy the model as a scheduled job

Question 3

A company is building a recommendation system that uses user embeddings stored in a vector database. The system must retrieve the top 10 most similar items for a given user query. Which vector database feature is MOST critical for this task?

Accepted Answer

Approximate nearest neighbor (ANN) search. Approximate nearest neighbor (ANN) search is the most critical feature because it enables the vector database to efficiently find the top-10 most similar items to a user query embedding without scanning the entire dataset. Unlike exact nearest neighbor search, ANN algorithms (e.g., HNSW, IVF) trade a small amount of accuracy for massive performance gains, which is essential for real-time recommendation systems handling millions of high-dimensional vectors.

Answer

Built-in data versioning

Answer

ACID transaction support

Answer

SQL query interface

Question 4

An MLOps team observes that their production inference API experiences increasing latency as more concurrent requests arrive. They need to scale horizontally while maintaining session state of preprocessing steps. Which deployment strategy should they implement?

Accepted Answer

Deploy multiple instances behind a round-robin load balancer with sticky sessions. Sticky sessions (session affinity) ensure that all requests from a given client are routed to the same backend instance, preserving the in-memory session state of preprocessing steps. Combined with a round-robin load balancer, this allows horizontal scaling while maintaining stateful behavior, which is essential for the described latency issue under concurrent load.

Answer

Deploy stateless containers without session persistence

Answer

Use a single larger GPU instance to handle all requests

Answer

Implement a message queue (e.g., Kafka) to buffer requests

Question 5

A developer wants to integrate an AI-powered text summarization API into their application. They need to authenticate securely and manage usage limits. What is the standard mechanism for authenticating with cloud-based AI services?

Accepted Answer

Include an API key in the HTTP request header. Option D is correct because cloud-based AI services, including text summarization APIs, standardize authentication via API keys passed in the HTTP header (e.g., `Authorization: Bearer ` or `x-api-key: `). This method keeps credentials out of URLs and request bodies, preventing exposure in logs or caches, and aligns with RESTful API best practices and OWASP guidelines for secure API access.

Answer

Provide a username and password in the request body

Answer

Embed the API key in the URL query string

Answer

Use a digital certificate for each request

Question 6

A data engineering team is building a pipeline to ingest streaming user activity data, process it in real-time, and store features in a feature store for ML models. Which streaming technology is BEST suited for this real-time data ingestion and processing?

Accepted Answer

Apache Kafka. Apache Kafka is the best choice because it is a distributed streaming platform designed for high-throughput, fault-tolerant, real-time data ingestion and processing. It provides publish-subscribe messaging, durable log storage, and stream processing capabilities, making it ideal for ingesting streaming user activity data and feeding it into a feature store for ML models.

Answer

Apache Spark SQL

Answer

Apache Airflow

Answer

Apache Hadoop MapReduce

Question 7

A team has trained a large transformer model that achieves 95% accuracy but requires 8 GB of GPU memory for inference. They need to deploy it on edge devices with only 2 GB of memory and minimal accuracy loss. Which combination of techniques should they apply?

Accepted Answer

Apply INT8 quantization, pruning, and model distillation. Option C is correct because the team needs to reduce the model's memory footprint from 8 GB to under 2 GB while preserving accuracy. INT8 quantization reduces memory by 4x (from 32-bit floats to 8-bit integers), weight pruning removes redundant connections, and model distillation trains a smaller student model to mimic the teacher, collectively achieving the required compression with minimal accuracy loss.

Answer

Use model distillation to create a smaller student model

Answer

Apply INT8 quantization and weight pruning only

Answer

Use FP16 precision and increase batch size

Question 8

An organization wants to centralize experiment tracking, model versioning, and deployment management across its data science team. Which MLOps platform is specifically designed for experiment tracking and model registry?

Accepted Answer

MLflow. MLflow is an open-source MLOps platform that provides a centralized experiment tracking API (MLflow Tracking) and a model registry (MLflow Model Registry) for versioning, staging, and deploying machine learning models. It is specifically designed to address the need for experiment tracking and model lifecycle management, making it the correct choice for this scenario.

Answer

Apache Airflow

Answer

Weights & Biases

Answer

Kubeflow

Question 9

A company uses AWS SageMaker to train a model and wants to deploy it for real-time inference. They also need to monitor the endpoint for data drift and retrain automatically. Which SageMaker feature enables this automated retraining pipeline?

Accepted Answer

SageMaker Pipelines. SageMaker Pipelines is the correct answer because it provides a fully managed CI/CD service for creating, automating, and managing end-to-end machine learning workflows. It allows you to define a pipeline that includes steps for monitoring data drift (via Model Monitor), triggering retraining jobs, and deploying updated models, enabling the automated retraining pipeline described in the question.

Answer

SageMaker Debugger

Answer

SageMaker Ground Truth

Answer

SageMaker Model Monitor

Question 10

A team is deploying a machine learning model on a Kubernetes cluster. They need to ensure low-latency inference and efficient resource utilization. Which approach should they use to dynamically scale inference pods based on request volume?

Accepted Answer

Use a Horizontal Pod Autoscaler (HPA) with target CPU utilization. The Horizontal Pod Autoscaler (HPA) is the correct choice because it automatically scales the number of inference pods based on observed CPU utilization or custom metrics, ensuring low-latency inference by adding replicas during traffic spikes and reducing waste during idle periods. This dynamic scaling aligns with the need for efficient resource utilization in a Kubernetes cluster, as it adjusts pod count in real-time to match request volume without manual intervention.

Answer

Use a Job resource to process requests in batch

Answer

Deploy a single large pod on a powerful node

Answer

Set a fixed number of pod replicas equal to the maximum expected load

Question 11

A data scientist is using a Hugging Face transformer model for a sentiment analysis task. They want to optimize inference latency for a mobile app. Which model format and framework combination is BEST suited for on-device deployment?

Accepted Answer

Convert to TensorFlow Lite (TFLite) and run on the device. TensorFlow Lite (TFLite) is specifically designed for on-device machine learning inference on mobile and edge devices. It provides a lightweight runtime, hardware acceleration via delegates (e.g., GPU, NNAPI), and reduced model size through quantization, making it the best choice for optimizing inference latency in a mobile app. Converting a Hugging Face transformer model to TFLite allows the model to run locally without network latency, which is critical for real-time sentiment analysis on a smartphone.

Answer

Use the full PyTorch model with JIT scripting

Answer

Deploy the model on a cloud endpoint and call via REST API

Answer

Export to ONNX and use ONNX Runtime with GPU

Question 12

An AI developer needs to store large amounts of unstructured data (e.g., images, logs) for training datasets. Which cloud storage solution is purpose-built for data lakes?

Accepted Answer

Amazon S3. Amazon S3 is purpose-built for data lakes because it provides virtually unlimited scalability, high durability (99.999999999% or 11 nines), and supports any type of unstructured data (images, logs, videos) with a flat object storage architecture. Its integration with AWS Glue, Athena, and Lake Formation enables schema-on-read analytics, making it the foundational service for building a data lake on AWS.

Answer

Amazon DynamoDB

Answer

Amazon RDS

Answer

Amazon Redshift

Question 13

A team is deploying a model that must comply with GDPR. Users can request deletion of their data. Which TWO practices should be implemented to support this compliance? (Select TWO.)

Accepted Answer

Maintain the ability to delete a user's data from training sets and derived features. Option D is correct because GDPR's 'right to erasure' requires that upon user request, the organization must delete not only the user's raw data but also any derived features or embeddings that were generated from that data. Without this capability, the model could still indirectly retain user information through trained parameters or feature stores, violating compliance.

Answer

Enable output caching for frequently requested predictions

Answer

Validate inputs to prevent prompt injection attacks

Answer

Use a vector database to store user embeddings

Question 14

A machine learning engineer is designing a pipeline to train a computer vision model using PyTorch on a large dataset stored in an S3 data lake. They need to preprocess images (resize, normalize) and stream them efficiently to GPUs. Which THREE components are essential in this pipeline? (Select THREE.)

Accepted Answer

GPU-accelerated training with CUDA. Option A is correct because GPU-accelerated training with CUDA is essential for efficiently training computer vision models on large datasets. PyTorch leverages CUDA to parallelize tensor operations and model computations on NVIDIA GPUs, which is critical for reducing training time from days to hours when processing high-resolution images.

Answer

CPU-only inference pipeline

Answer

Apache Airflow to orchestrate the training job

Question 15

A data scientist is building a RAG (Retrieval-Augmented Generation) system. They need to store document embeddings and retrieve relevant chunks efficiently. Which TWO technologies are most appropriate for this task? (Select TWO.)

Accepted Answer

A vector database such as Pinecone or Weaviate. A vector database such as Pinecone or Weaviate is specifically designed to store and index high-dimensional vector embeddings, enabling efficient approximate nearest neighbor (ANN) search. This is essential for RAG systems to quickly retrieve the most semantically relevant document chunks based on the query embedding.

Answer

A relational database with BLOB storage

Answer

A GPU cluster for model serving

Answer

A data warehouse like Snowflake or BigQuery