Courseiva

CCNA Aio Ai Infrastructure Questions

48 questions · Aio Ai Infrastructure topic · All types, answers revealed

Practice these questionsExam hubAll questions
1
MCQeasy

A developer is using Hugging Face Transformers to fine-tune a BERT model for sentiment analysis. They want to track experiments, log metrics, and compare runs. Which MLOps tool should they integrate?

A.Apache Airflow
B.Docker
C.Kubeflow
D.MLflow
AnswerD

MLflow's Tracking API is simple to integrate and supports logging parameters, metrics, and artifacts.

Why this answer

MLflow is the correct choice because it is purpose-built for experiment tracking, metric logging, and run comparison in machine learning workflows. It provides an API to log parameters, metrics, and artifacts, and its UI allows easy comparison of different fine-tuning runs, which directly matches the developer's need to track experiments and compare runs for a BERT sentiment analysis model.

Exam trap

CompTIA often tests the distinction between infrastructure tools (Airflow, Docker, Kubeflow) and ML-specific experiment tracking tools (MLflow), trapping candidates who confuse orchestration or containerization with MLOps tracking capabilities.

How to eliminate wrong answers

Option A is wrong because Apache Airflow is a workflow orchestration tool for scheduling and managing DAGs (Directed Acyclic Graphs) of tasks, not for experiment tracking or metric logging; it lacks native ML run comparison capabilities. Option B is wrong because Docker is a containerization platform for packaging applications and dependencies, not an MLOps tool for logging metrics or comparing experiments; it provides environment consistency but no tracking or logging features. Option C is wrong because Kubeflow is a Kubernetes-native platform for deploying and managing ML pipelines at scale, but it is overkill for simple experiment tracking and does not offer the lightweight, focused metric logging and run comparison that MLflow provides out of the box.

Practice this question →
2
MCQeasy

A company wants to build a real-time anomaly detection system for IoT sensor data using edge AI. The model must run on resource-constrained devices with minimal power consumption. Which model optimization technique is MOST important?

A.Use FP32 precision
B.Model quantization (INT8)
C.Increase the number of layers
D.Use a larger batch size
AnswerB

INT8 quantization dramatically reduces model size and inference latency with minimal accuracy loss, ideal for edge devices.

Why this answer

Quantization reduces model precision (e.g., FP32 to INT8), decreasing model size and computation, which is critical for resource-constrained edge devices.

Practice this question →
3
MCQeasy

An ML engineer wants to deploy a model as a REST API that can scale to handle thousands of inference requests per second. Which serving approach is most appropriate?

A.Export the model to ONNX format and use a batch processing pipeline
B.Use gRPC streaming for all inference requests
C.Run the model directly on the client device
D.Deploy the model as a REST API endpoint using a containerized inference server
AnswerD

REST APIs are stateless and easily scalable with load balancers and container orchestration.

Why this answer

Deploying the model as a REST API endpoint using a containerized inference server (e.g., TensorFlow Serving, TorchServe, or NVIDIA Triton Inference Server) is the most appropriate approach for handling thousands of inference requests per second. These servers are designed for high-throughput, low-latency serving, support horizontal scaling via load balancers, and provide built-in batching and model versioning. REST APIs are stateless and can be easily integrated with existing web infrastructure, making them ideal for production-scale inference.

Exam trap

The AI0-001 exam often tests the distinction between serving infrastructure (REST API with containerized server) and data processing pipelines (batch) or communication protocols (gRPC), leading candidates to confuse a transport mechanism or batch method with a scalable serving architecture.

How to eliminate wrong answers

Option A is wrong because exporting to ONNX and using a batch processing pipeline is designed for offline/batch inference, not for real-time REST API serving with thousands of requests per second; batch pipelines introduce latency and are not suitable for synchronous, low-latency inference. Option B is wrong because gRPC streaming is a communication protocol that can be used for inference, but it is not a serving approach itself; moreover, gRPC streaming is typically used for bidirectional or long-lived streams, not for high-volume stateless REST API requests, and it adds complexity without inherent scalability benefits over REST for this use case. Option C is wrong because running the model directly on the client device (edge inference) offloads computation from the server but does not provide a centralized REST API; it also introduces challenges with model updates, device heterogeneity, and security, and is not a server-side serving approach.

Practice this question →
4
MCQmedium

A machine learning team is training a large transformer model on a text corpus. They need to reduce training time while maintaining model accuracy. Which hardware configuration would be MOST effective for this task?

A.Use a high-core-count CPU with large RAM
B.Use a cluster of GPUs with data parallelism
C.Use a single GPU with model parallelism
D.Use a single TPU with model parallelism
AnswerB

GPUs accelerate parallel tensor operations, and data parallelism distributes batches across multiple GPUs, significantly reducing training time.

Why this answer

GPUs are optimized for the parallel computations required in deep learning training, offering significant speedups over CPUs. TPUs are also effective but less accessible and more specialized. The question specifies 'most effective' for training a transformer model, which aligns with GPU acceleration.

Practice this question →
5
Multi-Selecteasy

A machine learning engineer needs to containerize a PyTorch model for deployment on Kubernetes. Which THREE tools or formats should they use?

Select 3 answers
A.MLflow
B.Docker
C.Kubeflow
D.Kubernetes
E.ONNX
AnswersB, D, E

Docker is the standard for containerizing applications, including ML models and their dependencies.

Why this answer

Docker is correct because it is the standard tool for creating container images that package the PyTorch model along with its dependencies, runtime, and environment into a portable artifact. Kubernetes requires container images (typically built with Docker) to deploy and orchestrate workloads, making Docker essential for containerization before deployment.

Exam trap

CompTIA often tests the distinction between containerization tools (Docker) and orchestration or ML lifecycle tools (Kubeflow, MLflow), leading candidates to select tools that manage containers rather than build them.

Practice this question →
6
MCQhard

A company uses Azure OpenAI to generate customer support responses. The team notices that repeated queries with similar context incur high costs due to token usage. They want to reduce costs without affecting response quality. Which strategy is MOST effective?

A.Use a larger model to improve efficiency
B.Increase the frequency penalty
C.Reduce the max_tokens parameter
D.Implement prompt caching
AnswerD

Prompt caching avoids recomputing common prefixes, reducing token usage.

Why this answer

Prompt caching stores and reuses tokens from previous queries, reducing token consumption for similar requests and lowering costs without quality loss.

Practice this question →
7
MCQmedium

A data scientist is building a recommendation system using Apache Spark for feature engineering. They need to process streaming user click data in real-time before feeding into the model. Which tool should they use for the streaming data ingestion?

A.Amazon S3
B.Apache Kafka
C.Airflow
D.Snowflake
AnswerB

Kafka supports high-throughput, real-time data streams that can be processed by Spark.

Why this answer

Apache Kafka is the correct choice because it is a distributed streaming platform designed for high-throughput, fault-tolerant, real-time data ingestion. It acts as a durable message broker that can ingest streaming click data and make it available for Spark Structured Streaming to process in micro-batches or continuous processing mode, which is essential for real-time feature engineering in a recommendation system.

Exam trap

CompTIA often tests the distinction between storage, orchestration, and streaming tools, and the trap here is that candidates confuse batch-oriented tools like S3 or Airflow with real-time streaming ingestion, overlooking Kafka's role as a dedicated event streaming platform.

How to eliminate wrong answers

Option A is wrong because Amazon S3 is an object storage service, not a streaming ingestion tool; it lacks the low-latency, pub-sub messaging capabilities required for real-time data streaming. Option C is wrong because Airflow is a workflow orchestration tool for scheduling batch jobs, not a real-time streaming ingestion platform; it cannot handle continuous, event-driven data streams. Option D is wrong because Snowflake is a cloud-based data warehouse optimized for analytical queries on structured data, not for real-time streaming ingestion; it does not provide a pub-sub or message queue interface for live click data.

Practice this question →
8
MCQmedium

A company wants to build a customer service chatbot that answers questions about their internal policy documents. The documents are updated monthly, and the team cannot afford to retrain a model each time. Which approach is MOST appropriate?

A.Use Retrieval-Augmented Generation (RAG) with the policy documents indexed in a vector store
B.Train a custom model from scratch on the policy documents each month
C.Use a larger foundation model with a longer context window and paste all documents into each prompt
D.Fine-tune a base LLM on the policy documents monthly
AnswerA

RAG retrieves relevant document chunks at query time, ensuring the chatbot always answers from the latest uploaded documents without any model retraining.

Why this answer

Retrieval-Augmented Generation (RAG) is the most appropriate approach because it allows the chatbot to answer questions by retrieving relevant chunks from the policy documents stored in a vector store, without requiring model retraining. When documents are updated monthly, RAG simply re-indexes the new content, keeping the system current while avoiding the cost and complexity of fine-tuning or retraining a model each cycle.

Exam trap

CompTIA often tests the distinction between retrieval-based approaches (RAG) and fine-tuning, where candidates mistakenly choose fine-tuning because they think it 'customizes' the model, but the key constraint here is avoiding monthly retraining, which RAG uniquely satisfies.

How to eliminate wrong answers

Option B is wrong because training a custom model from scratch each month is prohibitively expensive and time-consuming, requiring large datasets and GPU resources, and contradicts the requirement to avoid retraining. Option C is wrong because pasting all policy documents into each prompt exceeds typical context window limits (e.g., 4K–128K tokens for most models), leading to truncation, high latency, and increased cost per query. Option D is wrong because fine-tuning a base LLM monthly still requires retraining, which the team cannot afford, and fine-tuning may cause catastrophic forgetting of previous policies unless carefully managed with multi-epoch training on all historical data.

Practice this question →
9
Multi-Selectmedium

An organization is building a recommendation system that requires low-latency vector similarity search. They need to store and query millions of embeddings. Which THREE technologies are appropriate for this task?

Select 3 answers
A.Snowflake
B.Amazon S3
C.Weaviate
D.pgvector
E.Pinecone
AnswersC, D, E

Weaviate is an open-source vector database with built-in similarity search.

Why this answer

Pinecone, Weaviate, and pgvector are vector databases designed for similarity search. Snowflake and S3 are not optimized for vector search.

Practice this question →
10
MCQeasy

An organization wants to centralize experiment tracking, model versioning, and deployment management across its data science team. Which MLOps platform is specifically designed for experiment tracking and model registry?

A.Apache Airflow
B.Weights & Biases
C.MLflow
D.Kubeflow
AnswerC

MLflow offers experiment tracking, model registry, and deployment management, making it a comprehensive tool for MLOps.

Why this answer

MLflow is an open-source MLOps platform that provides a centralized experiment tracking API (MLflow Tracking) and a model registry (MLflow Model Registry) for versioning, staging, and deploying machine learning models. It is specifically designed to address the need for experiment tracking and model lifecycle management, making it the correct choice for this scenario.

Exam trap

CompTIA often tests the distinction between tools that handle only one part of the MLOps lifecycle (like W&B for tracking or Kubeflow for deployment) versus a unified platform like MLflow that combines experiment tracking and model registry.

How to eliminate wrong answers

Option A is wrong because Apache Airflow is a workflow orchestration tool for scheduling and managing data pipelines, not a platform for experiment tracking or model registry. Option B is wrong because Weights & Biases (W&B) is a commercial platform focused on experiment tracking and visualization, but it does not include a built-in model registry for versioning and deployment management; its model registry is a separate add-on and not as integrated as MLflow's. Option D is wrong because Kubeflow is a Kubernetes-native platform for deploying and managing ML workflows, but it does not have a dedicated experiment tracking or model registry component; it relies on external tools like MLflow or Katib for those functions.

Practice this question →
11
MCQhard

A data scientist is training a large language model on a custom dataset using PyTorch on AWS. The training is taking too long due to GPU memory constraints. The team wants to use multiple GPUs across instances with minimal code changes. Which AWS service should they use?

A.AWS Elastic Fabric Adapter (EFA)
B.Amazon SageMaker with distributed training libraries
C.AWS Batch with GPU instances
D.AWS ParallelCluster with Slurm
AnswerB

SageMaker's distributed libraries (e.g., SageMaker Data Parallelism) enable multi-GPU training with minimal code changes.

Why this answer

SageMaker distributed training libraries support data parallelism and model parallelism with minimal code changes, enabling multi-GPU training across instances efficiently.

Practice this question →
12
Multi-Selectmedium

A healthcare startup needs to deploy an AI model for real-time patient monitoring on IoT devices with limited battery and compute. The model must run locally with minimal latency. Which TWO strategies are most appropriate?

Select 2 answers
A.Apply model distillation to create a smaller student model
B.Deploy the model on a cloud server and stream data
C.Use TensorFlow Lite to convert and run the model on the device
D.Quantize the model to INT8 precision
E.Use ONNX Runtime with a GPU backend
AnswersC, D

TensorFlow Lite is optimized for on-device machine learning, providing low-latency inference on resource-constrained devices.

Why this answer

TensorFlow Lite is specifically designed to run TensorFlow models on resource-constrained edge devices like IoT sensors. It optimizes the model for low latency inference by using a specialized interpreter and hardware acceleration delegates (e.g., NNAPI, GPU), enabling real-time patient monitoring without cloud dependency.

Exam trap

A common misconception is that model distillation alone is sufficient for edge deployment, when in fact it must be combined with a framework like TensorFlow Lite and quantization to meet hardware constraints in a Comptia AI context.

Practice this question →
13
MCQmedium

A team is using an API from a cloud AI service to generate text. They notice that repeated requests with the same prompt return different outputs. They want consistent responses for testing. Which parameter should they adjust?

A.Increase the top_p parameter to 1.0
B.Set the frequency_penalty to 0
C.Increase the max_tokens parameter
D.Set the temperature to 0
AnswerD

Temperature controls randomness; a value of 0 makes the model deterministic, so the same prompt always yields the same output.

Why this answer

Setting the temperature to 0 makes the model deterministic, producing the same output for the same input, which is ideal for testing.

Practice this question →
14
MCQmedium

A data engineering team needs to orchestrate a complex ML pipeline that involves data extraction, transformation, model training, and deployment. They require scheduling, monitoring, and retry logic. Which MLOps tool is BEST suited for this task?

A.Weights & Biases
B.Kubeflow
C.MLflow
D.Apache Airflow
AnswerD

Airflow is a mature, flexible orchestrator for scheduling and monitoring complex pipelines.

Why this answer

Apache Airflow is a workflow orchestration tool that supports complex DAGs, scheduling, monitoring, and retries, making it ideal for ML pipelines.

Practice this question →
15
MCQeasy

An organization wants to integrate an AI-powered summarization feature into their existing web application. The AI service will be called via API. Which factor is MOST important to consider for cost management?

A.Token pricing of the AI model
B.Authentication method (API key vs. OAuth)
C.Rate limits per minute
D.Network latency to the API endpoint
AnswerA

Token pricing is the primary cost driver; optimizing prompt length and output tokens directly reduces expenses.

Why this answer

Token pricing directly impacts cost because API calls are billed based on the number of tokens (input + output). Understanding token usage helps estimate and control expenses.

Practice this question →
16
MCQmedium

A data scientist is using PyTorch to train a custom NLP model. The training is slow on a single GPU. They want to speed up training by using multiple GPUs on a single machine. Which PyTorch feature should they use?

A.TorchScript tracing
B.torch.nn.DataParallel
C.torch.optim.SGD
D.PyTorch Lightning's zero_grad function
AnswerB

DataParallel automatically splits input across GPUs and aggregates gradients; it's the simplest multi-GPU approach.

Why this answer

DataParallel (or DistributedDataParallel) is PyTorch's built-in feature to split batches across multiple GPUs. It is straightforward for single-machine multi-GPU training.

Practice this question →
17
MCQmedium

A data scientist is using a Hugging Face transformer model for a sentiment analysis task. They want to optimize inference latency for a mobile app. Which model format and framework combination is BEST suited for on-device deployment?

A.Convert to TensorFlow Lite (TFLite) and run on the device
B.Use the full PyTorch model with JIT scripting
C.Deploy the model on a cloud endpoint and call via REST API
D.Export to ONNX and use ONNX Runtime with GPU
AnswerA

TFLite is optimized for mobile devices, providing low latency and small binary size.

Why this answer

TensorFlow Lite (TFLite) is specifically designed for on-device machine learning inference on mobile and edge devices. It provides a lightweight runtime, hardware acceleration via delegates (e.g., GPU, NNAPI), and reduced model size through quantization, making it the best choice for optimizing inference latency in a mobile app. Converting a Hugging Face transformer model to TFLite allows the model to run locally without network latency, which is critical for real-time sentiment analysis on a smartphone.

Exam trap

Candidates may mistakenly think that other export formats such as ONNX or PyTorch JIT are equally suitable for mobile deployment, but the correct answer is TFLite because it is specifically designed for on-device inference with quantization and hardware acceleration, while ONNX and PyTorch JIT are primarily optimized for server-side or desktop inference.

How to eliminate wrong answers

Option B is wrong because using a full PyTorch model with JIT scripting does not produce a mobile-optimized runtime; PyTorch Mobile exists but JIT scripting alone lacks the quantization and delegate support that TFLite offers for low-latency on-device inference. Option C is wrong because deploying the model on a cloud endpoint and calling via REST API introduces network latency and dependency on connectivity, which defeats the purpose of on-device deployment for a mobile app. Option D is wrong because exporting to ONNX and using ONNX Runtime with GPU is typically designed for server or desktop environments with dedicated GPUs, not for mobile devices where GPU support is limited and ONNX Runtime Mobile is less mature than TFLite for transformer models.

Practice this question →
18
MCQmedium

A security team needs to ensure that all data used for AI model training in the cloud is encrypted at rest and in transit. Which set of measures meets this requirement on AWS?

A.Use Security Groups and Network ACLs
B.Use client-side encryption and store keys in AWS Secrets Manager
C.Enable S3 default encryption with SSE-S3 and use HTTPS for API calls
D.Enable VPC peering and use VPN connections
AnswerC

SSE-S3 encrypts data at rest in S3; HTTPS encrypts data in transit. This covers both requirements.

Why this answer

AWS provides KMS for at-rest encryption and TLS for in-transit encryption. These are standard practices to secure data across the AI pipeline.

Practice this question →
19
MCQmedium

A team uses Apache Kafka to stream real-time sensor data for ML inference. They need to process the stream, perform feature engineering, and store results in a data lake. Which tool is best suited for this streaming ML pipeline?

A.Apache Spark with Structured Streaming
B.Apache Airflow
C.TensorFlow Data Validation
D.SageMaker Processing jobs
AnswerA

Spark's structured streaming reliably processes Kafka streams with exactly-once semantics and writes to data lakes.

Why this answer

Apache Spark with Structured Streaming is best suited because it provides a unified, scalable engine for both stream processing and batch processing, enabling real-time feature engineering on Kafka streams and direct writing to a data lake (e.g., Parquet format in Amazon S3). Its micro-batch or continuous processing model integrates natively with Kafka, allowing exactly-once semantics and low-latency transformations for ML inference pipelines.

Exam trap

CompTIA often tests the distinction between stream processing engines (like Spark Structured Streaming) and orchestration or batch tools (like Airflow or SageMaker Processing), trapping candidates who confuse workflow scheduling with real-time data processing.

How to eliminate wrong answers

Option B (Apache Airflow) is wrong because it is a workflow orchestration tool for scheduling and managing DAGs, not a stream processing engine; it cannot perform real-time feature engineering on Kafka streams. Option C (TensorFlow Data Validation) is wrong because it is designed for data validation and schema inference in static datasets or batch pipelines, not for continuous stream processing or feature engineering on live sensor data. Option D (SageMaker Processing jobs) is wrong because it is a batch processing service for data preprocessing and model evaluation on static datasets, lacking native support for streaming ingestion from Kafka or real-time feature computation.

Practice this question →
20
MCQmedium

A company is deploying a computer vision model to smartphones for offline object detection. The model was trained in PyTorch. Which format should they use for deployment on iOS devices?

A.TorchScript
B.ONNX
C.Core ML
D.TensorFlow Lite
AnswerC

Core ML is Apple's native format for iOS, providing optimized inference.

Why this answer

Core ML is Apple's framework for on-device machine learning on iOS, and PyTorch models can be converted to Core ML format.

Practice this question →
21
Multi-Selecteasy

A data scientist wants to develop a computer vision model using transfer learning. They need a framework that provides pre-trained models and easy-to-use APIs for data augmentation and training. Which TWO frameworks are best suited for this task?

Select 2 answers
A.Hugging Face Transformers
B.PyTorch
C.scikit-learn
D.TensorFlow
E.Keras
AnswersB, D

PyTorch provides torchvision with pre-trained models and torchvision.transforms for data augmentation, making it ideal for transfer learning in computer vision.

Why this answer

PyTorch (option B) is correct because it offers a rich ecosystem of pre-trained models via `torchvision.models`, along with built-in data augmentation transforms in `torchvision.transforms` and a flexible training loop that is ideal for transfer learning. Its dynamic computation graph makes it easy to modify model architectures for fine-tuning, which is a core requirement for the task.

Exam trap

Candidates often select Hugging Face Transformers because it provides pre-trained models, but it is primarily designed for NLP tasks, not computer vision. Similarly, Keras is a high-level API that runs on top of TensorFlow, so it is not considered a standalone framework for this purpose.

Practice this question →
22
MCQeasy

A data engineer needs to process streaming clickstream data for real-time feature engineering in an ML pipeline. Which data pipeline technology is BEST suited for this task?

A.Apache Spark in batch mode
B.Snowflake
C.Apache Kafka
D.Apache Airflow
AnswerC

Kafka is purpose-built for real-time data streaming and can feed into ML pipelines.

Why this answer

Apache Kafka is the best choice because it is a distributed streaming platform designed for high-throughput, fault-tolerant, real-time data ingestion and processing. It can capture clickstream events as they occur and make them immediately available for feature engineering in an ML pipeline, supporting exactly-once semantics and low-latency delivery.

Exam trap

CompTIA AI often tests the distinction between data ingestion/messaging systems (Kafka) and batch processing or storage systems, leading candidates to confuse Airflow's orchestration role with actual stream processing capabilities.

How to eliminate wrong answers

Option A is wrong because Apache Spark in batch mode processes data in static, finite batches with high latency, making it unsuitable for real-time streaming clickstream data. Option B is wrong because Snowflake is a cloud-based data warehouse optimized for analytical queries on structured, stored data, not for real-time stream ingestion or processing. Option D is wrong because Apache Airflow is a workflow orchestration tool for scheduling and monitoring batch jobs, not a stream processing or messaging system capable of handling real-time data streams.

Practice this question →
23
MCQmedium

A company has a TensorFlow model trained on-premises and wants to deploy it on AWS SageMaker for scalable inference. What is the BEST way to package the model for deployment?

A.Convert the model to ONNX and upload to SageMaker
B.Upload the .h5 file to S3 and create a SageMaker endpoint directly
C.Package the model in a Docker container with a TensorFlow serving script and push to Amazon ECR
D.Use SageMaker Studio to train the model again from scratch
AnswerC

This creates an inference container that SageMaker can deploy; it includes the model and serving logic.

Why this answer

SageMaker expects models in a container format; the inference container should include the model artifacts and the serving code, allowing SageMaker to host it on scalable endpoints.

Practice this question →
24
MCQhard

During inference, a model served via a REST API occasionally returns high latency due to cold starts. The team uses a containerized service on Kubernetes with horizontal pod autoscaling. Which solution minimizes cold start impact while controlling cost?

A.Configure the autoscaler based on request count with a shorter cooldown period
B.Increase CPU and memory requests for the inference container
C.Switch to vertical pod autoscaling
D.Use a sidecar container that pre-warms the model and set a minimum replica count
AnswerD

Pre-warming ensures the model is loaded; minimum replicas keep pods ready, reducing cold starts.

Why this answer

A sidecar warm-up agent and a minimum replica count keep pods ready. Increasing resources may not fix cold starts; autoscaling based on request count may lag; vertical scaling helps but not directly.

Practice this question →
25
Multi-Selecthard

A data science team uses Vertex AI for model training and deployment. They want to implement CI/CD for ML pipelines. Which THREE Google Cloud services should they integrate?

Select 3 answers
A.Vertex AI Pipelines
B.Cloud Deploy
C.BigQuery
D.Cloud Build
E.Google Kubernetes Engine (GKE)
AnswersA, B, D

Vertex AI Pipelines is the workflow orchestrator for ML CI/CD.

Why this answer

Vertex AI Pipelines orchestrates ML workflows; Cloud Build automates builds; Cloud Deploy manages deployments. BigQuery is for analytics; GKE is for containers but not CI/CD specific.

Practice this question →
26
MCQmedium

A team uses Kubeflow to manage ML workflows on Kubernetes. They want to automate hyperparameter tuning for a training job. Which Kubeflow component should they use?

A.KFServing
B.Kubeflow Notebooks
C.Kubeflow Pipelines
D.Kubeflow Katib
AnswerD

Katib provides automated hyperparameter tuning with various algorithms.

Why this answer

Katib is the hyperparameter tuning component in Kubeflow. Pipelines orchestrate workflows; KFServing is for inference; Notebooks are for development.

Practice this question →
27
MCQmedium

A company wants to store unstructured text data for AI model training while enabling SQL-based queries for analytics. Which storage solution should they use as the primary data source?

A.A vector database like Pinecone
B.A data lake like Amazon S3
C.A data warehouse like Snowflake
D.A NoSQL database like DynamoDB
AnswerB

Data lakes store unstructured data in native format; SQL queries can be run on top via services like Athena or Presto.

Why this answer

Amazon S3 is a highly scalable object storage service that can store unstructured text data in its native format (e.g., CSV, JSON, Parquet) and supports SQL-based queries via services like Amazon Athena or S3 Select. This makes it ideal as a primary data source for AI model training while enabling analytics without requiring data transformation or loading into a separate system.

Exam trap

The trap here is that candidates often confuse a data warehouse (Snowflake) with a data lake (S3) for storing unstructured data, forgetting that data warehouses require structured schemas and are not designed for raw, schema-on-read storage.

How to eliminate wrong answers

Option A is wrong because vector databases like Pinecone are optimized for similarity search and embedding storage, not for SQL-based analytics or general unstructured text storage for training. Option C is wrong because data warehouses like Snowflake require structured, schema-on-write data and are not designed to store raw unstructured text files as the primary source. Option D is wrong because NoSQL databases like DynamoDB are key-value/document stores that enforce schema constraints and are not optimized for SQL queries on large volumes of unstructured text data.

Practice this question →
28
MCQmedium

A team is using a cloud AI service with a pay-per-token pricing model. They want to minimize costs while maintaining response quality. Which strategy is MOST effective?

A.Switch to a smaller, less capable model
B.Increase the batch size for API calls
C.Use prompt caching for repeated query patterns
D.Reduce the model's max_tokens to a very low value
AnswerC

Caching avoids reprocessing identical prompts, saving token costs and reducing latency while preserving quality.

Why this answer

Prompt caching reduces costs by avoiding redundant token processing for repeated query patterns. The cloud AI service charges per token, so caching the prefix of frequent requests (e.g., system prompts or common context) means only the new, unique tokens are billed, directly lowering expenditure without sacrificing response quality.

Exam trap

Candidates often mistakenly think that reducing model size or output length is the only way to cut costs, but the correct strategy leverages architectural features like prompt caching to reduce token consumption without affecting quality.

How to eliminate wrong answers

Option A is wrong because switching to a smaller, less capable model typically reduces response quality, which contradicts the requirement to maintain quality. Option B is wrong because increasing batch size for API calls does not reduce per-token cost; it may improve throughput but still charges for all tokens processed. Option D is wrong because reducing max_tokens to a very low value can truncate responses, degrading quality, and does not address the cost of input tokens or repeated patterns.

Practice this question →
29
Multi-Selectmedium

A company uses Azure OpenAI to generate marketing copy. They need to manage costs and ensure consistent response quality. Which TWO actions should they take?

Select 2 answers
A.Fine-tune the model on previous marketing copy
B.Use prompt caching to avoid reprocessing identical inputs
C.Switch to a cheaper, less capable model
D.Implement rate limiting and token-based throttling
E.Increase max tokens per response to ensure completeness
AnswersB, D

Caching reduces token usage and latency for repeated prompts.

Why this answer

Implementing rate limits prevents exceeding token budgets; prompt caching reduces repeated API calls. Fine-tuning is expensive; increasing max tokens may increase costs; using a less capable model may harm quality.

Practice this question →
30
MCQmedium

An organisation needs to deploy PyTorch models on mobile devices with minimal latency. Which framework or tool should they use to convert and optimise the model for on-device inference?

A.TensorFlow Lite
B.Keras for mobile
C.ONNX Runtime with Core ML conversion
D.TorchScript
AnswerD

TorchScript is PyTorch's own tool for model serialisation and optimisation for mobile deployment.

Why this answer

TorchScript is the correct choice because it is PyTorch's native model serialization and optimization format, designed specifically for deploying PyTorch models on mobile devices with minimal latency. It allows you to trace or script a PyTorch model into a static graph that can be run efficiently on iOS and Android via the PyTorch Mobile runtime, without the overhead of Python interpreter.

Exam trap

CompTIA often tests the misconception that any model can be easily converted to any mobile framework, but the trap here is that TorchScript is the only native, optimized path for PyTorch models, while options like TensorFlow Lite or ONNX Runtime require non-trivial cross-framework conversions that increase latency and complexity.

How to eliminate wrong answers

Option A is wrong because TensorFlow Lite is designed for TensorFlow models, not PyTorch; converting a PyTorch model to TensorFlow Lite requires an intermediate conversion step (e.g., ONNX) and adds complexity and potential performance loss. Option B is wrong because Keras for mobile does not exist as a standalone framework; Keras is a high-level API for TensorFlow, and mobile deployment would still rely on TensorFlow Lite, inheriting the same conversion issues. Option C is wrong because ONNX Runtime with Core ML conversion introduces an extra conversion step (PyTorch → ONNX → Core ML) that can increase latency and compatibility issues, and Core ML is specific to Apple devices, not a cross-platform mobile solution like TorchScript.

Practice this question →
31
MCQmedium

A company is using Google Cloud Vertex AI for model training. They want to automate the retraining pipeline when new data arrives in BigQuery. Which Vertex AI feature should they use?

A.Vertex AI Prediction
B.Vertex AI Pipelines
C.Vertex AI Model Registry
D.Vertex AI Feature Store
AnswerB

Pipelines can be scheduled or triggered by events to automate ML workflows.

Why this answer

Vertex AI Pipelines is the correct choice because it enables you to define, automate, and orchestrate end-to-end ML workflows, including retraining models when new data arrives. By integrating with BigQuery triggers or Cloud Scheduler, you can set up a pipeline that automatically ingests new data, preprocesses it, retrains the model, and deploys the updated version—all without manual intervention.

Exam trap

CompTIA often tests the distinction between operational tools (like Prediction or Model Registry) and orchestration tools (like Pipelines), so the trap here is confusing a component that manages models or features with the service that actually automates the end-to-end retraining workflow.

How to eliminate wrong answers

Option A is wrong because Vertex AI Prediction is a serving endpoint for deploying models to make predictions, not a tool for automating retraining pipelines. Option C is wrong because Vertex AI Model Registry is a central repository for managing model versions and metadata, but it does not orchestrate the retraining workflow itself. Option D is wrong because Vertex AI Feature Store is designed for managing and serving feature data consistently across training and serving, not for automating pipeline execution.

Practice this question →
32
MCQeasy

A machine learning engineer needs to train a deep neural network on a large image dataset. Which hardware component is specifically optimized for this task due to its high parallel processing capability and is commonly used in AI training?

A.Central Processing Unit (CPU)
B.Neural Processing Unit (NPU)
C.Graphics Processing Unit (GPU)
D.Tensor Processing Unit (TPU)
AnswerC

GPUs have thousands of cores that excel at parallel processing, making them the industry standard for training deep neural networks.

Why this answer

Graphics Processing Units (GPUs) are specifically optimized for the parallel processing required in deep neural network training. Their architecture contains thousands of smaller cores designed to handle multiple matrix operations simultaneously, which is the core computation in backpropagation and forward passes of neural networks. This makes GPUs the standard choice for training large image datasets in AI.

Exam trap

CompTIA often tests the distinction between training and inference hardware, where candidates may confuse NPUs (optimized for inference) with GPUs (optimized for training), or assume TPUs are the most common due to their specialization, when GPUs remain the industry standard for deep learning training.

How to eliminate wrong answers

Option A is wrong because CPUs are optimized for sequential, low-latency processing with a small number of powerful cores, not the massive parallelism needed for deep learning matrix operations. Option B is wrong because Neural Processing Units (NPUs) are specialized for inference (running trained models) with lower power consumption, not for the heavy parallel training workloads that GPUs handle. Option D is wrong because Tensor Processing Units (TPUs) are custom ASICs designed by Google specifically for TensorFlow workloads, but they are less commonly used in general AI training compared to GPUs, and the question asks for the hardware 'commonly used' in AI training, which is the GPU.

Practice this question →
33
MCQhard

A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?

A.Enable batching of multiple queries into a single request
B.Convert the model to ONNX and use ONNX Runtime
C.Switch from gRPC to REST with HTTP/2
D.Use a larger instance type with more CPU
AnswerA

Batching increases payload size per request, reducing per-query overhead and improving throughput/latency.

Why this answer

Batching multiple queries into a single request reduces the overhead of repeated gRPC connection setup, serialization, and network round trips for small payloads. This amortizes the fixed cost of each inference call across several queries, directly lowering per-query latency in high-throughput scenarios.

Exam trap

The AI0-001 exam often tests the misconception that model optimization (ONNX) or hardware upgrades are the default fix for latency, when the real bottleneck for small payloads is network and serialization overhead, which batching directly mitigates.

How to eliminate wrong answers

Option B is wrong because converting to ONNX and using ONNX Runtime primarily improves inference speed through model optimization and hardware acceleration, but it does not address the network and serialization overhead that dominates latency for small payloads. Option C is wrong because switching from gRPC to REST with HTTP/2 would likely increase latency, as gRPC already uses HTTP/2 and provides more efficient binary serialization (Protobuf) compared to REST's text-based JSON. Option D is wrong because using a larger instance type with more CPU addresses compute-bound bottlenecks, but the high latency here is due to network and protocol overhead, not CPU capacity.

Practice this question →
34
MCQmedium

A company wants to build an AI pipeline that processes streaming data from IoT sensors, performs feature engineering, trains a model incrementally, and deploys the updated model. Which data pipeline technology is BEST suited for the streaming ingestion step?

A.Amazon S3
B.Apache Spark
C.Apache Airflow
D.Apache Kafka
AnswerD

Kafka is purpose-built for ingesting and storing high-volume streaming data with low latency.

Why this answer

Apache Kafka is the best choice for the streaming ingestion step because it is a distributed event streaming platform designed for high-throughput, fault-tolerant ingestion of real-time data streams. It acts as a durable message broker that can ingest IoT sensor data in real time and make it available for downstream processing, which aligns perfectly with the requirement for streaming data ingestion.

Exam trap

CompTIA often tests the distinction between data ingestion (Kafka), data processing (Spark), and data storage (S3), so the trap here is confusing Apache Spark's streaming capability with a dedicated ingestion tool, leading candidates to choose Spark instead of Kafka.

How to eliminate wrong answers

Option A is wrong because Amazon S3 is an object storage service designed for batch storage of static files, not for real-time streaming ingestion; it lacks the low-latency publish-subscribe mechanism needed for streaming data. Option B is wrong because Apache Spark is a distributed processing engine that can handle streaming data via Spark Streaming, but it is not a data ingestion technology—it consumes data from sources like Kafka rather than ingesting it directly. Option C is wrong because Apache Airflow is a workflow orchestration tool for scheduling and managing batch pipelines, not a real-time streaming ingestion platform; it cannot handle continuous, low-latency data streams.

Practice this question →
35
Multi-Selecthard

A machine learning engineer is designing a pipeline to train a computer vision model using PyTorch on a large dataset stored in an S3 data lake. They need to preprocess images (resize, normalize) and stream them efficiently to GPUs. Which THREE components are essential in this pipeline? (Select THREE.)

Select 3 answers
A.GPU-accelerated training with CUDA
B.CPU-only inference pipeline
C.Apache Airflow to orchestrate the training job
D.PyTorch DataLoader with multi-processing for batching and shuffling
E.Distributed data parallel (DDP) training across multiple GPUs
AnswersA, D, E

GPU acceleration is essential for fast training of deep neural networks.

Why this answer

GPU-accelerated training with CUDA is essential for efficiently training computer vision models on large datasets. PyTorch leverages CUDA to parallelize tensor operations and model computations on NVIDIA GPUs, which is critical for reducing training time from days to hours when processing high-resolution images.

Exam trap

CompTIA often tests the distinction between essential pipeline components (like GPU acceleration and efficient data loading) versus optional orchestration tools (like Airflow) that are not required for the core training loop.

Practice this question →
36
Multi-Selectmedium

A startup is building a recommendation system that requires low-latency similarity search over millions of product embeddings. They need a vector database that offers high performance and has a managed cloud option. Which TWO databases are best suited for this requirement?

Select 2 answers
A.Chroma
B.Weaviate
C.pgvector (PostgreSQL extension)
D.Amazon DynamoDB
E.Pinecone
AnswersB, E

Weaviate offers a managed cloud service with vector search.

Why this answer

Weaviate and Pinecone are both purpose-built vector databases that natively support high-performance approximate nearest neighbor (ANN) search using algorithms like HNSW (Weaviate) or proprietary indexing (Pinecone). They offer managed cloud services with automatic scaling, making them ideal for low-latency similarity search over millions of product embeddings without requiring manual infrastructure management.

Exam trap

CompTIA often tests the distinction between general-purpose databases with vector extensions (like pgvector) and purpose-built vector databases (like Weaviate and Pinecone), where candidates mistakenly assume any database with vector support is suitable for production-scale low-latency workloads.

Practice this question →
37
MCQmedium

An AI team uses SageMaker Pipelines to orchestrate their ML workflow. They need to version the pipeline and track experiments across runs. Which complementary MLflow feature should they integrate?

A.MLflow Tracking
B.MLflow Models
C.MLflow Projects
D.MLflow Model Registry
AnswerA

MLflow Tracking logs parameters, metrics, and artifacts per run, enabling experiment comparison and reproducibility.

Why this answer

MLflow Tracking is the correct complementary feature because it provides a centralized API and UI for logging parameters, metrics, and artifacts (e.g., model checkpoints, datasets) from each SageMaker Pipeline run. This enables the team to version their pipeline executions and compare experiments across different runs, directly addressing the requirement for tracking and versioning.

Exam trap

The AI0-001 exam often tests the distinction between tracking (logging run metadata) and registry (managing model versions), so the trap here is that candidates confuse MLflow Model Registry's versioning of models with the pipeline versioning and experiment tracking requirement, leading them to select D instead of A.

How to eliminate wrong answers

Option B (MLflow Models) is wrong because it focuses on packaging ML models in a standardized format (e.g., MLflow Model flavor) for deployment, not on logging run metadata or versioning pipeline executions. Option C (MLflow Projects) is wrong because it is a packaging format for code and dependencies to enable reproducible runs, not a tool for tracking experiments or pipeline versions. Option D (MLflow Model Registry) is wrong because it manages model lifecycle stages (e.g., staging, production) and versioning of registered models, not the tracking of pipeline runs or experiment parameters.

Practice this question →
38
MCQeasy

An AI team wants to version control datasets, track experiments, and log model parameters across multiple projects. Which MLOps platform is specifically designed for experiment tracking and model management?

A.MLflow
B.SageMaker Pipelines
C.Vertex AI Pipelines
D.Kubeflow
AnswerA

MLflow is the correct answer; it provides experiment tracking, model registry, and project packaging.

Why this answer

MLflow is an open-source MLOps platform specifically designed for experiment tracking, model management, and reproducibility. It provides a unified API to log parameters, metrics, and artifacts across multiple projects, making it the correct choice for versioning datasets, tracking experiments, and managing models.

Exam trap

CompTIA often tests the distinction between general-purpose pipeline orchestration tools (like SageMaker Pipelines, Vertex AI Pipelines, and Kubeflow) and purpose-built experiment tracking platforms (like MLflow), so the trap is assuming any pipeline tool inherently includes experiment tracking and model management capabilities.

How to eliminate wrong answers

Option B (SageMaker Pipelines) is wrong because it is a fully managed CI/CD service for building, training, and deploying ML pipelines on AWS, but it is not specifically designed for experiment tracking and model management; it focuses on workflow orchestration. Option C (Vertex AI Pipelines) is wrong because it is a serverless ML pipeline service on Google Cloud that orchestrates training and deployment workflows, but it lacks the dedicated experiment tracking and model registry features that MLflow provides. Option D (Kubeflow) is wrong because it is a Kubernetes-native platform for deploying and managing ML workflows, but its primary focus is on orchestration and portability across clusters, not on experiment tracking and model management as a core feature.

Practice this question →
39
MCQeasy

Which of the following is a key advantage of using ONNX (Open Neural Network Exchange) format for model deployment?

A.It automatically quantizes models to INT8
B.It enables framework interoperability for model inference
C.It compresses model size by 90%
D.It reduces training time
AnswerB

ONNX provides a standard format that can be used across different frameworks and runtimes.

Why this answer

ONNX provides a standardized, open format for representing machine learning models, enabling seamless interoperability between different frameworks (e.g., PyTorch, TensorFlow, scikit-learn). This allows a model trained in one framework to be deployed for inference using a different runtime or hardware accelerator without requiring retraining or manual conversion, which is a key advantage in heterogeneous production environments.

Exam trap

CompTIA often tests the misconception that ONNX provides built-in performance optimizations like quantization or compression, when in fact its primary value is framework interoperability, and any performance gains come from the runtime or additional tools, not the format itself.

How to eliminate wrong answers

Option A is wrong because ONNX does not automatically quantize models to INT8; quantization is a separate optimization step that can be applied to ONNX models using tools like ONNX Runtime or Intel Neural Compressor, but it is not an inherent feature of the format itself. Option C is wrong because ONNX does not inherently compress model size by 90%; while ONNX models may be slightly more compact than some framework-specific formats due to serialization, significant compression requires techniques like pruning or quantization, and 90% reduction is not guaranteed. Option D is wrong because ONNX is a model representation format for inference and interoperability, not a training framework; it does not reduce training time, which depends on the training framework, hardware, and algorithm used.

Practice this question →
40
MCQmedium

A company needs to store large volumes of unstructured data (PDFs, images, logs) for future AI model training. The data must be easily accessible by data scientists using Spark and must support cost-effective storage. Which data infrastructure is MOST appropriate?

A.Snowflake data warehouse
B.Relational database like Amazon RDS
C.Pinecone vector database
D.Amazon S3 data lake
AnswerD

S3 is a scalable, low-cost object store for unstructured data; it integrates with Spark and is ideal for a data lake.

Why this answer

A data lake stores raw, unstructured data at low cost and integrates with Spark. Data warehouses are for structured, processed data; vector databases are for embeddings.

Practice this question →
41
MCQeasy

Which hardware accelerator is specifically designed by Google for training and inference of machine learning models, particularly their TensorFlow framework?

A.NPU
B.FPGA
C.GPU
D.TPU
AnswerD

TPU is Google's custom chip for ML, optimized for TensorFlow.

Why this answer

TPU (Tensor Processing Unit) is Google's custom ASIC designed to accelerate ML workloads, especially with TensorFlow.

Practice this question →
42
MCQhard

An ML team uses Kubeflow to orchestrate a pipeline that includes data preprocessing, model training, and evaluation. The pipeline runs on a Kubernetes cluster. After a cluster upgrade, the pipeline fails at the training step with an 'OOMKilled' error. What is the MOST likely cause?

A.The training code has a memory leak
B.The pipeline definition is missing a step dependency
C.The Kubernetes node's memory resources were not correctly allocated to the pod's resource requests or limits
D.The training data is corrupted
AnswerC

After upgrade, default resource limits may have changed, or the pod's memory request exceeded available node memory, causing OOMKill.

Why this answer

OOMKilled indicates the container exceeded its memory limit. The resource requests/limits likely were not adjusted for the new cluster configuration, or the node's allocatable memory decreased after upgrade.

Practice this question →
43
MCQmedium

A data engineer is building a pipeline to process streaming clickstream data and feed it into a real-time ML feature store. Which tool is BEST suited for the streaming ingestion?

A.Amazon S3
B.Apache Airflow
C.Apache Spark (batch mode)
D.Apache Kafka
AnswerD

Kafka provides low-latency, durable streaming, ideal for real-time clickstream ingestion into feature stores.

Why this answer

Apache Kafka is the industry standard for high-throughput, fault-tolerant streaming data ingestion. It can handle real-time clickstream data and integrate with feature stores.

Practice this question →
44
MCQeasy

A developer is building a mobile app that uses a pre-trained image classification model on-device. Which framework should they use to run the model on iOS devices?

A.Hugging Face Transformers
B.TensorFlow Lite
C.PyTorch Mobile
D.Core ML
AnswerD

Core ML is Apple's native framework for on-device ML inference on iOS devices.

Why this answer

Core ML is Apple's framework for on-device machine learning inference on iOS. TensorFlow Lite is for mobile and embedded, but Core ML is native to iOS and optimized.

Practice this question →
45
Multi-Selecthard

An organisation is deploying a fine-tuned LLM for internal use. They need to ensure the API endpoint is secure and cost-effective. Which TWO measures should they implement? (Choose 2)

Select 2 answers
A.Implement API key authentication
B.Enable content filtering
C.Disable logging to reduce storage costs
D.Apply rate limiting per user
E.Use gRPC instead of REST
AnswersA, D

API keys restrict access to authorised clients.

Why this answer

API key authentication (Option A) is a fundamental security measure that ensures only authorized clients can access the LLM endpoint. It provides a simple, lightweight mechanism to validate requests without the overhead of full OAuth, making it both secure and cost-effective for internal deployments.

Exam trap

The CompTIA AI+ exam tests the distinction between security measures (authentication, rate limiting) and non-security features (content filtering, protocol choice), leading candidates to mistakenly select content filtering or gRPC as security controls.

Practice this question →
46
MCQmedium

A data scientist needs to train a deep learning model on a large image dataset. Which hardware is most suitable for parallel matrix operations and faster training compared to a CPU?

A.GPU with thousands of CUDA cores
B.TPU designed for TensorFlow
C.CPU with high clock speed
D.FPGA for reconfigurable logic
AnswerA

GPUs excel at parallel matrix multiplications, drastically reducing training time for deep learning models.

Why this answer

A GPU with thousands of CUDA cores is the most suitable hardware for parallel matrix operations because deep learning training involves massive matrix multiplications and tensor operations that can be decomposed into thousands of independent threads. CUDA cores execute these threads in a massively parallel SIMT (Single Instruction, Multiple Thread) fashion, achieving significantly higher throughput than a CPU for such workloads, which leads to faster training times.

Exam trap

CompTIA often tests the misconception that a TPU is always the best choice for deep learning, but the trap here is that the question specifies 'parallel matrix operations' and 'faster training compared to a CPU' without limiting the framework to TensorFlow, making the GPU the most universally suitable and correct answer.

How to eliminate wrong answers

Option B is wrong because a TPU is a custom ASIC designed specifically for TensorFlow workloads, but the question asks for the most suitable hardware for parallel matrix operations in general, and GPUs are more widely supported across deep learning frameworks (PyTorch, TensorFlow, etc.) and offer greater flexibility for various model architectures. Option C is wrong because a CPU with high clock speed excels at sequential, latency-sensitive tasks but has a limited number of cores (typically 8–64) compared to a GPU's thousands of cores, making it inefficient for the massive parallelism required in deep learning training. Option D is wrong because an FPGA offers reconfigurable logic for custom hardware acceleration but requires significant development effort and has lower floating-point throughput per watt compared to a GPU for standard deep learning operations, making it less practical for general-purpose training.

Practice this question →
47
MCQhard

A data science team is deploying a real-time fraud detection model on edge devices in retail stores. The model must infer under 10ms and fit within 50MB memory. Which combination of techniques should the team apply?

A.Model parallelism and distributed inference
B.Increase batch size and use FP16 precision
C.Train a larger model and use distillation to transfer knowledge
D.Model quantization to INT8 and pruning of low-weight connections
AnswerD

INT8 quantization reduces model size and latency; pruning eliminates unnecessary weights, meeting both memory and speed constraints.

Why this answer

Quantization reduces model precision (e.g., FP32 to INT8) to shrink memory and speed up inference, while pruning removes redundant parameters. Distillation can further compress. These are standard for edge deployment.

Practice this question →
48
MCQhard

An MLOps team observes that their production inference API experiences increasing latency as more concurrent requests arrive. They need to scale horizontally while maintaining session state of preprocessing steps. Which deployment strategy should they implement?

A.Deploy stateless containers without session persistence
B.Use a single larger GPU instance to handle all requests
C.Deploy multiple instances behind a round-robin load balancer with sticky sessions
D.Implement a message queue (e.g., Kafka) to buffer requests
AnswerC

Sticky sessions ensure that all requests from a user session are routed to the same instance, preserving session state during horizontal scaling.

Why this answer

Sticky sessions (session affinity) ensure that all requests from a given client are routed to the same backend instance, preserving the in-memory session state of preprocessing steps. Combined with a round-robin load balancer, this allows horizontal scaling while maintaining stateful behavior, which is essential for the described latency issue under concurrent load.

Exam trap

CompTIA AI exams often test the distinction between stateless and stateful scaling. Candidates may incorrectly choose message queues (Option D) thinking they solve concurrency, but they do not preserve synchronous session state needed for preprocessing steps.

How to eliminate wrong answers

Option A is wrong because stateless containers without session persistence would lose the preprocessing session state between requests, breaking the required stateful behavior. Option B is wrong because scaling vertically with a single larger GPU instance does not address horizontal scaling needs and creates a single point of failure, while also not solving the latency increase under concurrent requests. Option D is wrong because a message queue like Kafka buffers requests asynchronously, which introduces decoupling and potential ordering issues, but does not directly provide horizontal scaling with session state preservation for synchronous inference requests.

Practice this question →

Ready to test yourself?

Try a timed practice session using only Aio Ai Infrastructure questions.

Start 20-question session