How should I use these AI Infrastructure and Technologies practice questions?

Read each scenario carefully and choose your answer before revealing the explanation. Then check why your choice was right or wrong. Repeat until the reasoning feels automatic.

AI0-001 · topic practice

AI Infrastructure and Technologies practice questions

Q: Can I practise just AI Infrastructure and Technologies questions in a focused session?

Yes — use the session launcher on this page to start a 10-, 20-, 30- or 50-question session drawn entirely from the AI Infrastructure and Technologies domain.

This domain covers the compute, storage, networking, and pipeline infrastructure that hosts AI workloads. Expect scenario questions on choosing accelerators, deployment topologies, streaming data tooling, and model packaging for cloud inference. You must match a stated constraint — latency, compliance, scale, or existing stack — to the correct service or architecture rather than the most familiar one.

Courseiva uses original exam-style practice questions designed for learning and revision. The goal is to understand the concepts, recognise exam patterns, and improve through explanations — not memorise copied exam dumps.

Editorial oversight:Johnson Ajibi· MSc IT Security, IEEE Senior Member

20 questionsDomain: AI Infrastructure and Technologies

Practice 10 questions Browse domain →

What the exam tests

What to know about AI Infrastructure and Technologies

Be able to select accelerators, deployment architectures, streaming tools, and model packaging formats from stated constraints. The single most important skill is mapping the constraint — latency, compliance, cloud vendor, or data velocity — to the correct infrastructure choice, not the most familiar one.

Google Cloud TPUs purpose-built for large neural network training and inference

On-premises GPU inference serving for compliance-bound low-latency LLM deployment

Apache Kafka plus stream processing for real-time feature engineering into a data lake

Packaging TensorFlow models as SageMaker model artifacts for scalable AWS inference

Watch out for

Common AI Infrastructure and Technologies exam traps

▸Assuming any GPU instance fits every inference job; ignoring that TPUs are Google-specific and not portable to AWS or on-prem
▸Choosing a batch or serverless pipeline for real-time streaming ML when the requirement is continuous low-latency processing
▸Uploading raw training checkpoints to SageMaker without the expected model artifact structure and inference handler

Practice set

AI Infrastructure and Technologies questions

20 questions · select your answer, then reveal the explanation

Question 1hardmultiple choice

Read the full AI Infrastructure and Technologies explanation →

A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?

Trap 1: Convert the model to ONNX and use ONNX Runtime

ONNX Runtime can speed up inference, but the latency issue is likely due to request overhead, not model compute.

Trap 2: Switch from gRPC to REST with HTTP/2

Both support HTTP/2; gRPC is binary and typically faster. The issue is likely overhead from stream establishment.

Trap 3: Use a larger instance type with more CPU

Compute power may not be the bottleneck; more CPU adds cost without addressing protocol overhead.

Study all AI Infrastructure and Technologies common traps →

A
Enable batching of multiple queries into a single request
Batching increases payload size per request, reducing per-query overhead and improving throughput/latency.
B
Convert the model to ONNX and use ONNX Runtime
Why it fails: ONNX Runtime can speed up inference, but the latency issue is likely due to request overhead, not model compute.
C
Switch from gRPC to REST with HTTP/2
Why it fails: Both support HTTP/2; gRPC is binary and typically faster. The issue is likely overhead from stream establishment.
D
Use a larger instance type with more CPU
Why it fails: Compute power may not be the bottleneck; more CPU adds cost without addressing protocol overhead.

AI Infrastructure and Technologies practice questions

What to know about AI Infrastructure and Technologies

Common AI Infrastructure and Technologies exam traps

AI Infrastructure and Technologies questions

A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?

An organization uses Azure Machine Learning to manage the ML lifecycle. They want to automatically retrain a model when new data arrives in Azure Blob Storage. Which Azure service should they integrate with Azure ML to trigger retraining?

A startup is building a recommendation system that requires low-latency similarity search over millions of product embeddings. They need a vector database that offers high performance and has a managed cloud option. Which TWO databases are best suited for this requirement?

A data scientist wants to build a proof-of-concept chatbot using a large language model. They need to choose a cloud AI platform that provides easy access to pre-trained models via API, with built-in safety filters and prompt engineering tools. Which TWO platforms are best suited?

A data scientist needs to train a deep learning model on a large image dataset. Which hardware is most suitable for parallel matrix operations and faster training compared to a CPU?

A company uses a vector database to store embeddings for a RAG application. Users report that some queries return irrelevant results. Which adjustment is most likely to improve relevance?

An AI team uses SageMaker Pipelines to orchestrate their ML workflow. They need to version the pipeline and track experiments across runs. Which complementary MLflow feature should they integrate?

Which AWS service would a developer use to integrate a pre-built foundation model into an application via API, without managing underlying infrastructure?

A company wants to store unstructured text data for AI model training while enabling SQL-based queries for analytics. Which storage solution should they use as the primary data source?

A company uses Azure OpenAI to generate marketing copy. They need to manage costs and ensure consistent response quality. Which TWO actions should they take?

A machine learning engineer needs to deploy a PyTorch model for real-time inference with low latency. The model uses custom operators that are not supported by standard ONNX conversion. Which deployment approach is MOST appropriate?

A data engineering team needs to orchestrate a complex ML pipeline that involves data extraction, transformation, model training, and deployment. They require scheduling, monitoring, and retry logic. Which MLOps tool is BEST suited for this task?

A team is deploying a model on a cloud-based ML service and needs to handle variable traffic patterns with automatic scaling based on request latency. They want to minimize costs during low traffic. Which endpoint configuration should they use?

A data scientist is deploying a model on edge devices using TensorFlow Lite. The model currently uses FP32 precision. Which TWO techniques can reduce the model size and improve inference speed without significant accuracy loss? (Choose TWO.)

A team is using Kubeflow to orchestrate ML workflows on Kubernetes. They need to ensure reproducibility, track experiments, and share models across the organization. Which THREE components or tools should they integrate? (Choose THREE.)

A company uses AWS SageMaker to train a large language model. The training job fails with an out-of-memory error. The team is already using the largest available GPU instance. Which step should the team take to resolve the issue without modifying the model architecture?

An organisation needs to deploy PyTorch models on mobile devices with minimal latency. Which framework or tool should they use to convert and optimise the model for on-device inference?

A team is using Hugging Face Transformers to serve an LLM via a REST API. They notice high latency during inference. The model is deployed on a single GPU. Which optimisation would reduce inference latency WITHOUT changing the model architecture?

A healthcare AI startup must store and query high-dimensional embeddings of medical records for a RAG system. They need low-latency similarity search at scale. Which database should they choose?

An MLOps team observes that their production inference API experiences increasing latency as more concurrent requests arrive. They need to scale horizontally while maintaining session state of preprocessing steps. Which deployment strategy should they implement?

Track your progress over time

Start a AI Infrastructure and Technologies only practice session

Related AI0-001 topic practice pages

Implementing AI Solutions practice questions

AI Governance and Ethics practice questions

AI Concepts and Techniques practice questions

AI Concepts and Foundations practice questions

AI Security practice questions

AI Infrastructure and Technologies practice questions

AI Models and Data Engineering practice questions

Machine Learning and Deep Learning practice questions

AI Security, Ethics and Governance practice questions

AI Implementation and Operations practice questions

CompTIA A+ hardware practice questions

CompTIA A+ mobile devices practice questions

Frequently asked questions

Track your progress

Study resources

Exam traps to avoid