Courseiva

CCNA Ai Implementation Operations Questions

16 of 91 questions · Page 2/2 · Ai Implementation Operations topic · Answers revealed

Practice these questionsExam hubAll questions
76
Multi-Selecteasy

Which THREE components are essential in an MLOps pipeline?

Select 3 answers
A.Data versioning
B.Manual code review
C.Deployment automation
D.Hardware procurement
E.Automated model testing
AnswersA, C, E

Versioning data is crucial for reproducibility and tracking.

Why this answer

Data versioning (A) is essential in an MLOps pipeline because it ensures reproducibility and traceability of datasets used for training, validation, and testing. Without versioning, changes to data cannot be tracked, leading to inconsistent model behavior and difficulty in debugging. Tools like DVC or Git LFS enable precise snapshotting of data, which is critical for auditing and rollback in production AI systems.

Exam trap

CompTIA often tests the distinction between operational pipeline components (automation, testing, versioning) and peripheral activities (procurement, manual reviews) to see if candidates understand that MLOps is about automating the ML lifecycle, not general IT operations.

Practice this question →
77
MCQeasy

A team of data scientists and engineers is working on multiple AI projects. They often struggle to reproduce experiments and manage model versions. Which tool or practice should they adopt?

A.Document experiments in a shared Word document.
B.Share code via email attachments.
C.Keep all models in a shared network drive.
D.Use an MLOps platform that provides version control, tracking, and reproducibility.
AnswerD

MLOps platforms are designed to manage the ML lifecycle effectively.

Why this answer

An MLOps platform (e.g., MLflow, Kubeflow, or Vertex AI) provides integrated version control for code, data, and models, along with experiment tracking and reproducibility. This directly addresses the team's struggle to reproduce experiments and manage model versions by automating lineage capture and enabling consistent environment recreation.

Exam trap

CompTIA often tests the misconception that simple file-sharing or document-based approaches are sufficient for reproducibility, when in fact they lack the automated lineage and environment locking that MLOps platforms provide.

How to eliminate wrong answers

Option A is wrong because a shared Word document lacks automated versioning, dependency tracking, and execution capture, making it impossible to reliably reproduce experiments from static text. Option B is wrong because sharing code via email attachments introduces version confusion, lacks any form of change tracking or environment locking, and violates basic software engineering practices for collaboration. Option C is wrong because keeping models on a shared network drive provides no version history, no lineage to training code or data, and no mechanism to roll back or compare model iterations, leading to overwrites and irreproducible results.

Practice this question →
78
MCQmedium

During model monitoring, a loan approval model shows disparate impact against a protected group. The model's overall accuracy is high, but the false positive rate for the protected group is 0.12 compared to 0.02 for other groups. Which action should the operations team take first?

A.Document the disparity and proceed with deployment because accuracy is high
B.Replace the model with a simpler model that is less discriminatory
C.Retrain the model with reweighted training data to minimize disparity
D.Adjust the decision threshold for the protected group to equalize false positive rates
AnswerC

Retraining with fairness constraints directly mitigates bias in the model.

Why this answer

Retraining the model with reweighted training data directly addresses the root cause of disparate impact—biased historical data—by assigning higher weights to underrepresented groups during training. This technique, often implemented via cost-sensitive learning or sample reweighting, adjusts the model's internal decision boundaries to reduce false positive rate disparities without sacrificing overall accuracy. The operations team should first attempt to mitigate bias at the data level before considering threshold adjustments or model replacement, as reweighting preserves the model's learned patterns while promoting fairness.

Exam trap

CompTIA often tests the misconception that adjusting the decision threshold for a specific group is a quick fix for disparate impact, but the trap is that this violates the principle of equal treatment and can introduce legal liability, whereas retraining with reweighted data addresses bias at the algorithmic level without changing the decision rule per group.

How to eliminate wrong answers

Option A is wrong because documenting the disparity and proceeding with deployment ignores the ethical and regulatory requirement to address disparate impact, even if overall accuracy is high; high accuracy can mask significant bias against protected groups. Option B is wrong because replacing the model with a simpler model does not guarantee less discrimination—simplicity does not correlate with fairness, and a simpler model may still exhibit bias or have lower predictive performance. Option D is wrong because adjusting the decision threshold for the protected group alone treats the symptom (unequal false positive rates) rather than the cause, and can lead to calibration drift, reduced model interpretability, and potential legal issues under the Equal Credit Opportunity Act (ECOA) by applying different standards to different groups.

Practice this question →
79
MCQeasy

An organization deploys an AI model on edge devices for real-time image classification. Which metric is most important to monitor for ensuring the device's operational health?

A.Model calibration error
B.Inference memory consumption
C.Average prediction confidence
D.Model accuracy on local test data
AnswerB

Memory is a key operational health indicator for edge devices.

Why this answer

For edge devices with limited resources, inference memory consumption is the most critical operational health metric because exceeding available memory can cause the model to crash or the device to become unresponsive. Unlike accuracy or confidence, memory usage directly reflects whether the device can sustain real-time inference without resource exhaustion.

Exam trap

CompTIA often tests the misconception that model accuracy or confidence is the primary concern for operational health, but the trap here is that edge device stability depends on resource constraints like memory, not model performance metrics.

How to eliminate wrong answers

Option A is wrong because model calibration error measures the reliability of predicted probabilities, not the operational health of the device. Option C is wrong because average prediction confidence indicates model certainty, not whether the device has sufficient memory to run inference. Option D is wrong because model accuracy on local test data evaluates model performance, not the device's ability to operate without memory overflow or system failure.

Practice this question →
80
MCQeasy

A company must deploy a new model version with zero downtime. The current model is served via a REST API on a Kubernetes cluster. Which deployment strategy should the team use to gradually shift traffic to the new version while monitoring for errors?

A.Blue-green deployment
B.Canary deployment
C.Recreate deployment
D.Rolling update
AnswerB

Canary deployment gradually routes traffic to the new version for safe rollout.

Why this answer

A canary deployment gradually shifts a small percentage of traffic to the new model version while the majority continues to hit the stable version. This allows the team to monitor for errors and roll back quickly if issues arise, achieving zero downtime. It is the ideal strategy for validating a new model in production with minimal risk.

Exam trap

The trap here is that candidates confuse 'rolling update' with 'canary deployment' because both involve gradual changes, but a rolling update replaces pods sequentially without the ability to route a controlled subset of traffic for targeted monitoring and rollback.

How to eliminate wrong answers

Option A is wrong because blue-green deployment switches all traffic at once from the old to the new environment, which does not provide gradual traffic shifting or incremental error monitoring; it is an all-or-nothing cutover. Option C is wrong because recreate deployment tears down the old version before deploying the new one, causing downtime and violating the zero-downtime requirement. Option D is wrong because a rolling update replaces pods incrementally but does not allow fine-grained traffic splitting or canary-style monitoring; it updates all instances without a separate traffic-routing phase for error detection.

Practice this question →
81
MCQhard

An organization is implementing an AI-powered chatbot for customer service. The chatbot must comply with GDPR and handle data subject access requests (DSARs). Which design approach best ensures compliance?

A.Minimize data collection by not logging any user interactions.
B.Anonymize all user data before logging interactions.
C.Implement an audit trail that logs interactions with a unique user identifier, and provide a mechanism to delete logs upon user request.
D.Encrypt all chat logs and store them indefinitely for audit purposes.
AnswerC

This ensures compliance with the right to access and erasure under GDPR.

Why this answer

GDPR requires that personal data be stored only as long as necessary and that data subjects have the right to erasure. By logging interactions with a unique user identifier and providing a deletion mechanism, the chatbot can fulfill DSARs while maintaining an audit trail for compliance monitoring. This approach balances operational needs with regulatory obligations.

Exam trap

CompTIA often tests the misconception that GDPR requires complete data minimization (Option A) or indefinite encryption (Option D), when in fact the regulation mandates a balance between data utility and privacy rights, including the ability to delete data upon request.

How to eliminate wrong answers

Option A is wrong because not logging any user interactions prevents the organization from monitoring chatbot performance, improving the AI model, or detecting security incidents, and GDPR does not prohibit all logging—only excessive or unnecessary data collection. Option B is wrong because anonymization must be irreversible to be GDPR-compliant; if the data can be re-identified (e.g., via correlation with other logs), it is pseudonymization, which still subjects it to GDPR requirements, and anonymizing before logging does not address the need to handle DSARs for data that was originally personal. Option D is wrong because storing chat logs indefinitely violates the GDPR storage limitation principle (Article 5(1)(e)), which mandates that personal data be kept no longer than necessary for the purpose for which it is processed.

Practice this question →
82
MCQmedium

A company uses an AI system to recommend products. The recommendation accuracy is high, but users complain about lack of diversity. Which strategy should the team adopt to improve diversity without significantly sacrificing accuracy?

A.Randomly replace some recommendations with popular items.
B.Use only popularity-based recommendations.
C.Increase the number of recommendations and use collaborative filtering.
D.Modify the loss function to include a term that penalizes overly similar recommendations.
AnswerD

This explicitly encourages diversity while retaining accuracy.

Why this answer

Modifying the loss function to include a diversity penalty directly addresses the lack of recommendation diversity at the algorithmic level. By adding a regularization term that penalizes overly similar recommendations, the model learns to balance accuracy with variety, ensuring that the output set remains diverse without a significant drop in relevance. This approach is a standard technique in recommendation systems, often implemented via Determinantal Point Processes (DPPs) or diversity-aware loss functions.

Exam trap

CompTIA often tests the misconception that simply adding more recommendations or using popularity will solve diversity issues, when in reality, algorithmic constraints like loss function modification are required to maintain accuracy while improving diversity.

How to eliminate wrong answers

Option A is wrong because randomly replacing some recommendations with popular items introduces noise and can significantly degrade accuracy, as popular items may not be relevant to the user's specific preferences. Option B is wrong because using only popularity-based recommendations completely ignores personalization, leading to a severe loss of accuracy and user-specific relevance. Option C is wrong because simply increasing the number of recommendations and using collaborative filtering does not inherently enforce diversity; it may still produce a homogeneous set of similar items, and the increased list size can dilute relevance without a diversity constraint.

Practice this question →
83
MCQhard

A real-time recommendation system uses a model retrained daily. The operations team notices that click-through rate drops sharply at 8 AM each day and recovers by noon. The retraining job runs at midnight. What is the most likely cause?

A.The model overfits to late-night user behavior
B.The model suffers from catastrophic forgetting due to daily retraining
C.There is data drift due to morning user patterns not seen in training
D.The retraining pipeline has a bug that only affects morning predictions
AnswerC

Morning patterns differ from training data, causing a temporary performance drop until the model adapts through retraining.

Why this answer

The sharp drop in click-through rate at 8 AM, followed by recovery by noon, strongly indicates data drift caused by a shift in user behavior patterns during morning hours. Since the model is retrained at midnight using data that predominantly captures late-night user behavior, it fails to generalize to the distinct morning user patterns (e.g., different browsing habits, content preferences). This is a classic example of temporal data drift where the training distribution does not match the inference distribution at specific times of day.

Exam trap

CompTIA often tests the distinction between data drift and model degradation issues; the trap here is that candidates might confuse a temporary performance dip due to distribution shift (data drift) with a permanent model flaw like overfitting or catastrophic forgetting, which would not self-correct within the same day.

How to eliminate wrong answers

Option A is wrong because overfitting to late-night user behavior would cause poor performance during morning hours, but the recovery by noon suggests the model adapts as more morning data becomes available, not that it is permanently overfit. Option B is wrong because catastrophic forgetting refers to a model losing previously learned knowledge when trained on new data, which would cause a persistent performance drop, not a temporary one that recovers within hours. Option D is wrong because a pipeline bug that only affects morning predictions would likely cause consistent errors or failures at 8 AM every day, not a gradual recovery by noon, and there is no evidence of a bug in the retraining process itself.

Practice this question →
84
MCQhard

A team is implementing an ML pipeline using a feature store. Which benefit does a feature store primarily provide in an AI operations context?

A.Automated scaling of inference endpoints
B.Real-time monitoring of model performance
C.Consistency of feature computation between training and inference
D.Automatic model versioning and rollback
AnswerC

Feature store provides a centralized, consistent feature computation pipeline.

Why this answer

A feature store ensures that feature engineering logic is stored, versioned, and reused consistently across both training and inference pipelines. This eliminates training-serving skew, a common cause of model degradation in production, by guaranteeing that the same transformations are applied to data regardless of when or where it is computed.

Exam trap

CompTIA often tests the distinction between infrastructure-level benefits (scaling, monitoring, versioning) and the core data-consistency problem that a feature store solves, leading candidates to confuse feature stores with model registries or serving platforms.

How to eliminate wrong answers

Option A is wrong because automated scaling of inference endpoints is a function of model serving infrastructure (e.g., Kubernetes Horizontal Pod Autoscaler or serverless inference platforms), not a primary benefit of a feature store. Option B is wrong because real-time monitoring of model performance is handled by observability tools (e.g., MLflow, Prometheus, or custom drift detection systems), not by the feature store itself. Option D is wrong because automatic model versioning and rollback is a capability of model registries and CI/CD pipelines (e.g., MLflow Model Registry or DVC), whereas a feature store focuses on feature definitions and values, not model artifacts.

Practice this question →
85
MCQmedium

A company deployed a chatbot using a pre-trained language model. Users report that the chatbot provides incorrect answers to domain-specific questions. Which approach should the AI team prioritize to improve accuracy without retraining the entire model?

A.Fine-tune the model on a curated dataset of domain-specific conversations.
B.Increase the temperature parameter to reduce randomness.
C.Collect more general training data and retrain the model from scratch.
D.Roll back to a previous version of the model that was more accurate.
AnswerA

Fine-tuning adapts the model to the domain with less data and compute.

Why this answer

Fine-tuning on a curated domain-specific dataset is the most efficient way to improve accuracy for specialized queries without retraining the entire model. It adjusts the model's weights using a smaller, targeted dataset, preserving general language understanding while adapting to domain terminology and context.

Exam trap

CompTIA often tests the misconception that increasing temperature reduces randomness (when it actually increases it) or that rolling back to an older version is a valid fix for new domain-specific issues, leading candidates to choose B or D instead of recognizing fine-tuning as the targeted, efficient solution.

How to eliminate wrong answers

Option B is wrong because increasing the temperature parameter increases randomness in token selection, which would make answers less deterministic and more likely to be incorrect, not more accurate. Option C is wrong because collecting more general training data and retraining from scratch is resource-intensive, time-consuming, and contradicts the requirement to avoid retraining the entire model. Option D is wrong because rolling back to a previous version does not address the domain-specific inaccuracies; the older model likely lacks the specialized knowledge needed and may have its own deficiencies.

Practice this question →
86
MCQhard

An AI system misclassifies rare but critical events. The team considers using synthetic data. Which consideration is MOST important for ensuring the synthetic data improves performance on real rare events?

A.The synthetic data should include a wide variety of events, even if not realistic.
B.The synthetic data should be generated using an unsupervised generative model.
C.The synthetic data should accurately represent the distribution and features of real rare events.
D.The synthetic data should be as large as possible to cover all possibilities.
AnswerC

Fidelity to real event characteristics is crucial for generalization.

Why this answer

Synthetic data must faithfully replicate the distribution and feature space of real rare events to enable the model to learn meaningful decision boundaries. If the synthetic data does not capture the true underlying patterns—such as specific sensor readings or transaction anomalies—the model will fail to generalize to actual rare events, defeating the purpose of augmentation.

Exam trap

CompTIA often tests the misconception that 'more data is always better' or that 'any synthetic data helps,' when in reality the fidelity of the synthetic data to the real rare event distribution is the paramount factor for improving model performance on those events.

How to eliminate wrong answers

Option A is wrong because including a wide variety of unrealistic events introduces noise and spurious correlations, which can degrade the model's precision and recall on real rare events. Option B is wrong because the choice of generative model (unsupervised vs. supervised) is secondary; the critical factor is that the synthetic data accurately reflects the real rare event distribution, not the training paradigm. Option D is wrong because simply maximizing dataset size without ensuring fidelity to real rare events can lead to overfitting on synthetic artifacts and poor generalization to authentic edge cases.

Practice this question →
87
Multi-Selectmedium

A team monitors a production model for bias. They measure the selection rate for two demographic groups and find a significant difference. Which TWO actions should the team take to mitigate bias? (Choose two.)

Select 2 answers
A.Increase the complexity of the model to capture more patterns
B.Add more training data from both groups
C.Retrain the model with a balanced training dataset
D.Remove the protected attribute from the model input
E.Implement a post-processing fairness adjustment
AnswersC, E

Balanced data reduces bias by ensuring the model learns from fair representations.

Why this answer

Retraining with a balanced training dataset (Option C) directly addresses the root cause of bias by ensuring the model learns from equal representation of both demographic groups, which reduces skewed selection rates. This is a standard data-level mitigation technique in AI fairness, as it prevents the model from overfitting to majority patterns.

Exam trap

CompTIA often tests the misconception that removing the protected attribute (Option D) is sufficient to eliminate bias, when in reality proxy features and correlated variables can perpetuate discrimination.

Practice this question →
88
Multi-Selecthard

Which TWO deployment strategies allow for testing a new model version before fully rolling it out?

Select 2 answers
A.Shadow deployment
B.Canary deployment
C.Direct cutover
D.A/B testing with traffic splitting
E.Blue-Green deployment
AnswersB, D

Canary releases route a subset of users to the new version for validation.

Why this answer

Canary deployment is correct because it routes a small percentage of live traffic to the new model version while the majority continues using the stable version. This allows real-world validation of the new model's performance and error rates under production load before a full rollout, minimizing blast radius if issues arise.

Exam trap

The trap here is that candidates confuse shadow deployment with canary deployment, mistakenly thinking shadow also tests user-facing behavior, when in fact shadow only tests infrastructure impact without validating model outputs against live user expectations.

Practice this question →
89
MCQhard

An e-commerce company deploys a recommendation model that must serve predictions with sub-100 ms latency for millions of users during peak hours. The model is a large neural network. Which architecture is most suitable?

A.Batch process predictions every hour.
B.Use a distributed system with load balancers and model replicas.
C.Deploy the model on a single powerful GPU server.
D.Use serverless functions with auto-scaling.
AnswerB

This architecture handles high traffic and meets latency requirements efficiently.

Why this answer

Distributing the model across multiple servers with load balancers and replicas allows horizontal scaling to handle millions of concurrent users while maintaining sub-100 ms latency. This architecture provides fault tolerance and can dynamically adjust to peak traffic loads, which is essential for real-time inference with large neural networks.

Exam trap

CompTIA often tests the misconception that a single powerful server or serverless functions can meet strict latency and throughput requirements, but the trap here is that horizontal scaling with load-balanced replicas is the only viable solution for high-concurrency, low-latency inference with large models.

How to eliminate wrong answers

Option A is wrong because batch processing predictions every hour introduces latency of up to 3600 seconds, which fails the sub-100 ms requirement and is unsuitable for real-time recommendation systems. Option C is wrong because a single powerful GPU server creates a single point of failure and cannot scale horizontally to handle millions of concurrent users during peak hours, leading to resource contention and latency spikes. Option D is wrong because serverless functions typically have cold start delays (often 100 ms to several seconds) and may not support large neural network models due to memory and execution time limits (e.g., AWS Lambda max 15 minutes, 10 GB memory), making them unsuitable for low-latency, high-throughput inference.

Practice this question →
90
MCQhard

An MLOps team automates model deployment with a CI/CD pipeline. A performance regression is detected after deploying a new model version. The team needs to automatically roll back to the previous version. Which approach best enables safe automated rollback?

A.Use a blue/green deployment with automated health checks and traffic switching
B.Maintain a manual rollback script that the operations team can run
C.Deploy new models as canary releases and monitor for 24 hours
D.Automatically keep the previous model version in storage for later use
AnswerA

Blue/green allows instant rollback by redirecting traffic.

Why this answer

Blue/green deployment with automated health checks and traffic switching is the best approach because it allows the team to instantly route all traffic back to the previous (green) environment if the new (blue) version fails health checks. This ensures zero-downtime rollback without manual intervention, directly addressing the need for safe automated rollback in a CI/CD pipeline.

Exam trap

CompTIA often tests the distinction between preserving artifacts (storage) and enabling automated traffic switching (deployment strategy), so candidates mistakenly choose Option D thinking storage alone ensures rollback capability.

How to eliminate wrong answers

Option B is wrong because a manual rollback script introduces human delay and error risk, contradicting the requirement for automated rollback. Option C is wrong because canary releases with a 24-hour monitoring window do not provide immediate automated rollback; they rely on manual decision-making after observation, which is not fully automated. Option D is wrong because simply keeping the previous model version in storage does not enable automatic traffic switching or rollback; it only preserves the artifact, not the deployment state.

Practice this question →
91
MCQeasy

A company has developed a deep learning model for image classification. The team wants to deploy the model to production with high availability and scalability. Which approach should they use?

A.Run the model on a laptop during business hours.
B.Deploy the model as a monolithic application on a single server.
C.Embed the model directly into a mobile app.
D.Use a containerized approach with Kubernetes.
AnswerD

Kubernetes provides orchestration, scaling, and high availability for containerized applications.

Why this answer

Containerization with Kubernetes provides the orchestration, auto-scaling, and self-healing capabilities required for high availability and scalability in production. Kubernetes manages container lifecycles, distributes traffic across replicas via Services and Ingress controllers, and can automatically scale pods based on CPU/memory metrics or custom metrics, ensuring the deep learning model handles variable loads without downtime.

Exam trap

CompTIA often tests the misconception that embedding AI models directly into mobile apps or running them on a single server is sufficient for production, when in reality enterprise-grade deployments require container orchestration for resilience and elasticity.

How to eliminate wrong answers

Option A is wrong because running the model on a laptop during business hours lacks any production-grade availability, scalability, or fault tolerance; it is a single point of failure and cannot handle concurrent requests. Option B is wrong because a monolithic application on a single server creates a single point of failure, cannot scale horizontally, and offers no load balancing or automated recovery, making it unsuitable for high availability. Option C is wrong because embedding the model directly into a mobile app offloads inference to client devices, which introduces latency, security risks, and inconsistent performance; it does not provide centralized high availability or scalability for the production service.

Practice this question →
← PreviousPage 2 of 2 · 91 questions total

Ready to test yourself?

Try a timed practice session using only Ai Implementation Operations questions.

Start 20-question session