AI0-001 AI Implementation and Operations Practice Question
A hospital deploys an AI model that summarizes clinical notes for physicians. Before go-live, the AI team must verify that the model does not reproduce patient identifiers in its summaries when they are not clinically necessary. Which activity is the MOST appropriate for this verification?
⚠ Common exam trap
The trap here is assuming that de-identifying the training data guarantees the model will not output identifiers, which confuses input hygiene with output verification.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Run a red-team evaluation with prompts designed to elicit protected health information and measure leakage rates.
Verifying that a summarizer suppresses unnecessary identifiers requires exercising the model with prompts that attempt to elicit protected health information and measuring how often leakage occurs. Red-teaming produces that empirical evidence against a threshold. Perplexity, training-data scrubbing, and model cards are useful complements but none demonstrates the deployed model's output behavior under adversarial or realistic clinical prompts.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Run a red-team evaluation with prompts designed to elicit protected health information and measure leakage rates.
Why this is correct
Red-teaming directly probes the deployed behavior by attempting to extract identifiers through realistic and adversarial prompts, producing a measured leakage rate the team can compare against an acceptance threshold. This tests the actual risk the hospital cares about, unlike metrics that assess only general language quality or training-set statistics without exercising the summarization path.
- ✗
Verify that the training dataset was de-identified using an automated named-entity recognition scrubber.
Why it's wrong here
De-identification of training data reduces risk but does not guarantee the model will not regenerate identifiers, because memorization and inference from context can still surface them. The hospital needs evidence about output behavior, not only input hygiene. Relying solely on upstream scrubbing leaves the deployed summarizer untested against the actual leakage scenario.
- ✗
Confirm the model card documents the intended use and known limitations of the summarization system.
Why it's wrong here
Documentation is a governance artifact and is valuable for transparency, but it does not empirically verify that identifiers are suppressed in generated summaries. A model card describes what the developers intended and observed, not what the model does on new inputs. The hospital still needs direct behavioral testing to satisfy the pre-deployment privacy requirement.
- ✗
Compare the model's perplexity on the clinical corpus against its perplexity on public text.
Why it's wrong here
Perplexity measures how well the model predicts tokens in a corpus and says nothing about whether identifiers appear in generated summaries. A model can have excellent perplexity while still emitting names or medical record numbers. This metric would give false assurance and consume validation time without testing the privacy property the hospital must confirm before go-live.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 962 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official CompTIA exam blueprint
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.