AIF-C01 Guidelines for Responsible AI Practice Test 4 — 15 Questions

Question 1

A social media company uses Amazon Comprehend to moderate user comments. They want to avoid censoring legitimate speech while catching hate speech. Which approach aligns with responsible AI governance?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Implement a human-in-the-loop review for borderline cases. A human-in-the-loop (HITL) review for borderline cases aligns with responsible AI governance by balancing automated detection with human judgment. Amazon Comprehend can flag comments with moderate confidence scores (e.g., 0.5–0.9) for manual review, ensuring that ambiguous or context-dependent hate speech is not censored while still catching clear violations. This approach mitigates false positives and respects free expression, which is a core tenet of responsible AI.

Answer

Use multiple models and average their scores

Answer

Use a single model with high confidence threshold

Answer

Rely solely on automated filtering

Question 2

A startup uses Amazon Lex to build a chatbot for mental health support. They must ensure user conversations are private and not used for model improvement. Which AWS service can help anonymize text data before storage?

Accepted Answer

Amazon Comprehend. Amazon Comprehend offers a built-in feature called PII (Personally Identifiable Information) detection and redaction, which can automatically identify and mask sensitive data such as names, addresses, and health information in text. By using the `DetectPIIEntities` API with redaction, the startup can anonymize user conversations before storing them, ensuring compliance with privacy requirements and preventing data from being used for model improvement.

Answer

Amazon Textract

Answer

AWS Key Management Service (KMS)

Answer

Amazon Macie

Question 3

A research lab uses Amazon SageMaker to train a deep learning model for medical diagnosis. They need to ensure the model's decisions are interpretable to clinicians. Which SageMaker feature provides local and global feature importance?

Accepted Answer

SageMaker Clarify. SageMaker Clarify is the correct answer because it is specifically designed to provide both local and global feature importance for machine learning models. Local feature importance explains individual predictions (e.g., why a specific patient was diagnosed), while global feature importance shows which features most influence the model overall. This directly supports interpretability for clinicians, as required in the question.

Answer

SageMaker Model Monitor

Answer

SageMaker Experiments

Answer

SageMaker Debugger

Question 4

Which TWO actions help ensure fairness in an AI system deployed on AWS? (Select two.)

Accepted Answer

Train the model on a representative dataset. Option A (Train the model on a representative dataset) is correct because fairness in AI depends on the training data reflecting the demographics and conditions of the real-world population the model will serve; unrepresentative or skewed data leads to biased predictions. Option C (Use SageMaker Clarify to detect bias) is correct because SageMaker Clarify provides bias detection metrics (e.g., pre-training and post-training bias metrics such as Disparate Impact and Equal Opportunity Difference) that quantify and help mitigate bias in data and models. Option B (Enable AWS CloudTrail for audit) is not a fairness action; CloudTrail records API activity for security, compliance, and operational auditing, not for measuring or correcting model bias. Option D (Use a single validation set) is not a fairness measure and can actually increase evaluation variance; fairness requires representative and possibly multiple or cross-validated evaluation sets. Option E (Encrypt data at rest using AWS KMS) addresses data confidentiality and compliance, not fairness or bias in model outcomes.

Answer

Enable AWS CloudTrail for audit

Answer

Use a single validation set

Answer

Encrypt data at rest using AWS KMS

Question 5

Which TWO actions can help mitigate bias in a face recognition model trained on AWS? (Select two.)

Accepted Answer

Ensure the training dataset is balanced across demographics. Options A and B are correct. Mitigating bias in a face recognition model requires a balanced training dataset (A) and regular evaluation of model performance across demographic subgroups (B). Option C (deploying in multiple regions) affects latency or availability, not bias. Option D (larger neural network) does not address data imbalance. Option E (Amazon Rekognition's content moderation) is for detecting inappropriate content, not for bias mitigation.

Answer

Deploy the model in multiple regions

Answer

Use a larger neural network

Answer

Use Amazon Rekognition's content moderation

Question 6

Refer to the exhibit. An AWS customer runs SageMaker Clarify to evaluate bias in their training data. The report shows multiple metrics with status 'violated'. What should the customer do next?

Accepted Answer

Use data augmentation to balance the dataset. SageMaker Clarify bias metrics such as Class Imbalance (CI) or Difference in Positive Proportions in Labels (DPPL) flag potential bias in the training data or model predictions. When a report shows violations, the next step is to review the findings and apply a targeted mitigation. Among the options, balancing the dataset through data augmentation directly addresses the representative imbalance; reducing features or simply adding more data does not target the demographic imbalance, and ignoring the metrics is not appropriate.

Answer

Reduce the number of features

Answer

Retrain the model with more data

Answer

Ignore the metrics because thresholds are too strict

Question 7

Refer to the exhibit. A team is configuring a SageMaker Model Bias job. The baseline job has been completed. However, the bias job fails with a resource not found error. What is the most likely cause?

Accepted Answer

The BaseliningJobName is incorrect. The bias job requires a reference to the completed baseline job to compare the training data against. If the BaseliningJobName parameter is incorrect or does not match the actual name of the completed baseline job, SageMaker will throw a 'ResourceNotFound' error because it cannot locate the specified baseline job. The error is not related to timeouts, instance types, or IAM permissions for describing the baseline job.

Answer

The StoppingCondition is too short

Answer

The instance type ml.m5.large is not supported

Answer

The IAM role lacks permissions to DescribeBaselineJob

Question 8

Refer to the exhibit. An ML team finds that their training data is stored in two subfolders under s3://my-bucket/train/. They need to ensure that the dataset is balanced for training a classification model. What should they do?

Accepted Answer

Count the number of files in each subfolder and resample. The core requirement is to balance the dataset by ensuring an equal number of samples from each subfolder (class). Counting the files in each subfolder and then resampling (e.g., undersampling the majority class or oversampling the minority class) directly addresses class imbalance. This is a standard data preprocessing step before training a classification model, and it does not require any additional AWS services beyond the existing S3 storage.

Answer

Use AWS Glue to create a balanced dataset

Answer

Use Amazon Rekognition custom labels

Answer

Enable versioning on the bucket

Question 9

A company uses Amazon SageMaker to build a binary classification model for loan approvals. After training, the data science team wants to evaluate the model for potential bias against a protected group. Which AWS service should they use to compute bias metrics?

Accepted Answer

Amazon SageMaker Clarify. Amazon SageMaker Clarify is the correct service because it is specifically designed to detect bias in machine learning models and datasets. It provides built-in bias metrics (e.g., difference in positive proportion, disparate impact) for both pre-training and post-training evaluation, making it the appropriate tool for assessing potential bias against a protected group in a binary classification model.

Answer

Amazon SageMaker Model Monitor

Answer

Amazon SageMaker Debugger

Answer

Amazon SageMaker Experiments

Question 10

A data scientist is using Amazon SageMaker to train a model and wants to understand the contribution of each feature to individual predictions. Which technique should they use to generate local explanations?

Accepted Answer

SHAP values. SHAP (SHapley Additive exPlanations) values are the correct choice because they provide local explanations by decomposing a prediction into the additive contribution of each feature, based on cooperative game theory. This allows the data scientist to understand exactly how each feature influenced a specific individual prediction, unlike global methods that summarize behavior across the entire dataset.

Answer

Permutation feature importance

Answer

Global feature importance

Answer

Partial dependence plots

Question 11

A company deploys a deep learning model for image classification using Amazon SageMaker. They are concerned about adversarial attacks that could misclassify images with small perturbations. Which of the following is the most effective approach to improve model robustness?

Accepted Answer

Apply adversarial training. Adversarial training is the most effective approach because it explicitly augments the training dataset with adversarial examples—inputs crafted with small, intentional perturbations designed to fool the model. By training on these perturbed samples, the model learns to recognize and resist such attacks, directly improving its robustness against adversarial perturbations in image classification tasks on SageMaker.

Answer

Reduce training data size

Answer

Use early stopping during training

Answer

Increase model complexity

Question 12

A healthcare company is training a model on sensitive patient data using Amazon SageMaker. They need to ensure that individual patient data cannot be reverse-engineered from the model. Which technique should they implement during training?

Accepted Answer

Differential privacy. Differential privacy is the technique specifically designed to prevent reverse-engineering of individual records from a trained model by injecting calibrated statistical noise during training. It provides a mathematical guarantee that the presence or absence of any single patient's data has a bounded effect on the model's output, directly addressing the requirement that individual patient data cannot be inferred. This is the only option that operates at the training algorithm level to protect individual records.

Answer

Data encryption at rest

Answer

AWS Identity and Access Management (IAM) policies

Answer

SageMaker Model Monitor

Question 13

A team is developing an AI system and wants to document key information such as intended use, performance benchmarks, and limitations. According to AWS best practices for responsible AI, what should they create?

Accepted Answer

Model cards. Model cards are a structured documentation framework recommended by AWS for responsible AI. They provide a standardized way to communicate key information such as intended use, performance benchmarks, limitations, and ethical considerations, ensuring transparency and accountability.

Answer

A whitepaper

Answer

A business requirement document

Answer

A technical blog

Question 14

A large enterprise has multiple teams deploying ML models on AWS. To ensure governance and accountability, they need to enforce that all models pass a fairness review before production deployment. Which SageMaker feature should they use to implement this approval workflow?

Accepted Answer

SageMaker Model Registry. SageMaker Model Registry is the correct choice because it provides a centralized catalog for managing ML models, including versioning, approval status, and metadata. It supports approval workflows by allowing you to define model groups, set approval statuses (e.g., PendingApproval, Approved, Rejected), and integrate with CI/CD pipelines to enforce that only approved models are deployed to production.

Answer

SageMaker Studio

Answer

SageMaker Experiments

Answer

SageMaker Model Monitor

Question 15

An e-commerce company uses an Amazon Lex chatbot to handle customer inquiries. They want to implement human oversight for sensitive interactions, such as when the chatbot cannot provide a confident response. Which AWS service should they integrate?

Accepted Answer

Amazon Augmented AI (A2I). Amazon Augmented AI (A2I) is the correct service because it provides built-in human review workflows for ML predictions, allowing you to route low-confidence responses from Amazon Lex to human reviewers for oversight. This directly addresses the requirement for human oversight on sensitive interactions where the chatbot cannot provide a confident response.

Answer

Amazon Rekognition

Answer

Amazon Comprehend

Answer

Amazon SageMaker Ground Truth