AIF-C01 Guidelines for Responsible AI Practice Test 5 — 15 Questions

Question 1

Refer to the exhibit. A team is creating an IAM policy for a SageMaker notebook user. The user needs to access training data in an S3 bucket and create models. Which responsible AI concern is most relevant to this policy?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

The policy grants overly broad permissions, violating the principle of least privilege.. The IAM policy grants the SageMaker notebook user overly broad permissions (e.g., s3:* or sagemaker:*), which violates the principle of least privilege. This is a core responsible AI concern as it increases the risk of unauthorized access or accidental modification of training data and models. The policy should restrict actions to only those necessary for the user's specific role, such as s3:GetObject for specific buckets and sagemaker:CreateModel with resource constraints.

Answer

The policy does not enforce encryption for the notebook.

Answer

The policy does not restrict which S3 buckets the user can read.

Answer

The policy does not include a condition for model explainability.

Question 2

A company uses Amazon Rekognition for facial analysis. They want to ensure the model doesn't exhibit bias based on skin tone. What should they do?

Accepted Answer

Ensure the training dataset includes diverse skin tones. Bias in facial analysis models, such as those used by Amazon Rekognition, often stems from imbalanced training data. By ensuring the training dataset includes diverse skin tones, the model learns to recognize features across all demographic groups, reducing performance disparities and promoting fairness. This directly addresses the root cause of bias in machine learning models.

Answer

Apply data augmentation to increase dataset size

Answer

Use a larger neural network

Answer

Use a pre-trained model from AWS Marketplace

Question 3

A financial services company deploys a generative AI chatbot for customer support. They want to prevent the chatbot from generating harmful or misleading information. Which AWS service can help monitor and filter responses?

Accepted Answer

Amazon Augmented AI (A2I) with human review. Amazon Augmented AI (A2I) enables human review of machine learning predictions, making it suitable for monitoring and filtering chatbot responses for harmful or misleading content. Other options: Amazon GuardDuty is a threat detection service, not for content filtering. AWS WAF protects web applications from common web exploits. Amazon Comprehend is a natural language processing service for insights, but not designed for real-time filtering with human review.

Answer

Amazon GuardDuty

Answer

AWS WAF

Answer

Amazon Comprehend

Question 4

A healthcare startup uses Amazon SageMaker to train a model predicting patient readmission. They need to ensure the model's predictions do not discriminate based on protected attributes like age or race. Which SageMaker feature allows them to monitor and mitigate bias during training?

Accepted Answer

SageMaker Clarify. SageMaker Clarify is the correct choice because it is specifically designed to detect and mitigate bias in machine learning models. It provides built-in capabilities to analyze training data and model predictions for bias against protected attributes such as age or race, and can generate bias reports and suggest mitigation strategies during training.

Answer

SageMaker Model Monitor

Answer

SageMaker Autopilot

Answer

SageMaker Debugger

Question 5

A media company uses Amazon Transcribe for automatic speech recognition. They discover the model has higher error rates for non-native English speakers. Which Responsible AI principle are they failing to uphold?

Accepted Answer

Fairness. The model's higher error rates for non-native English speakers indicate a bias in the training data or model design that leads to disparate performance across demographic groups. This directly violates the Fairness principle of Responsible AI, which requires that AI systems treat all groups equitably and do not amplify existing societal biases. Amazon Transcribe's underlying acoustic and language models may have been trained predominantly on native English speech, causing systematic underperformance for non-native accents.

Answer

Explainability

Answer

Robustness

Answer

Privacy

Question 6

An e-commerce company uses a recommendation system built with Amazon Personalize. They want to explain to customers why certain products are recommended. Which AWS service can provide model explanations?

Accepted Answer

Amazon SageMaker Clarify. Amazon SageMaker Clarify is the correct choice because it provides model explainability features, including feature importance and SHAP-based explanations, which can be used to interpret why Amazon Personalize recommends specific products. This aligns with the requirement to explain recommendations to customers, as SageMaker Clarify integrates with Personalize to generate human-readable explanations for model predictions.

Answer

AWS Config

Answer

AWS CloudTrail

Answer

Amazon Detective

Question 7

A startup uses Amazon Lex to build a chatbot for mental health support. They must ensure user conversations are private and not used for model improvement. Which AWS service can help anonymize text data before storage?

Accepted Answer

Amazon Comprehend. Amazon Comprehend offers a built-in feature called PII (Personally Identifiable Information) detection and redaction, which can automatically identify and mask sensitive data such as names, addresses, and health information in text. By using the `DetectPIIEntities` API with redaction, the startup can anonymize user conversations before storing them, ensuring compliance with privacy requirements and preventing data from being used for model improvement.

Answer

Amazon Textract

Answer

AWS Key Management Service (KMS)

Answer

Amazon Macie

Question 8

A research lab uses Amazon SageMaker to train a deep learning model for medical diagnosis. They need to ensure the model's decisions are interpretable to clinicians. Which SageMaker feature provides local and global feature importance?

Accepted Answer

SageMaker Clarify. SageMaker Clarify is the correct answer because it is specifically designed to provide both local and global feature importance for machine learning models. Local feature importance explains individual predictions (e.g., why a specific patient was diagnosed), while global feature importance shows which features most influence the model overall. This directly supports interpretability for clinicians, as required in the question.

Answer

SageMaker Model Monitor

Answer

SageMaker Experiments

Answer

SageMaker Debugger

Question 9

Refer to the exhibit. A team is configuring a SageMaker Model Bias job. The baseline job has been completed. However, the bias job fails with a resource not found error. What is the most likely cause?

Accepted Answer

The BaseliningJobName is incorrect. The bias job requires a reference to the completed baseline job to compare the training data against. If the BaseliningJobName parameter is incorrect or does not match the actual name of the completed baseline job, SageMaker will throw a 'ResourceNotFound' error because it cannot locate the specified baseline job. The error is not related to timeouts, instance types, or IAM permissions for describing the baseline job.

Answer

The StoppingCondition is too short

Answer

The instance type ml.m5.large is not supported

Answer

The IAM role lacks permissions to DescribeBaselineJob

Question 10

A healthcare company is training a model on sensitive patient data using Amazon SageMaker. They need to ensure that individual patient data cannot be reverse-engineered from the model. Which technique should they implement during training?

Accepted Answer

Differential privacy. Differential privacy adds noise to the training process to protect individual records. Data encryption and IAM control access but do not prevent inference from model parameters; Model Monitor is for post-deployment monitoring.

Answer

Data encryption at rest

Answer

AWS Identity and Access Management (IAM) policies

Answer

SageMaker Model Monitor

Question 11

A team is developing an AI system and wants to document key information such as intended use, performance benchmarks, and limitations. According to AWS best practices for responsible AI, what should they create?

Accepted Answer

Model cards. Model cards are a structured documentation framework recommended by AWS for responsible AI. They provide a standardized way to communicate key information such as intended use, performance benchmarks, limitations, and ethical considerations, ensuring transparency and accountability.

Answer

A whitepaper

Answer

A business requirement document

Answer

A technical blog

Question 12

Which TWO of the following are key components of a responsible AI governance framework?

Accepted Answer

Develop and enforce AI ethics policies and standards. A responsible AI governance framework must include the development and enforcement of AI ethics policies and standards to ensure alignment with societal values, fairness, and accountability. These policies guide the design, deployment, and monitoring of AI systems, embedding ethical principles such as transparency, privacy, and non-discrimination into the AI lifecycle. Without such policies, organizations risk deploying AI that violates ethical norms or regulatory expectations.

Answer

Focus solely on compliance with legal regulations

Answer

Minimize human involvement in AI lifecycle decisions

Answer

Deploy AI models as black boxes to avoid scrutiny

Question 13

A hospital uses an AI system to prioritize patients for organ transplant based on predicted survival rates. The system was trained on historical data that includes socioeconomic factors. A review reveals that the system systematically assigns lower priority to patients from lower-income neighborhoods, even when medical urgency is similar. The hospital's ethics board demands an immediate remedy. The data science team is small and must act quickly. What should the hospital do to address this fairness issue most effectively?

Accepted Answer

Retrain the model with only medically relevant features, after removing socioeconomic factors and correlated proxies. The best course is to retrain the model using only medically relevant features, removing socioeconomic factors and correlated proxies. This directly addresses the source of bias. Adding a penalty for low-income patients is artificial and may not reflect medical reality. Relying solely on human review delays the issue and introduces potential inconsistency. Using a different model without data changes may not eliminate bias.

Answer

Discontinue the AI system and have all prioritization done by a human committee

Answer

Apply a re-weighting penalty to boost priority for low-income patients

Answer

Use a different model type, such as a random forest instead of gradient boosting, on the same data

Question 14

A large e-commerce company uses a recommendation system to suggest products to customers. Recently, a data scientist noticed that the model's recommendations for high-value luxury items are predominantly shown to users in affluent zip codes, while users in less affluent areas rarely see these items, even if they have searched for them. The company is concerned about fairness and wants to ensure all customers have equal access to recommendations regardless of location. The current model uses collaborative filtering on historical purchase data. The team needs to modify the system without sacrificing overall recommendation accuracy. Which action best addresses the fairness concern while maintaining performance?

Accepted Answer

Remove zip code and any income-correlated features from the training data. The most effective approach is to ensure the model does not use zip code or any feature correlated with income as a direct or indirect input. This removes the proxy for socioeconomic status. Simply equalizing recommendation frequency artificially may hurt relevance. Personalizing based on search history is already being done but zip code bias remains. Adding more training data may not help if the bias is in the features.

Answer

Randomly show luxury recommendations to a subset of users regardless of their behavior

Answer

Add more training data from less affluent areas to balance the dataset

Answer

Implement a separate recommendation pipeline for luxury items based only on search history

Question 15

A government agency is deploying an AI system to detect fraudulent benefit claims. The system uses a neural network trained on historical claims data, which includes a disproportionate number of false positives from a particular ethnic group due to historical over-policing. The agency must ensure the system does not perpetuate discrimination. They have a rigorous testing procedure but limited budget. The project lead wants to balance fairness with detection performance. Which combination of steps should they prioritize?

Accepted Answer

Rebalance the training data to have equal representation across groups and evaluate using a fairness metric like equal opportunity. The most effective approach is to rebalance the training data to be more representative and to use a fairness metric, such as equal opportunity, during evaluation. This directly addresses the data bias and quantifies fairness. Excluding race features may still leave proxies. Using a simpler model may not eliminate bias if data is biased. Post-hoc explanations help understand bias but do not fix it.

Answer

Remove the race feature from the model and rely on performance metrics alone

Answer

Replace the neural network with a logistic regression model retrained on the same data

Answer

Use a post-hoc explainability tool to identify biased predictions and manually override them