AIF-C01 Guidelines for Responsible AI — Timed 15 Questions

Question 1

A financial services company uses Amazon Rekognition to verify customer identities. To ensure responsible AI practices, which measure should the company prioritize?

Accepted Answer

Regularly audit the model for demographic bias. Option D is correct because regularly auditing the model for demographic bias is a core responsible AI practice, especially for identity verification systems where biased outcomes could lead to unfair treatment of certain customer groups. Amazon Rekognition's facial analysis and comparison features must be tested across diverse demographics to ensure equitable performance, as bias can arise from imbalanced training data or algorithmic artifacts.

Answer

Use only black-box models to protect intellectual property

Answer

Increase model complexity to improve accuracy

Answer

Minimize the amount of training data collected

Question 2

A healthcare startup deploys a model to predict patient readmission risk using Amazon SageMaker. After deployment, the model shows higher false-positive rates for a specific age group. What is the most responsible first step?

Accepted Answer

Use Amazon SageMaker Clarify to detect bias in predictions. Amazon SageMaker Clarify is purpose-built for detecting bias in ML models and data. It provides bias metrics (e.g., Difference in Positive Proportions in Predicted Labels, Disparate Impact) that can quantify whether the model's predictions are systematically skewed against a specific age group. This is the most responsible first step because it objectively measures the bias before any corrective action is taken.

Answer

Increase the prediction threshold for the affected group

Answer

Retrain the model with more data from the affected group

Answer

Immediately retire the model to prevent harm

Question 3

A company uses an AI system to automate loan approvals. The model uses demographic features and achieves high accuracy, but the company wants to ensure compliance with responsible AI guidelines. Which practice best balances performance and fairness?

Accepted Answer

Remove sensitive attributes and monitor for proxy bias. Option C is correct because removing sensitive attributes (e.g., race, gender) from the training data directly addresses fairness by preventing the model from explicitly using these features. However, simply removing them is insufficient; monitoring for proxy bias (e.g., zip code or income correlating with race) is critical to ensure the model does not inadvertently learn discriminatory patterns through correlated features. This approach balances performance by retaining predictive power from non-sensitive features while actively auditing for fairness violations.

Answer

Use demographic features but with minimal monitoring

Answer

Use a complex black-box model and rely on post-hoc explanations

Answer

Optimize the model solely for accuracy on historical data

Question 4

A retail company uses a recommendation system that occasionally suggests inappropriate products to minors. Which responsible AI practice should be applied?

Accepted Answer

Implement human review of flagged recommendations. The correct practice is to implement human review of flagged recommendations. This aligns with the responsible AI principle of accountability, where automated systems must have oversight mechanisms to catch and correct inappropriate outputs, especially when minors are involved. Human-in-the-loop (HITL) validation ensures that edge cases or subtle context (e.g., age-inappropriate product suggestions) are caught before they reach end users, rather than relying solely on automated filters or feedback loops.

Answer

Rely solely on user feedback to improve

Answer

Disable the recommendation system entirely

Answer

Increase the volume of training data

Question 5

A company uses Amazon Comprehend to analyze customer sentiment. They discover the model performs poorly on text with slang from underrepresented groups. What is the most responsible action?

Accepted Answer

Collect more representative training data including slang. Option D is correct because the core principle of responsible AI requires that models be trained on data that is representative of the populations they serve. Amazon Comprehend's sentiment analysis is a supervised machine learning model; its poor performance on slang from underrepresented groups indicates a training data bias. Collecting more representative training data, including that slang, directly addresses the root cause by enabling the model to learn the linguistic patterns of those groups, improving fairness and accuracy without restricting access or masking the problem.

Answer

Restrict model use to only standard English

Answer

Remove slang from input before inference

Answer

Adjust the confidence threshold only for those groups

Question 6

A bank uses an AI system to detect fraudulent transactions. The model has high precision but low recall for small transactions, potentially missing fraud. Which approach aligns with responsible AI?

Accepted Answer

Tune the model to achieve an acceptable balance between recall and precision. Option C is correct because responsible AI requires balancing competing objectives like precision and recall to align with ethical principles and business needs. In fraud detection, high precision with low recall means many fraudulent transactions are missed, which can lead to significant financial losses and erode customer trust. Tuning the model to achieve an acceptable trade-off ensures that the system is both effective and fair, minimizing harm while maintaining operational viability.

Answer

Send all flagged transactions to customers for confirmation

Answer

Focus only on precision to minimize false positives

Answer

Increase the detection threshold to reduce false positives

Question 7

A company develops a chatbot using Amazon Lex. To ensure transparency, what should the chatbot do when it cannot answer a question?

Accepted Answer

Clearly state that it cannot answer and offer alternatives. Option C is correct because responsible AI guidelines, including those from AWS for Amazon Lex, require that when a chatbot cannot answer a question, it should clearly state its inability and offer alternatives (e.g., rephrasing the query or providing related topics). This maintains transparency and user trust, aligning with the 'Explainability' principle under the Guidelines for Responsible AI.

Answer

Remain silent and wait for the next input

Answer

Provide a random answer from a predefined list

Answer

Automatically escalate all unanswered questions to a human

Question 8

Which TWO actions are most aligned with responsible AI practices when deploying a model that makes decisions affecting individuals? (Choose 2)

Accepted Answer

Continuously monitor the model for fairness metrics. Options A and C are correct. Option A: Providing explanations supports transparency. Option C: Regular monitoring detects bias drift. Option B is wrong because teams should include diverse perspectives. Option D is wrong because using the most complex model may harm explainability. Option E is wrong because more data alone does not ensure fairness.

Answer

Collect as much data as possible without quality checks

Answer

Ensure the development team is homogeneous to avoid conflicts

Answer

Use the most complex model available for maximum accuracy

Question 9

Which THREE considerations are essential for ensuring responsible AI in a model that predicts employee performance? (Choose 3)

Accepted Answer

Incorporate human review before final decisions. Option C is correct because responsible AI frameworks, such as those outlined by AWS, mandate human-in-the-loop (HITL) oversight for high-stakes decisions like employee performance predictions. This ensures that automated outputs are reviewed for context, fairness, and potential errors before affecting employment outcomes, aligning with the AIF-C01 domain's emphasis on human accountability.

Answer

Minimize the number of features to reduce cost

Answer

Publish the model's predictions publicly for transparency

Question 10

Which TWO practices help ensure transparency in AI systems? (Choose 2)

Accepted Answer

Use model-agnostic explainability tools like SHAP. Option B is correct because model-agnostic explainability tools like SHAP (SHapley Additive exPlanations) provide post-hoc explanations for any machine learning model by computing feature contributions based on cooperative game theory. This allows stakeholders to understand how each input feature influences a prediction, directly supporting transparency without requiring access to the model's internal structure.

Answer

Combine multiple models to obscure decision logic

Answer

Remove all features except the most predictive ones

Answer

Use black-box models to protect proprietary algorithms

Question 11

An AI team uses the IAM policy shown in the exhibit to control endpoint creation. Why does this policy support responsible AI?

Accepted Answer

It ensures data capture is enabled for model monitoring. Option C is correct because the IAM policy includes a condition that enforces the `DataCaptureConfig.EnableCapture` parameter to be set to `true` when creating a SageMaker endpoint. This ensures that model monitoring data is automatically collected, which is a key practice for responsible AI as it allows continuous monitoring of model performance, bias detection, and drift analysis. Without data capture, teams cannot audit or validate model behavior in production, undermining accountability and transparency.

Answer

It requires human approval before deploying any model

Answer

It prevents the use of GPU instances to reduce cost

Answer

It restricts endpoints to only use models built in SageMaker

Question 12

A data scientist runs the SageMaker Clarify job shown in the exhibit for a credit risk model. After reviewing the results, they find a high bias metric for the gender facet. Which action is most consistent with responsible AI?

Accepted Answer

Investigate the root cause and retrain with balanced data. Option C is correct because responsible AI requires understanding and mitigating bias at its source, not just masking it. Investigating the root cause (e.g., data collection bias, labeling bias, or proxy features) and retraining with balanced data directly addresses the high bias metric detected by SageMaker Clarify, aligning with AWS's principle of fairness. Simply removing the gender attribute may not eliminate bias if other features act as proxies, and increasing the threshold does not fix the underlying model bias.

Answer

Proceed with deployment because the model is already in production

Answer

Remove the gender attribute from the training data and retrain

Answer

Increase the acceptance threshold for the model

Question 13

A financial services company is deploying a generative AI chatbot to assist customers with account inquiries. The company wants to ensure the chatbot does not generate biased or harmful responses. Which combination of AWS services and practices should the company implement to monitor and mitigate these risks?

Accepted Answer

Use Amazon SageMaker Clarify to detect bias in model outputs and implement a human-in-the-loop workflow with Amazon A2I to review flagged responses.. Option C is correct because Amazon SageMaker Clarify is specifically designed to detect bias in machine learning models and their outputs, while Amazon Augmented AI (A2I) enables a human-in-the-loop workflow to review flagged responses. This combination directly addresses the requirement to monitor and mitigate biased or harmful responses from a generative AI chatbot, ensuring responsible AI practices.

Answer

Configure the chatbot to use a pre-trained model from SageMaker JumpStart and disable logging to avoid storing sensitive customer data.

Answer

Use Amazon Rekognition to analyze chat logs for biased language and automatically block responses with a confidence score above 90%.

Answer

Deploy Amazon Lex with built-in sentiment analysis to detect negative customer emotions and automatically escalate to a human agent.

Question 14

A healthcare organization is developing a clinical decision support system using Amazon Bedrock with a large language model (LLM) to analyze patient symptoms and suggest potential diagnoses. The system must comply with HIPAA and internal responsible AI guidelines. During testing, the model occasionally generates diagnoses that are inconsistent with established medical guidelines and shows a tendency to recommend more aggressive treatments for patients from certain demographic groups. The team has already implemented data encryption, access controls, and basic content filtering. They need to further reduce biased and unsafe outputs without delaying the deployment timeline. What should the team do next?

Accepted Answer

Fine-tune the model using a curated dataset of anonymized patient records that is balanced across demographic groups and aligned with clinical guidelines.. Option C is correct because fine-tuning the model with a balanced, curated dataset directly addresses both the bias and clinical accuracy issues at the model level, which is the most effective approach for reducing biased and unsafe outputs without delaying deployment. This method adjusts the model's internal weights to align with established medical guidelines and demographic fairness, rather than relying on post-processing filters or logging that do not fix the root cause. Since the team has already implemented basic content filtering, fine-tuning provides a targeted, efficient solution that can be completed within a reasonable timeline.

Answer

Increase the logging of all model inputs and outputs to Amazon CloudWatch and set up alarms for any mentions of protected attributes.

Answer

Replace the current LLM with a different pre-trained model that has been benchmarked for lower bias on medical datasets.

Answer

Apply stronger content filtering rules using Amazon Comprehend Medical to block any diagnosis that contains demographic-related terms.

Question 15

A data scientist wants to detect potential bias in a binary classification model before deployment. Which AWS service can analyze the model's predictions across different demographic groups?

Accepted Answer

Amazon SageMaker Clarify. Option A is correct because Amazon SageMaker Clarify provides built-in bias metrics and explainability analysis for machine learning models. Options B, C, D are incorrect: SageMaker Model Monitor is for post-deployment monitoring; SageMaker Ground Truth is for labeling; CloudWatch Logs is for logging.

Answer

Amazon SageMaker Ground Truth

Answer

Amazon CloudWatch Logs Insights

Answer

Amazon SageMaker Model Monitor