Guidelines for Responsible AI

A healthcare company is training a model on sensitive patient data using Amazon SageMaker. They need to ensure that individual patient data cannot be reverse-engineered from the model. Which technique should they implement during training?

A team is deploying a regression model for loan approval. To ensure transparency for regulators, they need to explain individual predictions. Which interpretability method can provide local explanations by approximating the model with a simpler surrogate?

A data scientist runs the SageMaker Clarify job shown in the exhibit for a credit risk model. After reviewing the results, they find a high bias metric for the gender facet. Which action is most consistent with responsible AI?

A security team is concerned about adversarial attacks on their image classification model deployed on Amazon SageMaker. They want to test robustness against carefully crafted inputs that cause misclassification. What approach should they use?

Refer to the exhibit. A data scientist runs an Amazon SageMaker Clarify bias analysis on a binary classifier. The pre-training ClassImbalance is 1.5 and the post-training DPPL is 0.15. What should the data scientist conclude?

A startup uses Amazon Lex to build a chatbot for mental health support. They must ensure user conversations are private and not used for model improvement. Which AWS service can help anonymize text data before storage?

Which TWO practices help ensure transparency in AI systems? (Choose 2)

A healthcare organization is developing a clinical decision support system using Amazon Bedrock with a large language model (LLM) to analyze patient symptoms and suggest potential diagnoses. The system must comply with HIPAA and internal responsible AI guidelines. During testing, the model occasionally generates diagnoses that are inconsistent with established medical guidelines and shows a tendency to recommend more aggressive treatments for patients from certain demographic groups. The team has already implemented data encryption, access controls, and basic content filtering. They need to further reduce biased and unsafe outputs without delaying the deployment timeline. What should the team do next?

A company uses an AI system to automate loan approvals. The model uses demographic features and achieves high accuracy, but the company wants to ensure compliance with responsible AI guidelines. Which practice best balances performance and fairness?

A hospital uses an AI system to prioritize patients for organ transplant based on predicted survival rates. The system was trained on historical data that includes socioeconomic factors. A review reveals that the system systematically assigns lower priority to patients from lower-income neighborhoods, even when medical urgency is similar. The hospital's ethics board demands an immediate remedy. The data science team is small and must act quickly. What should the hospital do to address this fairness issue most effectively?

A healthcare startup deploys a model to predict patient readmission risk using Amazon SageMaker. After deployment, the model shows higher false-positive rates for a specific age group. What is the most responsible first step?

A data scientist wants to detect potential bias in a binary classification model before deployment. Which AWS service can analyze the model's predictions across different demographic groups?

Refer to the exhibit. A team is configuring a SageMaker Model Bias job. The baseline job has been completed. However, the bias job fails with a resource not found error. What is the most likely cause?

A research lab uses Amazon SageMaker to train a deep learning model for medical diagnosis. They need to ensure the model's decisions are interpretable to clinicians. Which SageMaker feature provides local and global feature importance?

A team is developing an AI system and wants to document key information such as intended use, performance benchmarks, and limitations. According to AWS best practices for responsible AI, what should they create?

A media company uses a generative AI model to automatically create image captions for user-uploaded photos. During quality assurance, testers discover that the model sometimes generates captions that include stereotypes based on gender and race, even when the photos do not contain people. For example, a photo of a kitchen produces captions like 'woman cooking,' and a photo of a sports car generates 'man driving.' The company wants to launch the feature soon but recognizes the reputational risk. They have a limited budget and need to implement a solution that reduces harmful stereotypes without overly restricting the captions' creativity. The team has access to the model's training data, which is a large public dataset of image-caption pairs. Which approach should the team prioritize?

Which THREE considerations are important when implementing responsible AI for a production NLP system? (Choose three.)

After deploying a model, a company notices that the distribution of the input features has shifted compared to the training data. Which feature of Amazon SageMaker Model Monitor can alert them to this change?

An e-commerce company uses a recommendation system built with Amazon Personalize. They want to explain to customers why certain products are recommended. Which AWS service can provide model explanations?

A media company uses Amazon Transcribe for automatic speech recognition. They discover the model has higher error rates for non-native English speakers. Which Responsible AI principle are they failing to uphold?

A government agency is deploying an AI system to detect fraudulent benefit claims. The system uses a neural network trained on historical claims data, which includes a disproportionate number of false positives from a particular ethnic group due to historical over-policing. The agency must ensure the system does not perpetuate discrimination. They have a rigorous testing procedure but limited budget. The project lead wants to balance fairness with detection performance. Which combination of steps should they prioritize?

A company uses Amazon SageMaker Ground Truth to label a dataset for a binary classifier. To reduce labeling bias, which workforce configuration is most appropriate?

A company uses Amazon Comprehend to analyze customer sentiment. They discover the model performs poorly on text with slang from underrepresented groups. What is the most responsible action?

An AI team uses the IAM policy shown in the exhibit to control endpoint creation. Why does this policy support responsible AI?

A large e-commerce company uses a recommendation system to suggest products to customers. Recently, a data scientist noticed that the model's recommendations for high-value luxury items are predominantly shown to users in affluent zip codes, while users in less affluent areas rarely see these items, even if they have searched for them. The company is concerned about fairness and wants to ensure all customers have equal access to recommendations regardless of location. The current model uses collaborative filtering on historical purchase data. The team needs to modify the system without sacrificing overall recommendation accuracy. Which action best addresses the fairness concern while maintaining performance?

A financial services company deploys a generative AI chatbot for customer support. They want to prevent the chatbot from generating harmful or misleading information. Which AWS service can help monitor and filter responses?

A retail company uses a recommendation system that occasionally suggests inappropriate products to minors. Which responsible AI practice should be applied?

Refer to the exhibit. A team is creating an IAM policy for a SageMaker notebook user. The user needs to access training data in an S3 bucket and create models. Which responsible AI concern is most relevant to this policy?

A financial services company uses Amazon Rekognition to verify customer identities. To ensure responsible AI practices, which measure should the company prioritize?

Which TWO of the following are key components of a responsible AI governance framework?

A bank uses an AI system to detect fraudulent transactions. The model has high precision but low recall for small transactions, potentially missing fraud. Which approach aligns with responsible AI?

A financial services company uses a machine learning model to automatically reject credit card transactions suspected of fraud. The model was trained on transaction data from the past two years. Over the last three months, the model's false positive rate has increased significantly, causing legitimate transactions to be declined and leading to customer complaints. The company needs to restore the model's accuracy quickly. Initial analysis shows that the distribution of transaction amounts and locations has shifted compared to the training period. The data science team is under pressure to deploy an update within a week. Which approach should they take to most effectively address the issue while adhering to responsible AI guidelines?

A company uses Amazon Rekognition for facial analysis. They want to ensure the model doesn't exhibit bias based on skin tone. What should they do?

A company develops a chatbot using Amazon Lex. To ensure transparency, what should the chatbot do when it cannot answer a question?

A machine learning team is building a credit risk model and discovers that the training data has a significant imbalance in loan approval rates between two demographic groups. They decide to reweight the training samples using a preprocessing technique. Which SageMaker Clarify feature can help compute the appropriate sample weights to achieve demographic parity?

A financial services company is deploying a generative AI chatbot to assist customers with account inquiries. The company wants to ensure the chatbot does not generate biased or harmful responses. Which combination of AWS services and practices should the company implement to monitor and mitigate these risks?

Which THREE considerations are essential for ensuring responsible AI in a model that predicts employee performance? (Choose 3)

A healthcare startup uses Amazon SageMaker to train a model predicting patient readmission. They need to ensure the model's predictions do not discriminate based on protected attributes like age or race. Which SageMaker feature allows them to monitor and mitigate bias during training?