AI Associate Ethical Considerations of AI — Timed 15 Questions

Question 1

A company uses Einstein Prediction Builder to recommend products. They notice the model often recommends high-priced items to users in affluent areas, potentially excluding others. What should the AI Associate do first?

Accepted Answer

Check the training data for representation and bias.. The correct first step is to check the training data for representation and bias because the model's tendency to recommend high-priced items to affluent areas suggests the training data may be skewed or contain historical biases. Einstein Prediction Builder relies on historical data to learn patterns, and if the data over-represents affluent users or under-represents others, the model will perpetuate those biases. Auditing the data for fairness and representation is the foundational step before any remediation, as per responsible AI practices.

Answer

Remove the model from production immediately.

Answer

Ignore the issue because the model predictions are accurate overall.

Answer

Add more features about customer income.

Question 2

An AI Associate deploys an Einstein Bot that uses sentiment analysis to escalate frustrated customers. After launch, the bot escalates disproportionately for non-native English speakers. What is the most likely cause?

Accepted Answer

The sentiment model was trained on a non-representative dataset.. Option A is correct because the sentiment analysis model likely exhibits bias due to training data that does not adequately represent the linguistic patterns, idioms, or expressions of non-native English speakers. This causes the model to misinterpret neutral or positive statements from these users as negative or frustrated, leading to disproportionate escalations. A non-representative dataset is a common source of algorithmic bias in AI systems.

Answer

The bot is routing to the wrong department.

Answer

The escalation threshold is set too low.

Answer

The bot is not properly connected to the escalation queue.

Question 3

A healthcare organization uses Einstein Discovery to predict patient readmission risk. The model uses protected attributes like race and age as features. Which action best aligns with Salesforce's ethical AI principles?

Accepted Answer

Retain the features but monitor for disparate impact and ensure compliance with regulations.. Removing protected attributes is a common step, but if they are proxies for legitimate medical factors, they may be retained with monitoring. Option A is too aggressive. Option C ignores that age can be medically relevant. Option D violates transparency and accountability.

Answer

Remove race and age features entirely to ensure fairness.

Answer

Replace age with an age group bucket to reduce granularity.

Answer

Use the model as is because predictions are accurate.

Question 4

A sales team uses Einstein Lead Scoring. They notice the model gives low scores to leads from certain industries. The AI Associate suspects bias. What should they do to validate?

Accepted Answer

Analyze the distribution of scores across industry segments.. Option D is correct because analyzing the distribution of scores across industry segments directly validates whether the model exhibits systematic bias. By comparing score distributions, the associate can identify if certain industries are consistently under-scored, which would indicate a biased pattern rather than random variation. This approach aligns with ethical AI practices that require transparency and fairness assessment before any model adjustments.

Answer

Run a holdout test to check prediction accuracy.

Answer

Retrain the model with balanced data.

Answer

Review the model's confidence intervals.

Question 5

An AI Associate is asked to build a model that predicts employee performance. The dataset includes gender, department, and tenure. Which practice could introduce ethical risk?

Accepted Answer

Including gender to improve model accuracy.. Option D is correct because including gender as a feature in a predictive model for employee performance can introduce bias and lead to unfair or discriminatory outcomes. Even if the model's accuracy improves, using protected attributes like gender may violate ethical guidelines and regulations such as GDPR or anti-discrimination laws, as it could perpetuate historical biases or result in disparate impact.

Answer

Evaluating model performance across different groups.

Answer

Excluding gender from the model features.

Answer

Documenting model limitations and assumptions.

Question 6

A financial services firm uses Einstein Next Best Action to offer credit products. The model recommends high-interest loans more often to minority groups. The AI Associate must mitigate this. What is the most effective approach?

Accepted Answer

Apply post-processing fairness adjustments to the recommendations.. Option C is correct because post-processing fairness adjustments directly modify the model's output to enforce demographic parity or equal opportunity, reducing biased recommendations without retraining the model. This approach is practical when the firm cannot easily change the underlying training data or model architecture, and it allows the AI Associate to intervene at the decision point to ensure fair lending practices.

Answer

Remove the model and use a rule-based system.

Answer

Use SHAP values to explain predictions.

Answer

Add a disclaimer that recommendations may be biased.

Question 7

A company's Einstein Sentiment model is used to flag negative customer feedback. The model was trained on English reviews only. When deployed globally, it misclassifies positive reviews in Spanish as negative. What is the primary ethical concern?

Accepted Answer

The model is unfair to Spanish-speaking customers.. The primary ethical concern is fairness: the model was trained exclusively on English reviews, so it systematically misclassifies Spanish positive feedback as negative. This creates a disparate impact on Spanish-speaking customers, violating the principle of algorithmic fairness. The issue is not just low accuracy but an unjust bias that disadvantages a specific linguistic group.

Answer

The model is not interpretable.

Answer

The model has low accuracy for Spanish reviews.

Answer

The model violates privacy regulations.

Question 8

Which TWO actions help ensure transparency in AI systems according to Salesforce's ethical AI guidelines?

Accepted Answer

Documenting model assumptions and limitations.. Option D is correct because documenting model assumptions and limitations is a core transparency practice under Salesforce's ethical AI guidelines. It ensures stakeholders understand the boundaries and potential biases of the AI system, enabling informed trust and accountability.

Answer

Limiting access to model outputs to only a few people.

Answer

Using complex deep learning models without explanation.

Answer

Automatically retraining models weekly.

Question 9

Which THREE factors should an AI Associate consider when evaluating a model for potential bias?

Accepted Answer

Whether features are correlated with protected attributes.. Option B is correct because if a feature is correlated with a protected attribute (e.g., race, gender, age), the model may inadvertently learn and perpetuate discriminatory patterns, even if the protected attribute itself is not used as an input. This is a key source of indirect or proxy bias in machine learning systems.

Answer

The complexity of the model architecture.

Answer

The date the model was last deployed.

Question 10

Which TWO practices are recommended when using AI for automated decision-making in hiring?

Accepted Answer

Regularly audit the model for adverse impact.. Option B is correct because regular auditing for adverse impact is a core ethical practice to detect and mitigate bias in AI-driven hiring systems. Audits involve statistical analysis (e.g., the four-fifths rule from the Uniform Guidelines on Employee Selection Procedures) to compare selection rates across protected groups, ensuring the model does not disproportionately disadvantage certain demographics.

Answer

Use the AI model as the sole decision-maker.

Answer

Use all available data including protected attributes.

Answer

Ignore adverse impact if the model is accurate.

Question 11

An AI Associate reviews the Lead Scoring model exhibit. What is the primary ethical concern with this model?

Accepted Answer

The model has low recall, potentially missing minority class leads.. The primary ethical concern is that the model has low recall, meaning it fails to identify a significant portion of actual positive leads (the minority class). In a lead scoring context, this can result in missed business opportunities and potential bias against certain customer segments, as the model systematically overlooks valuable leads that do not fit the majority pattern.

Answer

The model uses too many features.

Answer

The model is not explainable.

Answer

The training data is imbalanced.

Question 12

An AI Associate reviews the bot configuration and test results. Which action best addresses the ethical issue?

Accepted Answer

Add Spanish language support with separate sentiment model and intents.. The bot underperforms for Spanish speakers, so adding a Spanish sentiment model and intents would improve fairness. Option A does not fix the disparity. Option C may not solve the root cause. Option D is about privacy, not the language issue.

Answer

Increase the fallback threshold for all languages.

Answer

Collect more data from Spanish-speaking customers and retrain the English model.

Answer

Disable sentiment analysis for non-English conversations.

Question 13

A healthcare organization is deploying an AI model to predict patient readmission risk. The model was trained on historical data that underrepresented minority populations. During testing, the model shows lower accuracy for those groups. What should the data scientist do first?

Accepted Answer

Re-evaluate the training data to ensure balanced representation and consider re-sampling techniques.. Option D is correct because the first step in addressing model bias is to audit the training data for representational imbalance. Re-evaluating the data and applying re-sampling techniques (e.g., oversampling minority groups or undersampling the majority) directly targets the root cause of the disparity—skewed class distributions—before modifying the model or its features.

Answer

Remove sensitive attributes like race and gender from the training data.

Answer

Ignore the disparity because the model's overall accuracy is acceptable.

Answer

Retrain the model with more complex algorithms to improve accuracy.

Question 14

A financial institution uses an AI system to approve loan applications. The system denies loans to applicants from certain postal codes at a higher rate. The model includes 'postal code' as a feature. Which ethical consideration is most directly violated?

Accepted Answer

Fairness. The AI system's use of 'postal code' as a feature leads to disparate impact on applicants from certain areas, directly violating the ethical principle of fairness. Fairness requires that AI models do not discriminate against protected groups or perpetuate systemic biases, even if the feature itself is not a protected attribute. By denying loans at a higher rate based on postal code, the system is likely engaging in proxy discrimination, which is a core fairness violation.

Answer

Privacy

Answer

Accountability

Answer

Transparency

Question 15

A company is developing a chatbot for customer service. They want to ensure the bot does not generate offensive responses. Which practice should they implement?

Accepted Answer

Deploy a content filter and human-in-the-loop moderation for sensitive interactions.. Option D is correct because deploying a content filter combined with human-in-the-loop moderation provides both automated detection of offensive language and human oversight for ambiguous or sensitive interactions. This layered approach ensures that the chatbot can block clearly toxic outputs in real time while allowing human reviewers to handle edge cases, reducing the risk of generating offensive responses.

Answer

Use unsupervised learning to allow the bot to learn naturally from conversations.

Answer

Remove all toxicity detection to avoid false positives.

Answer

Train the model only on customer service transcripts without review.