Question 257 of 1,000
Ethical Considerations of AIhardMultiple ChoiceObjective-mapped

Fairness Audit Steps — First Step to Detect AI Bias

This AI Associate practice question tests your understanding of ethical considerations of ai. The scenario asks you to isolate a root cause — eliminate options that address a different problem before choosing. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

A global retail company deploys an AI-powered chatbot for customer service. The chatbot uses natural language processing to understand and respond to customer inquiries. After deployment, the company notices that the chatbot consistently provides less accurate and less helpful responses to customers from non-English-speaking regions, particularly those using dialects or slang. The company's data science team trained the model primarily on English-language customer service transcripts from the US and UK. The AI Ethics team has raised concerns about fairness and potential bias. The company wants to address this issue while maintaining overall performance and minimizing cost. Which action should the company take first?

Clue words in this question

Noticing these words before you look at the options changes how you read each choice.

  • Clue: "first"

    Why it matters: Order matters here. You are being tested on which action comes before the others — not which action is generally useful.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Conduct a fairness audit using diverse test cases from multiple languages and dialects to quantify the disparity.

Option B is correct because the first step in addressing potential bias in an AI system is to measure and quantify the disparity. Conducting a fairness audit with diverse test cases from multiple languages and dialects provides the data science team with a clear, empirical baseline of the model's performance gaps. This diagnostic step is essential before any remediation (like retraining or adding constraints) to ensure that subsequent actions are targeted and effective, avoiding wasted resources or unintended consequences.

Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • Implement a fairness constraint in the model's loss function to penalize disparities across language groups.

    Why it's wrong here

    Implementing constraints without first analyzing the bias could lead to unintended trade-offs or new biases.

  • Conduct a fairness audit using diverse test cases from multiple languages and dialects to quantify the disparity.

    Why this is correct

    An audit with diverse test cases will identify the specific gaps, allowing targeted and cost-effective improvements.

    Clue confirmation

    The clue word "first" in the question point toward this answer.

    Related concept

    Read the scenario before looking for a memorised answer.

  • Disable the chatbot for non-English languages and redirect those customers to human agents.

    Why it's wrong here

    Restricting service to English only fails to serve non-English-speaking customers equitably.

  • Collect more training data from all regions and retrain the model from scratch.

    Why it's wrong here

    Collecting more data without first understanding the specific gaps may not efficiently address the dialect/language issue and could be costly.

Common exam traps

Common exam trap: answer the scenario, not the keyword

Salesforce often tests the principle that measurement and diagnosis must precede intervention; the trap here is that candidates may jump to a technical fix (like a fairness constraint) or a drastic operational change (like disabling the chatbot) without first conducting the essential diagnostic step of a fairness audit.

Detailed technical explanation

How to think about this question

A fairness audit typically involves constructing a stratified evaluation dataset that includes representative samples from each language group, then computing metrics such as accuracy, precision, recall, or F1-score per group to detect statistically significant disparities. This process aligns with frameworks like the AI Fairness 360 toolkit, which provides metrics (e.g., disparate impact ratio, equal opportunity difference) to quantify bias. In a real-world scenario, a company might discover that the chatbot's intent classification accuracy drops from 92% for English to 45% for a dialect like Jamaican Patois, revealing that the model's word embeddings fail to capture non-standard syntax, which then guides a targeted data augmentation strategy rather than a full retrain.

KKey Concepts to Remember

  • Read the scenario before looking for a memorised answer.
  • Find the constraint that changes the correct option.
  • Eliminate answers that are true in general but not in this case.

TExam Day Tips

  • Watch for words such as best, first, most likely and least administrative effort.
  • Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Real-world example

How this comes up in practice

A practitioner preparing for the AI Associate exam encounters this exact type of scenario on the job. The correct answer here is not the most general option — it is the best answer for the specific constraint described. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Real exam questions reward reading the full scenario before eliminating options, because the constraint defines which answer fits.

What to study next

Got this wrong? Here's your next step.

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Related practice questions

Related AI Associate practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Practice this exam

Start a free AI Associate practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

FAQ

Questions learners often ask

What does this AI Associate question test?

Ethical Considerations of AI — This question tests Ethical Considerations of AI — Read the scenario before looking for a memorised answer..

What is the correct answer to this question?

The correct answer is: Conduct a fairness audit using diverse test cases from multiple languages and dialects to quantify the disparity. — Option B is correct because the first step in addressing potential bias in an AI system is to measure and quantify the disparity. Conducting a fairness audit with diverse test cases from multiple languages and dialects provides the data science team with a clear, empirical baseline of the model's performance gaps. This diagnostic step is essential before any remediation (like retraining or adding constraints) to ensure that subsequent actions are targeted and effective, avoiding wasted resources or unintended consequences.

What should I do if I get this AI Associate question wrong?

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Are there clue words in this question I should notice?

Yes — watch for: "first". Order matters here. You are being tested on which action comes before the others — not which action is generally useful.

What is the key concept behind this question?

Read the scenario before looking for a memorised answer.

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Same concept, more angles

2 more ways this is tested on AI Associate

These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.

Variation 1. Refer to the exhibit. A developer receives this fairness check error. What is the most likely cause?

easy
  • A.The model has higher false positive and false negative rates for Group B.
  • B.The error is due to insufficient training data for Group A.
  • C.The model is overfitting.
  • D.The recommendation suggests reweighting, so the model is already fair.

Why A: Option A is correct because the fairness check error indicates the model has higher false positive and false negative rates for Group B compared to Group A, which demonstrates disparate treatment. This is a common fairness violation. Option B is incorrect because insufficient training data might lead to other issues, but the error shown is specifically about error rate disparity. Option C is incorrect because overfitting is not indicated by these fairness metrics. Option D is incorrect because the recommendation to reweight is a mitigation step, not a confirmation that the model is already fair.

Variation 2. A large e-commerce company uses Salesforce Einstein to recommend products to customers. The AI model is trained on purchase history, browsing behavior, and demographic data including age and gender. Recently, the company received complaints that the model seems to recommend lower-priced items to female customers and higher-priced items to male customers for the same product categories. The data science team confirms the model has a statistically significant difference in recommendation value by gender. The company's ethical AI policy requires fairness, transparency, and human oversight. The compliance team is considering several actions. Which action should the company take first?

hard
  • A.Adjust the model to increase recommendation prices for female customers
  • B.Disable the recommendation system until the issue is resolved
  • C.Conduct a thorough bias audit to identify all sources of disparate impact
  • D.Immediately remove gender from the training data and retrain the model

Why C: The correct answer is C. The company's ethical AI policy requires fairness, transparency, and human oversight. Before taking any corrective action, the company must first understand the root cause and extent of the bias. A thorough bias audit will identify whether the bias stems directly from gender, from proxy variables (e.g., browsing patterns correlated with gender), or from other data imbalances. Only after this audit can the company decide on an appropriate remedy, such as retraining the model with balanced data or adjusting the model's objectives. Disabling the system (option B) is premature and may disrupt business operations without solving the underlying issue. Removing gender from the data (option D) is not sufficient because other features can serve as proxies for gender. Adjusting prices for females (option A) would introduce a new bias and is unethical.

Keep practising

More AI Associate practice questions

Last reviewed: Jun 30, 2026

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

Sign in to join the discussion.

This AI Associate practice question is part of Courseiva's free Salesforce certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI Associate exam.