Evaluating Dataset Quality for AI
Which THREE factors should be considered when evaluating the quality of a dataset for an AI model?
Quick Answer
The answer is the number of duplicate records in the dataset, along with the presence of outliers and the balance of target classes. Duplicate records artificially inflate the weight of certain data points, causing the model to learn patterns that do not generalize, while outliers can skew sensitive algorithms like linear regression or k-means clustering, leading to biased predictions. On the Salesforce AI Associate exam, this question tests your understanding of data preprocessing fundamentals, often appearing as a "select three" item where one distractor might be "total dataset size" or "file format." A common trap is overlooking duplicates because they seem harmless, but they silently distort accuracy metrics. To remember the three factors, think of the acronym DOB: Duplicates, Outliers, and Balance—if any of these are off, your model’s performance will be off too.
⚠ Common exam trap
Salesforce often tests the misconception that dataset size (option A) is a primary quality metric, whereas the exam emphasizes that completeness, consistency, and absence of bias (e.g., missing values, duplicates, outliers) are more critical for model reliability.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Presence of outliers that may skew the model.
Outliers can disproportionately influence model training, especially in algorithms like linear regression or k-means clustering, leading to biased predictions. Evaluating the presence and impact of outliers is critical for ensuring the model generalizes well to unseen data.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Total number of records available for training.
Why it's wrong here
Volume is a quantity, not quality.
- ✓
Presence of outliers that may skew the model.
Why this is correct
Outliers can distort the model's understanding.
- ✗
Number of distinct labels in the outcome field.
Why it's wrong here
This is a model design consideration, not data quality.
- ✓
Percentage of missing values in key fields.
Why this is correct
High missingness can reduce model accuracy.
- ✓
Number of duplicate records in the dataset.
Why this is correct
Duplicates can cause overfitting.
Go deeper
Related to this question
About these practice questions
One of 753 original AI Associate practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
3 more ways this is tested on AI Associate
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. Data quality is critical for AI model performance. Which three data quality dimensions should be monitored? (Choose three.)
hard- ✓ A.Completeness
- ✓ B.Consistency
- C.Uniqueness
- ✓ D.Timeliness
- E.Volume
Why A: Completeness, timeliness, and consistency are fundamental data quality dimensions. Volume is not a quality dimension; uniqueness is related to consistency but not always required.
Variation 2. Which TWO data preparation steps are critical for ensuring high-quality training data?
medium- A.Increasing dataset size by adding noise.
- ✓ B.Removing duplicate records.
- C.Normalizing all features.
- ✓ D.Handling missing values appropriately.
- E.Using only labeled data.
Why B: Duplicate records in a dataset can cause the model to overfit to repeated patterns, biasing the learned distribution and reducing generalization. Removing duplicates ensures each data point contributes equally to training, which is essential for robust model performance.
Variation 3. A retail company has implemented a Salesforce AI lead scoring model to prioritize high-value customers. After three months, the model's AUC-ROC score is only 0.55, indicating poor performance. The data scientist reviews the training data and finds that 20% of the records are exact duplicates due to multiple data imports from different sources. The duplicates have inconsistent target labels (some labeled 'converted', others 'not converted'). What should the data scientist do to improve model performance?
easy- A.Downsample duplicates to reduce their impact but keep all records.
- B.Use the duplicates as a separate class to indicate noisy data.
- ✓ C.Remove all duplicate records and keep only one instance per duplicate group, resolving label conflicts by majority vote.
- D.Keep all duplicates because they represent multiple interactions; increase model complexity to handle them.
Why C: Duplicate records with conflicting labels confuse the model. Removing duplicates and resolving label conflicts (e.g., by majority vote) is the most effective step to clean the data and improve performance.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI Associate practice question is part of Courseiva's free Salesforce certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI Associate exam.