DA0-002 Data Analysis Practice Question
A company is planning an A/B test to compare two website designs. Which THREE of the following must be determined before the test begins to ensure valid results? (Select three.)
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The desired effect size
Sample size (based on power and effect size), significance level (α), and desired effect size are all pre-specified to design the test. The p-value is an outcome, not a pre-test parameter. The hypothesis is defined beforehand, but which one is false? Actually null and alternative hypotheses should be pre-specified, but the phrasing 'which one is true' is not determined before; the test determines that. So correct are: determine minimum sample size, determine significance level, and determine desired effect size.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
The desired effect size
Why this is correct
Helps determine sample size.
- ✗
The p-value of the test
Why it's wrong here
p-value is calculated after collecting data.
- ✗
Which hypothesis is true
Why it's wrong here
The test determines that, not pre-specified.
- ✓
The minimum sample size required
Why this is correct
Needed to ensure adequate statistical power.
- ✓
The significance level (α)
Why this is correct
Must be set before, typically 0.05.
Go deeper
Related to this question
About these practice questions
This DA0-002 question is part of Courseiva's 986-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This DA0-002 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DA0-002 exam.