DA0-002 Data Analysis Practice Question
An analyst is conducting an A/B test to compare two website designs. The null hypothesis is that there is no difference in conversion rates. The p-value obtained is 0.03, and the significance threshold is 0.05. What should the analyst conclude?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Reject the null hypothesis; there is a significant difference.
Since p-value (0.03) < α (0.05), we reject the null hypothesis, indicating a statistically significant difference.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Reject the null hypothesis; there is a significant difference.
Why this is correct
Correct: p < α, reject null.
- ✗
Accept the alternative hypothesis that the new design is better.
Why it's wrong here
We reject null but do not automatically accept alternative; further analysis needed.
- ✗
The test is inconclusive; need a larger sample size.
Why it's wrong here
p < α provides evidence to reject null; sample size is adequate if test was properly designed.
- ✗
Fail to reject the null hypothesis; there is no significant difference.
Why it's wrong here
p < α means reject null.
Go deeper
Related to this question
About these practice questions
Courseiva writes every DA0-002 question from scratch — 986 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This DA0-002 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DA0-002 exam.