DA0-002 Data Analysis Practice Question
An analyst runs an A/B test with 1000 users per group and observes a conversion rate of 5% in the control and 6% in the treatment. The p-value is 0.12. What should the analyst conclude?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The difference is not statistically significant at the 0.05 level.
Since p-value > 0.05, we fail to reject the null hypothesis; the observed difference is not statistically significant.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
The difference is not statistically significant at the 0.05 level.
Why this is correct
Correct interpretation.
- ✗
The sample size is too small to detect an effect.
Why it's wrong here
While possible, conclusion is based on p-value; the test may lack power, but the direct conclusion is not significant.
- ✗
The treatment significantly outperforms control.
Why it's wrong here
p > 0.05 indicates no significant difference.
- ✗
There is a 12% chance the treatment is better.
Why it's wrong here
p-value is not the probability the treatment is better.
Go deeper
Related to this question
About these practice questions
This DA0-002 question is part of Courseiva's 986-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This DA0-002 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DA0-002 exam.