A company is planning an A/B test to compare two website designs. Which THREE of the following must be determined before the test begins to ensure valid results? (Select three.)
Helps determine sample size.
Why this answer
Sample size (based on power and effect size), significance level (α), and desired effect size are all pre-specified to design the test. The p-value is an outcome, not a pre-test parameter. The hypothesis is defined beforehand, but which one is false? Actually null and alternative hypotheses should be pre-specified, but the phrasing 'which one is true' is not determined before; the test determines that.
So correct are: determine minimum sample size, determine significance level, and determine desired effect size.