Significance Testing Tool

Compare two or more groups on proportions or means using Z-tests or t-tests (two-tailed).

1. Choose test type

Proportions (percentages) Means (continuous)

Proportions: % awareness, % top-2 box, etc. Means: average rating, spend, satisfaction, etc.

2. Input mode

Sample sizes (applied to all comparisons below)

Group A: Sample size (n₁)

Group B: Sample size (n₂)

Quick sample size options (sets both groups):

Multiple comparisons (Proportions)

Enter percentages for Group A and Group B for each metric / question. You can add more rows as needed.

Diff (B − A) pp	Z-score	p-value	Sig (90 / 95 / 99)
–	–	–	–
–	–	–	–
–	–	–	–

Blank rows are ignored when running the test.

Percentages are converted to proportions (0–1) and tested using a two-sample Z-test (unpooled). Same n is used for all rows.

Two-tailed test. H₀: no difference between Group A and Group B.

Multi-group comparison (Proportions only)

Copy from Excel: Label | Sample size (n) | Percentage (%) – separated by TABs or commas. The first row is treated as the baseline.

Output: Z-test for each group vs baseline, with 90% / 95% / 99% significance flags.