Confidence

The level of certainty that the A/B test results you’ve achieve are reliable and repeatable.

On GuessTheTest, we aim to publish only tests that have achieved 95% confidence or above.

A 95% confidence level means there’s just a 5% chance the results are due to random factors — and not the variables that changed within the A/B test.

Note, it’s impossible to reach 100% confidence. You can only ever achieve 99.99% confidence.