Best in Test Awards Replay

GuessTheTest is proud to have hosted the 1st annual Best in Test Awards.

The winning tests were exemplary of experimentation that is pushing the boundaries in the industry.

All tests were carefully judged using specific test trustworthiness criteria. Winning case studies achieved these qualities:

Were "True" A/B tests, accurately comparing one element change against another
Saw at least 95% confidence, based on a statistically significant effect and adequate testing time period
Ensured a large, representative, properly-powered sample size
Did not have Sample Ratio Mismatch (SRM) or other testing traffic issues
Showed interesting, or unusual results, far down the funnel

Winning tests will were selected by category and the top tests were showcased during the awards ceremony.

Check out the video below to see the winning tests by category:

Stay tuned for next year's awards, and be sure to

The Four Main Types of Tests You Can Run

One of the most debated testing topics is how large does my sample size need to be to get trustworthy test results? Some argue samples of more than 120,000 visitors per variant are needed to begin to see trustworthy test results. Ishan Goel of VWO disagrees. What does he think is needed to get trustworthy test results? Listen to this webinar recording to find out.