There’s some bad news and good news.
Let’s get the bad news out of the way. Then, go into the good news.
The bad news is: what you’ve been taught about how to calculate a valid A/B test is probably wrong!
That cause you’ve probably been taught using Frequentist Statistics.
While there’s nothing wrong with Frequentist Statistics, the model doesn’t work that well when applied to A/B testing.
In Frequentist statistics, the only way to validly address this question is by stating a null hypothesis. And here’s where it gets more mind boggling. . .
Unlock Access. Sign up to become a Pro Member. Get complete access to this helpful content, plus so much more.
To get users clicking your content, which format works best: buttons or links. A series of 8 real-life A/B tests suggests one format consistently outperforms. Can you guess which version wins? Checkout the mini meta analysis to find out.
Learn how using Google Tag Manager (GTM) helps you overcome many of the limitations with Google Analytics 4 (GA4). Find out the best ways to use GTM to manage and derive the most meaningful data from GA4.
To increase conversions, should you use product or lifestyle photos to showcase and sell your product? This mini meta analysis explores and answers this question, providing you with tangible takeaways and top test ideas, all in an easy-to-scan and easy-to-implement format. Which version wins? Checkout the mini meta analysis to find out.