guess_the_test-white-green
Member Login
Member
Login
guess_the_test-white-green

Peeking

« Back to Glossary Index

Involves looking at a test result before the test has concluded and deciding to stop the test because it looks like a winner has emerged.

Peaking at a test result is like baking a cake, opening the oven and deciding the cake is ready before it’s fully finished.

Even though it’s tempting to stop the test early and dig into that delicious win, the results are only half-baked.

Before pulling a cake out of the oven, a good baker pokes a tooth pick, or fork, into the cake batter to make sure it’s truly ready. If the batter sticks to the fork, the cake needs to stay in the over longer longer.

The same goes for A/B testing.

In a split-test, you should calculate the required sample size ahead of time to know if you've received enough traffic to declare a winner.

If the necessary sample size hasn't yet been reached, you know you need to keep the test running longer.

« Back to Glossary Index
hello world!
eyechevron-downarrow-circle-upcrossmenu-circlecross-circle linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram