guess_the_test-white-green
guess_the_test-white-green
Menu
Free Sign up
Member Login
Result: What's the optimal notification bar timing?
Pop-up, timed to display upon exit

WINNING VERSION

A

The pop-up timed to display upon exit was the big winner!

But, the test was much more complex. Read on to learn more. . .


Test Details & Background:

Guided under the direction of GuessTheTest's sister site, ConvertExperts, NextLeft, an award-winning digital marketing agency, conducted this terrific timing test for their client GMercyU, a private American university, which offers over 40 undergraduate and graduate degree programs.

This study was part of an on-going series.

Initially, an A/B test was ran to determine the optimal placement of a notification bar. In that test, a bottom notification bar was pitted against a reduced text bottom notification bar, with only a Call To Action (CTA) button, as well as a bottom, right-sided hook, and an exit pop-up.

The exit pop-up was the strong winner. However, the exit pop-up triggered only to viewers leaving the site. In contrast, all the other notification bars immediately displayed to all visitors who landed on the page.

It was, therefore, determined worthwhile to run a notification bar timing test that isolated the variable of timing displayed, examining the impact of when the notification bar triggered.

The goal of this follow-up test was two-fold:
1) Validate and optimize on Phase I results
2) Determine if both placement and timing impacted conversions

To examine this question, three variants were created:

  • Version A - Exit pop-up: displayed in the center of the screen, only when the user motioned to leave/exit the page
  • Version B - Hook: slid up from the bottom, right side of the page; displayed immediately when the user landed on the page
  • Version C - Scroll depth hook: slid into the page from the bottom, right; displayed only when the user scrolled down 20% of the page, showing engagement in the page content

These versions were formatted for both desktop and mobile visitors. They looked like this:

Oh, snap! Only Pro Members Have Full Access To This Test

Unlock Access. Sign up to become a Pro Member. Get complete access to this helpful content, plus so much more.

paywall_robot

Would you like to see your personal test results? 

Become a Pro Member

Poll Results - The Best Guesses:

What's the optimal notification bar timing?

  • A (58%, 282 Votes)
  • B (42%, 208 Votes)

Total Voters: 490

Vote

Loading ... Loading ...
Subscribe
Notify of
guest
3 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Bryan Trilli
3 years ago

Did this test count the views just on the exit pop-up when calculating the conversion rate or the views on the landing page where the exit pop-up was being tested? The difference is often the exit pop-up will never get displayed so it's not accurate to just look at the views on the pop-up itself. Instead we would consider the total views on the landing page running the exit pop-up when testing against hooks that are always on the page. For instance, if the 4700 views on the exit pop-up variation are only for the pop-up itself at 6.31% conversion… Read more »

This week’s Featured Test is brought to you by:

Test Run By:

nextleft-logo-300x80

Test Run For:

gmercy-u-logo

Test Run On:

convertflow-logo-300x44

Other Tests You Might Enjoy

View All Tests

This week’s Featured Test is brought to you by:

Test Run By:

nextleft-logo-300x80

Test Run For:

gmercy-u-logo

Test Run On:

convertflow-logo-300x44
Meet the GuessTheTest Founder
Deborah O'Malley, MS.sc.
deborah_omalley-headshot-1-776x776 Deborah is a Google Analytics certified digital marketer with a master's of science (M.Sc.) degree specialized in eye tracking technology. She founded GuessTheTest to connect digital marketers interested in Conversion Rate Optimization (CRO) and A/B testing with helpful resources and fun, gamified A/B tests that inspire and validate testing ideas.
magnifiercrossmenu-circlecross-circle
linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram