11 - Running the test

“It’s time to play the music, it’s time to light the lights…” –  The Muppet Show

It’s time to get things started on the Muppet Show tonight with our tree test. We're ready to launch it and see what happens.


Splitting users randomly among tests

Using separate links or code

Launching the test(s)

A launch checklist, and timing the launch

Monitoring the test's progress

Dealing with low turnout, weird scores, and high drop-out rates

Keeping stakeholders informed

Sending periodic updates to the team

Asking “why?” with in-person sessions

When we get results that need more probing

Closing the test

A few housekeeping items to remember

Key points


Next:  Chapter 12 - Analyzing results


Copyright © 2024 Dave O'Brien

This guide is covered by a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.