11 - Running the test
“It’s time to play the music, it’s time to light the lights…” – The Muppet Show
It’s time to get things started on the Muppet Show tonight with our tree test. We're ready to launch it and see what happens.
Splitting users randomly among tests
Using separate links or code
Launching the test(s)
A launch checklist, and timing the launch
Monitoring the test's progress
Dealing with low turnout, weird scores, and high drop-out rates
Keeping stakeholders informed
Sending periodic updates to the team
Asking “why?” with in-person sessions
When we get results that need more probing
Closing the test
A few housekeeping items to remember
Key points
Copyright © 2024 Dave O'Brien
This guide is covered by a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.