As mentioned in How many participants?, the tree you’re testing may serve more than one user group. As discussed in Different tasks for different user groups in Chapter 7, there are two basic methods to testing multiple types of users:

Identifying for separate tests

If you’re running a separate test for each user group, the test design is simple – you have your tree and a list of tasks that are aimed at that user group.

To recruit for this test, you would typically identify qualified participants first, then point them to the study. In other words, the qualifying step would be done before they start the test. For more on this, see Screening for specific participants later in this chapter.

 

Identifying in the same test

If you’re targeting several user groups with the same test, you first need to make sure that each user group can reasonably perform the tasks you’ve set. For more on this, see Different tasks for different user groups in Chapter 7.

Because they’re all doing the same test, you need a way to identify each participant’s user group. This is usually done by adding a survey question to the test. Later, when you’re analyzing the results, you can filter them by this question to compare between the user groups.

Here’s a typical survey question that identifies the participant’s user group:

 

Note that, like any survey question, it should:

Sometimes, it may not be possible for a single question to determine the user group. If your testing tool lets you filter results based on combinations of survey questions, you can use 2 (or even 3) questions to determine the user group.

For more on how to filter results by user group, see Analyzing by user group or other criteria in Chapter 12.

 


Next: Using web ads