Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Current »


 

As mentioned earlier, you may want to control who gets to do your study (and who doesn’t).

The easiest case is that you’re happy to get results from anyone who visits the site (in the case of web ads) or anyone you’ve emailed (presuming that being on the email list is enough qualification in itself).

However, there will be times when you want to be picky – when you a particular subset of users (or don’t want them).

For example, if you’re testing a site structure for a bank’s online banking service, you probably want online-banking users. More specifically, you may want to exclude bank customers who have never used online banking and never intend to, since their answers would be irrelevant and could actually skew the results.

 

Screening by filtering a database

If you’re recruiting using a customer database, you may be able to filter the users down to those who have logged into online banking, say, once a month or more. That may be enough “screening” for you, so you can go ahead and run your study without more qualifying questions.

 

Screening using separate email lists

If you have email lists that are already separated into groups that meet your specifications (e.g. business customers vs. consumers), then the job is easy – you invite people from the appropriate list to the corresponding study.

However, because email invitations can get forwarded (beyond your control), you may still want to include a screening survey question in your tree test, just to make sure you’re getting the participants you intended.

 

Screening with explicit questions

But what if you’re using a web ad (which every site visitor sees) or you have a customer email list that doesn’t include enough data to filter the users the way you want? In these cases, you’ll need to explicitly ask each interested person if they meet your specifications.

There are several ways to do this screening:

  • Using descriptive links
    The easiest way to point specific types of participants to specific tests is to use a list of links that describe who they’re for. You can use this list in both an email invitation and in a web ad’s explanation page. This works well as long as the descriptions are clear and distinguishable from each other:



  • Using a screening tool
    You can also use a dedicated screening tool (such as Ethnio) to make sure you’re getting the right participants. When users click your web ad, Facebook post, or Twitter tweet to participate, these tools pop up a window that asks the qualifying questions that you’ve provided. People who “pass” are directed through to your tree test, while the others are politely thanked and dismissed.



  • Using your tree-testing tool
    If your tree-testing tool offers a screening feature, you could of course use that instead.
    Even if it doesn’t, as a last resort, you could ask a screening question during the tree test itself (as a survey question either before or after the tasks), and then only include the qualified participants in your results. However, that would be a waste of time, effort, and data for those who didn’t meet your screening criteria, and you’ll need to include them in any reward you’re offering, because they did the study as you requested (even though you didn’t use their results).

 


Next: Restricting access with a password

 

  • No labels