...

Most tools let you us add survey questions to your our tree test. This can help you us in several ways:

• You We can ask questions that help you us analyze your the results (e.g. by comparing results between groups of participants).
  
  
• You We can ask questions that fill gaps in your our user research (e.g. things that you we didn’t ask in your our last user survey).
  
  
• You We can ask if participants would like to be involved in future studies for this website or product.
  
  
  

Your Our tree-testing tool may provide the ability to screen participants based on their answers to opening questions: if they answer “correctly”, they are allowed to proceed with the test; if they don’t, they are politely dismissed.

If your the tool doesn’t give you provide this option, there are other ways of screening participants – see Screening for specific participants in Chapter 9.

...

Probably the most useful way to use survey questions is for filtering results later so you we can compare between groups of participants.

For example, if you we post a web ad on your our site that asks visitors to do a tree test, you we may want to find out if return visitors do better than first-time visitors (presumably because they’re already familiar with your our site’s structure). If you we add a survey question that asks them “Is this your first visit to our site?”, you we can later split up the results into two groups (yes and no) and see if and where their results differ.

Note that you we do need to plan your our questions carefully to make sure you’re we’re getting the splits you we want to compare.

• For more on testing different groups of users, see Different user groups in Chapter 9.
  
  
• For more on filtering results to analyze subsets of data, see Analyzing by user group or other criteria in Chapter 12.
  
  
  

...

Good user experience depends on knowing who your our users are and what makes them tick. That means that every chance we get to learn from users, we should be trying to fill gaps in what we know about them, and continually asking new questions to guide our designs.

The main purpose of a tree test, of course, is to test the tree you’ve we’ve come up with, before you we build the site. However, because tree tests are very brief (typically about 5 minutes), you we also have a chance to ask a few fill-in-the-gap questions.

Most tree-testing tools let you us add survey questions to your our tree test. Before you But before we jump in and add a whole slew of research questions, however, consider the following:

• Questions that help you us analyze the results later are usually more important than general research questions, so add those first.
  
  
• Tree-test tools typically do not offer the advanced capabilities of dedicated survey tools (such as if-then question logic and fancy reporting), so we should keep your our “mini survey” simple.
  
  
• Don’t irritate your participants with a long list of follow-up questions. They have done what you we asked by completing your our tree test, and while they are probably willing to answer a few more questions, their goodwill will erode rapidly if you demand substantially more we demand another solid chunk of time and effort from them.
  
  

We recommend keeping the total number of questions to 5 or less. Because we usually ask some data-filtering questions to help our analysis, this leaves us room to ask 2-3 general research questions at most.

If you find yourself with there are 5 or 10 (or more) questions that you we really want answers to, we should consider creating a proper online survey to run separately from your our tree test. You We will be happier with the features offered by a full-on survey tool, and your our participants will not feel like they’ve been tricked into doing more work than they signed up for. 

...

• An organization may want all of its employees to do a study for a new intranet that it's planning.
  
  
• You We may be using a commercial research panel where panelists are automatically rewarded once they complete the study.
  
  

In this case, youwe'll need a mandatory question that asks for a unique identifier from each participant:

• For commercial panels, this is often a numeric identifier that the panel assigns to each panelist.
  
  
  • The identifier may be automatically passed to your the tree-test testing tool by the panel software, in which case you we just need to set up the integration of the two tools. (See your the tool's docs for details.)
    
    
  • If there is no automatic integration, youwe'll need to ask each panelist to enter the identifier that their panel gave them.
    
    
• For other situations, youwe'll need to find out which identifier to use (email address is a common choice), and ask each participant for it.

...

• If they're willing to give it to us (e.g. for a prize draw, for follow-ups on this study, or for future studies), that's great.
  
  
• But if they want to stay anonymous, that's fine too. We really just want their tree-test responses, and we don't want them to abandon the test because they feel they're being strong-armed in to giving give up personal information.
  
  

In most cases, we typically just ask for an email address because it’s easy (one field that they type all the time) and pretty much everyone has one.

...

• We make the email address optional.
  If they don’t want to give it, that’s fine (and we inform them that they won't be included in the prize draw, if any), but we still want their test results.
  
  
• We promise not to spam them.
  We assure them that we will not spam them (by using their email for other purposes like advertising) or share their address with other organizations.
  
  Here's an example:

Your email address (optional - only used for the prize draw, or if you asked to be notified about future research. No spam!)

...

One way to get part of that benefit is to give participants an optional “comments” field where they can give feedback, ask questions, offer suggestions, and so on. It’s pretty much guaranteed that you’ll we’ll get a few snarky comments, but you’re we’re also likely to get a few gems that give you us additional insight into how your our users think.

If you we want to extend the conversation, you we can also can ask participants if it’s OK to contact them to follow up on their test results and comments. We’ve got some of our most useful insights from talking to participants who were very critical in their feedback during the test; these are users who are typically very invested in the product/website you’re we’re testing, and they’re pleasantly surprised to be contacted by a real person who wants to hear more about their needs and issues.

If you’re we’re running a tree test, it’s unlikely to be the only research you’re we’re doing for your our project. And participants can be hard to come by, so why not have one study help the next one?

We often finish our survey questions with an invitation to do future studies about this product/website. It usually looks like this:

To improve the Acme website, we're doing more studies like this over the next few months. Would you like to be notified to help us out?

...

In our experience, a lot of people are willing; we typically get a “yes” response rate of 40-60%.

Note that you’ll we’ll need contact info for these people (usually an email address), so you we can notify them when your our next study is open for business. If we already asked them for an email address for a prize draw, we just use that instead of asking for it again.

...

Some tree-testing tools let you us decide when the survey questions will be presented – before the tree test, after, or some of each.

Be We need to be careful about asking questions before you we present the tasks. Your Our questions (and any multiple-choice answers you we supply) can give away information about the structure of the tree or the terminology youwe're using in it.

Even if your our questions don't explicitly give anything away, they may still have a "priming" effect on the participant, by putting them into a particular mindset before they try your the tasks.

In most cases, it’s best to ask survey questions after the tasks, because they won’t affect the tree test itself. While most questions won’t skew your the results much, it’s best to be safe.

...

Next: Choosing a visual designlook