Collecting task ideas

As we come up with ideas for tasks, it’s important to track them against our tree. The simplest way is to jot them down in our spreadsheet, in the Task column:

 

In this first pass, the goal is to collect our ideas quickly.

Refining our task list

After we’ve taken a first pass through the tree, either by ourselves or with others contributing too, we’ll likely come up with too many task ideas. This is a good thing, because we can then refine our task list down to a smaller number of focused items.  

To pick the winners for our task list, we look for:

It's important for us to mark our task ideas to show which we're keeping and which we're not. For example, we could highlight the chosen ones in green, or we could leave them unmarked and highlight the not-chosen ones in red. It doesn’t matter which method we use, as long as we’re consistent (and we include a legend so that others can understand our method later.)

Using the spreadsheet method, we find it’s better to mark tasks as deleted (e.g. using strike-through or a red highlight) rather than delete them outright. That way, if we change our minds later, we can reinstate a task that we initially “crossed out”. In the example below, we’ve highlighted the chosen tasks in green and struck out the unchosen tasks:

 

Checking coverage

When deciding which tasks to include, we also want to keep an eye on coverage - which parts of the tree we’re testing, and which we’re ignoring.

It’s not usually feasible to test every subtree of every section of the site, and usually it’s not necessary either. For example, if participants can find the specifications for product A in our site (by looking in the Products section, say), it’s safe to assume that they can also find product B’s specs in the same section.

Once we’ve created tasks that cover the most common, critical, and contentious areas of the site, it’s a good idea to pull back and see which parts of the tree are covered too much or too little.

If we find gaps in coverage (and we likely will), we may want to change up our tasks a bit:

Keep in mind that some of our tasks may have several correct answers in different parts of the site (or at least several places where we suspect participants will look). If we’re using a spreadsheet to track tasks, it’s often a good idea to copy our task ideas into these alternate slots too. We typically use some kind of styling (e.g. italics) to indicate that these are references to a task mentioned elsewhere in the tree.



Next: Different tasks for different user groups