Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The same rough markers we used for overall scores hold true for individual tasks:

Success scoreMeaning
0-50Most participants had real trouble with the task.
If they understood the task properly, then the tree failed to do its job.
If they didn’t understand the task (
see ~Where people went below
see Where they went later in this chapter), then
you
we won’t be able to judge the tree based on this task alone.
50-65A mixed bag: most found it, but quite a few didn’t.
This usually indicates that the tree is roughly right for this task, but there are specific topics that are luring some users off the correct paths.
65+Most participants succeeded.
Your
The tree is performing well for this task, and probably only needs minor tweaks to corral the wayward few.

 

Success rate is a good general indicator of the effectiveness of our tree, but immediately we want to dig deeper. For example, if we have a success rate of 27% on a task, we naturally want to ask “Where are all these people going wrong?”. For that, we need to look at the paths they took through our tree.

...