...
- Did it perform well, and all we have to do is tweak a few things?
- Did it perform just OK, and some parts need reorganizing?
- Did it perform poorly, and we need to discard it and look at other options?
Overall success rate
No surprisingly, the most important thing to look at is success rate – how many participants chose the correct answer, across all tasks?
...
- how TT scores relate to UT scores, why 65+ is good, and the role of visual design, nav aids, content, etc. in eventual success rates. Lisa Fast’s graph?
Directness
Overall directness (backtracking)
To get a general idea of the effectiveness of your tree, it also helps to look at how directly your participants found the right answer. Did they go straight there, or did they have to try a few different paths first?
...
While the overall directness score gives you a rough idea of how clear and distinguishable your headings are, you’ll need to drill down to specific tasks to determine where the most backtracking happens. For more on this, see “Where people backtracked” later in this chapter.
Overall speed (time taken)
Most tree-testing tools show you the average (or median) time taken by your participants to complete the tree test.
...