...
You can also see scattering when you download view the results as a spreadsheet. The vertical cluster of cells shows that, for a single task, participants chose a wide variety of subtopics under the correct topic.
...
Studying the click paths of a single task gives us insights into how the tree performed for that particular task. But it’s dangerous to draw conclusions based on only one scenario. What we need to do is look for supporting evidence from the other tasks in our study – see Finding patterns among tasks later in this chapter.
- show examples from UserZoom
Discovering more correct answers
...
It seems that no matter how thoughtfully we construct our trees and tasks up front, and mark which answers are correct, once we launch the test and start looking at click pathsseeing where they go, we always seem to find more correct answers that participants have “discovered” on their own.
- example – Meridian tree 0 task 7 (get permission first)add example
Often, it’s clear that we missed an answer, so we should just fix it and recalculate our results – see Cleaning the data earlier in this chapter.
...