...
But tree tests are not all sunshine and lollipops. Some of our tasks will probably look like this one, again from InternetNZ:
...
The correct answer in under Policies, in a section called Jurisdiction, but 87% of our participants failed to find it. Only 3% gave up, so where did all the others go?
The answer is that they went everywhere. Graphically, this is what “everywhere” looks like:
...
Quite the mess. But what can we learn from it?
...
For example, let’s look at the Projects by name section more closely:
...
A large chunk of participants came here, and the correct answer (Jurisdiction) was waiting for them, but most didn’t choose it (partly because it’s more abstract than the other topics).
...
The graph makes another problem obvious too – the “leakage” at the top level of the tree:
...
Right at the start, as their first click, a large fraction of the participants ran off in all directions. This is not what we intend when we design a site structure. It suggests that either:
...