Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Here’s our take on how does tree testing compares to a few of these methods.

 


Closed card sorting

Before tree testing became established, closed card sorts were a popular way to evaluate a site structure.

In a closed sort, participants are given a “pile” of topic cards and asked to put them into pre-named groups. The group names are typically the top-level headings in the site tree:

  •  ss of closed sort

...

 


Image Added


Once enough participants have done the closed sort, we can inspect the results to see if they put the right cards into the right buckets and (if not) where they disagreed.

...

  • Most closed sorts only test a single set of groups, which only represent a single level of the tree (usually the top level). Tree testing evaluates the full depth of the tree.

  • Closed sorts are essentially a filing exercise (“Where would you put this topic?”). While this is similar to browsing a website, it’s doesn’t mimic the act of browsing as well as tree testing does.

  • Tree-test results are easier to analyse analyze than closed-card-sort results (as we’ll see in Chapter ~).12 - Analyzing results).

For more on comparing closed sorts to tree tests, see David Juhlin's well-considered article, Is closed card sorting an outdated technique for IA?


Usability testing

Usability testing, whether in person or using remote tools, is a powerful technique, but it differs in some major ways from tree testing:

...

Tree testing certainly does not take the place of usability testing. Think of tree testing rather as a quick method you can use to test complement to usability testing - a early way of testing structural ideas before you we even have a prototype.

 It's also good to know that that tree-testing results line up nicely with later usability testing, as described in this 2014 academic paper.


Web analytics

Analytics are great because they tell you us what your our total population of site visitors is actually doing on your our site – where they click, where they don’t, and so on.

The traditional weakness of analytics is that, while they can tell you us (in detail) what actions your our users are taking on your the site, they can’t tell you us why. When you we track visitors jumping from your our home page to an intermediate landing page to a content page, you we have no idea why they’re going there; maybe they’re looking for what you we intended, maybe they’re not. Maybe they leave because they found the answer they wanted; maybe they leave because they didn’t. You We have no context, so you we don’t know how well the site performed in that sense.

Like a usability test, tree testing gives you us context by letting you us set specific tasks for the user to do. When they go down a certain path in your our tree, you we know if that’s a success or a failure.

Analytics are a great way to see where your our users are going, and can reveal issues in your our site structure, but on their own they’re not enough. 


...

Next:  Chapter 3 - key points

...