...
Often, it’s clear that we missed an answer, so we should just fix it and recalculate our results – see “Updating correct answers” on page ~ Cleaning the data earlier in this chapter.
However, we do need to be careful about changing our correct answers based on incoming results, because adding correct answers will raise our scores. If we are analyzing a tree that we hope does well, it’s often a bit too easy to convince ourselves that our participants’ borderline answers should be marked as correct. For more on this, see “Pandering to the task” in Chapter 13what we call "pandering to the task", see Revising trees in Chapter 14.
The best way to govern this is to agree on some consistent criteria for correctness ahead of time - see “How Correct is Correct?”see Identifying correct answers in Chapter 7.
...
Next: What they clicked first
...