highlight · part vi · 1

You can't score a relationship.

Trust in your data comes from carefully crafting the codebook. This relationship cannot be reduced to a number.


Validation is a relationship you build with your codebook. You learn where it's reliable. You learn where it isn't. You learn which round of refinement made which field trustworthy.

after three rounds of minting, you know:

  • Question 1rock solid
  • Question 2rock solid
  • Question 3rock solid
  • Question 4rock solid
  • Question 5rock solid
  • Question 6rock solid
  • Question 7rock solid
  • Question 8rock solid
  • Question 9needs a human eye on historical documents
  • Question 10works beautifully now — didn't until round 3

A score collapses all this into one dimension. You know a codebook the way you know a colleague — specifically, over time.

Earned through use. Not granted by a metric.

Helping you build a trusting relationship with your data.

@karlrohe