highlight · part iii · 1

Not every document fits the grid.

Careful readers disagree on some cells. No hallucination: the quotes are real, the reasoning is valid. And still they don't agree.


4 papers × 5 codebook fields

doc
f₁
f₂
f₃
f₄
f₅
paper_01
✓
✓
✓
✓
✓
paper_02
✓
⚠
✓
✓
✓
paper_03
✓
✓
✓
✓
✓
paper_04
✓
✓
⚠
✓
✓

⚠ two cells where careful readers disagreed.

The paper isn't ambiguous. The codebook asked something the paper didn't answer plainly. That's the codebook's responsibility — and the codebook is what decides what to do next.

When careful readers disagree, your codebook has three moves:

→Sharpen

Sharpen the wording. Name the threshold. Split the conjunction.

→Scaffold

Add an upstream free-text field, giving the reader something to think about first. Often what they write settles the cell.

→Relax

Allow a free-text answer. Sit with the complexity rather than forcing a premature answer.

Sometimes you sharpen. Sometimes you scaffold. Sometimes you relax. And some flags you leave, because no policy would hold.
Three craft decisions. The fourth is to leave it.

@karlrohe