P301 · Evaluation & feedback

Remove presentation answer cues

Keep an assessment from leaking its answer through presentation differences.

Editorially reviewed

These examples and illustrative results are independently authored teaching materials, not measured model results.

Use case

Create a retry-policy quiz requiring waits and at most two retries for transient errors. A uniquely bold/long/detailed correct option lets learners answer from presentation.

Mechanism

Establish the question’s correct-answer basis and plausible distractors. Keep length, syntax, detail and emphasis comparable without distorting accuracy for equal counts. Vary positions with mappings recorded. Hide explanations/answer-bearing helper text until choice, then give policy-based feedback. Inspect the complete presentation for format-only shortcuts.

Bad example

Make the correct answer a long bold paragraph while others say immediately or ignore, encouraging the longest-option guess.

Good example

Offer comparably detailed bounded-wait, immediate-bounded and ongoing-wait retry options. Express each clearly without unique emphasis; the prompt determines correctness. Explain waits/two-retry limit after choice, without making distractors vague to force identical lengths.

Why the change matters

Comparable presentation reduces association with irrelevant format. Reasoned feedback also exposes poor distractors instead of merely revealing a letter.

Observable expectation

Check unique length/boldness/fixed placement. If correctness remains guessable with content hidden, revise presentation. Wrong-choice feedback cites violated requirements without changing the key. This is not empirical quiz validity.

Limits

Equal word counts cannot remove semantic clues or establish validity. Frozen exact-count advice is a strategy, with clarity/accuracy taking priority. Avoid teaching false rules through distractors; learning outcomes need validation.

Sources and evidence

Read the editorial criteria