# Pretest open and closed survey question formats

Inspect what a provided answer list changes before choosing an open or closed question.

If nothing was unclear or difficult, say so. Skip questions about steps you did not experience; use not applicable where appropriate.

## 1. What answer would you give before seeing a list of examples?

Answer: ____________________

## 2. Which listed option, if any, expresses that answer?

Answer: ____________________

## 3. What experience cannot be expressed by this list?

Answer: ____________________

## 4. How did seeing the list change what came to mind?

Answer: ____________________

## Author notes / illustrative keys where applicable

1. Preserve the unprompted explanation before the list can cue categories.
2. Check fit without forcing the closest inadequate choice.
3. Locate missing coverage with room for none or non-exposure.
4. Investigate prompting rather than treating it as proven bias.

Interpretation caution: A small exploratory pilot cannot validate universal option coverage or unbiased measurement. Listed choices are external-method illustrations.


## Illustrative finding and follow-up

Observation: One fabricated answer concerns pickup discovery, which neither listed category expresses.

Action to test: Keep an optional open pilot prompt and revise the category proposal before a new test.

Follow-up: Test new fabricated experiences including no issue and non-exposure; inspect fit and explanation.


## Collection protocol

When and whom to ask: Before choosing a response format, let volunteers answer the actual prompt before showing the proposed list.

Decision owner: The questionnaire owner chooses the format; the reviewer checks coverage and presentation order.

Follow-up: Test new fabricated experiences including no issue and non-exposure; inspect fit and explanation.

Response handling: Use nonsensitive fabricated delivery cases; do not require addresses or order IDs. Closed choices here are a method illustration.

## Decision workshop

Synthetic examples only. Manual worksheet; no automatic import or product writes.

### Synthetic pilot and reporting records

Draft evidence | Example | Implication
--- | --- | ---
Exact open prompt | What happened during your latest delivery, if anything? | Unprompted external-method draft
Exact closed prompt | Which listed description matches your latest delivery? | External-method draft, not a configured product field
Full draft choices | Late arrival; damaged item; no issue; did not experience a delivery; prefer not to answer | Pickup discovery omitted; no forced answer
Open pilot answer | Could not find pickup point | Unprompted synthetic explanation
Revised review | Retain open pilot or revise coverage | Retest before coding

### Version changes

Boundary | Draft | Revised
--- | --- | ---
Coverage | Closest listed option forced | Unexpressible case retained
Sequence | List shown before open answer | Unprompted answer collected first in this exploratory pilot

### Draft or earlier version (review its limits)

A short option list gives the same answers as an open question.

### Revised example

The invented list omits pickup discovery. Preserve the unprompted explanation, review coverage and retest; the formats may prompt different experiences.

### Decision situations

- A relevant answer cannot be expressed: Review coverage or use an optional open prompt before retesting.
- The list covers these pilot examples: Retain this limited finding; do not assert universal coverage.
- The list was shown first: Do not label the later answer unprompted.

### Method references

- Pew Research Center question design: https://www.pewresearch.org/writing-survey-questions/ — Wording and response-option consistency.