Survey design and interpretation / Survey guide

Survey methods · Worked example

Survey participation and completion denominators

Distinguish invited people, started questionnaires and completed questionnaires before reporting a survey participation percentage.

Opens product registration. Example questions are not imported automatically.

Editable examplesPractical guidanceNo-code starting point

WHAT TO READ · WHAT TO TEST

Observation

Synthetic cohort: 40 eligible people invited, 20 started and 12 finished. One draft uses 40 as its denominator; another uses 20.

Interpretation boundary

This invited-cohort calculation is not a formal AAPOR response-rate estimate. Unknown eligibility, duplicate invitations and partial cases require an explicit disposition policy.

Next experiment

Report 12/40 invited-cohort participation and 12/20 started-questionnaire completion separately; document who entered each count.

Illustrative scenario. These are not real response counts or findings.

A useful starting point

Free-text pilot questions

A feedback owner has a known eligible invitation list but a report labels two different percentages “response rate.” Use the worked cohort below and pilot the invitation before choosing a reporting denominator.

If nothing was unclear or difficult, say so. Skip questions about steps you did not experience; use not applicable where appropriate.

QUESTION 01

What experience does this invitation ask you to have had?

Check whether the stated experience matches the intended invitation cohort.

QUESTION 02

Which part of the invitation explains why you were contacted?

Find ambiguity in eligibility rather than interpreting nonparticipation as disinterest.

QUESTION 03

What would help you decide whether to start the questionnaire?

Separate unclear purpose from missing access or time.

QUESTION 04

Which instruction is unclear if you begin but cannot finish?

Clarify the partial-completion route without pressuring people to finish.

Download the questions as text ↓

Examples to adapt, rather than a validated research instrument.

Before you send it

Check what your wording assumes.

BEFORE / LEADING

Why did you ignore our important survey?

AFTER / CONTEXTUAL

What would help you decide whether to start the questionnaire?

The revision asks about participation barriers without assuming deliberate refusal.

Choose the response format

Make room for the explanation.

Suggested formats for this example questionnaire
QuestionSuggested formatWhat to preserve
What experience does this invitation ask you to have had?Optional short open textCheck whether the stated experience matches the intended invitation cohort.
Which part of the invitation explains why you were contacted?Optional short open textFind ambiguity in eligibility rather than interpreting nonparticipation as disinterest.
What would help you decide whether to start the questionnaire?Optional short open textSeparate unclear purpose from missing access or time.
Which instruction is unclear if you begin but cannot finish?Optional short open textClarify the partial-completion route without pressuring people to finish.

Make questions optional where appropriate. If you add a rating scale, label its endpoints, keep one idea per question, and retain a follow-up for reasons. These examples are not a validated measurement instrument.

From question to next step

Make the feedback useful.

01

Set the decision

Pilot with a few people who fit the invitation rule before sending the full questionnaire; participation is optional.

02

Invite relevant voices

Report 12/40 invited-cohort participation and 12/20 started-questionnaire completion separately; document who entered each count.

03

Choose an action

Reconcile the next cohort’s invitation, start and finish counts using the same definitions; inspect why eligible people could not participate.

A worked interpretation example

From a comment to a practical next step.

Illustrative scenario. These are not customer results.

01 / OBSERVE

Keep the finding specific

Synthetic cohort: 40 eligible people invited, 20 started and 12 finished. One draft uses 40 as its denominator; another uses 20.

02 / INVESTIGATE

Choose an action to test

Report 12/40 invited-cohort participation and 12/20 started-questionnaire completion separately; document who entered each count.

03 / FOLLOW UP

Check the experience again

Reconcile the next cohort’s invitation, start and finish counts using the same definitions; inspect why eligible people could not participate.

Read the answers carefully

Limits to preserve

This invited-cohort calculation is not a formal AAPOR response-rate estimate. Unknown eligibility, duplicate invitations and partial cases require an explicit disposition policy.

Reporting note: 30% of the known eligible invitation cohort finished; 60% of starters finished. This is descriptive cohort reporting, not a formal response-rate or representativeness claim.

Run a focused feedback cycle

Plan the invitation, review and follow-up.

When and whom to ask

Pilot with a few people who fit the invitation rule before sending the full questionnaire; participation is optional.

Who reviews the finding

The survey owner defines eligibility and distinct invitations; the reporting reviewer checks all three counts.

What to check after a change

After clarifying the invitation, review participation barriers under the same inclusion rule; do not attribute a changed percentage to wording alone.

Handle responses carefully

Keep contact details out of this worksheet. Explain whether pilot comments can be linked to an invitation record; accept a skip without repeated pressure.

A worked measurement study

Inspect the data. Trace the decision.

Every record here is synthetic. Use the rule to review your own evidence before taking action.

Invented records · inspect every count

Inspect the synthetic example
Known-cohort countPeople
Eligible invited people40
Distinct starters20
Distinct finishers12

On small screens, scroll a wide table sideways to see all columns.

Download example data (.csv) · Download method worksheet (.json)

Try the arithmetic

Local calculation sandbox

Change the invented inputs to explore the rule. Inputs stay in this browser; nothing is sent or saved.

30 % invited-cohort participation

The written example remains below if JavaScript is unavailable. A calculation does not validate a sample, instrument or forecast.

Work through the rule

Invited-cohort participation = 12÷40×100 = 30%. Completion among starters = 12÷20×100 = 60%. Both use 12 finishers but answer different questions.

Reporting note: 30% of the known eligible invitation cohort finished; 60% of starters finished. This is descriptive cohort reporting, not a formal response-rate or representativeness claim.

Keep evidence and inference separate

Observed

Known invitation, start and finish counts

Supports two labelled percentages.

Unknown

Views of people who did not respond

Do not infer satisfaction or population coverage.

Next check

Inspect eligibility and duplicate-invitation policy

Resolve the denominator before comparing campaigns.

Before you send it

Questions, answered.

Which denominator should a completion percentage use?

Here it uses distinct starters. A percentage among eligible invitees is a separately named measure.

Does high participation prove an unbiased sample?

No. Document who could participate and whose experience may be missing.

Where can I find formal response-rate guidance?

Use the linked AAPOR resources and an appropriate disposition definition; this simple sandbox does not implement those formulas.

Can I load this example automatically?

No. Copy or download the free-text pilot questions and adapt them in your draft. The registration link does not import them. The calculation worksheet is a separate manual example; verify supported fields and features in your account.

Build with SurveyTeams

Adapt these pilot questions in SurveyTeams

Use these examples to draft your questionnaire. Create a survey draft, add questions, and check the respondent preview in SurveyTeams. Additional features depend on your account and plan.

Create your survey in SurveyTeams

Opens product registration. Example questions are not imported automatically.

Learn about the product ↗

Continue exploring

Related feedback guides.