Which invitation route brought you to this questionnaire?
Optional short open textUse a non-identifying route description to inspect cohort composition.Survey design and interpretation / Survey guide
Survey methods · Worked example
Compare survey waves when the respondent mix changes
Check respondent-group counts before interpreting a change in an overall survey percentage. Work through unchanged group rates with a shifting sample mix.
Opens product registration. Example questions are not imported automatically.
DESIGN THE ANSWER SPACE
What recent experience are you using to answer the feedback question?
Optional short open textCheck whether waves refer to comparable experience rather than merely identical wording.Does the stated time period match that experience?
Optional short open textFind period mismatch that can change which experience is reported.Suggested formats to adapt, not preconfigured product fields.
A worked interpretation example
From a comment to a practical next step.
Illustrative scenario. These are not customer results.
Keep the finding specific
Wave 1 has channel A 16 favourable of 20 and B 40 of 80. Wave 2 has A 64 of 80 and B 10 of 20.
Choose an action to test
Report both channel percentages and counts alongside each overall percentage; investigate invitation mix before claiming the service improved.
Check the experience again
For the next wave, retain wording, period and invitation rules where possible and compare counts plus within-channel percentages.
Read the answers carefully
Limits to preserve
Equal wording does not ensure comparable respondents. This synthetic channel mix is not a weighting recommendation or a significance test.
Comparison note: the overall share rises from 56% to 74% in the synthetic sample while both channel shares remain unchanged. Investigate recruitment mix before claiming an experience change.
From question to next step
Make the feedback useful.
Set the decision
Pilot with people reached through each planned invitation route before comparing successive waves.
Invite relevant voices
Report both channel percentages and counts alongside each overall percentage; investigate invitation mix before claiming the service improved.
Choose an action
For the next wave, retain wording, period and invitation rules where possible and compare counts plus within-channel percentages.
A useful starting point
Free-text pilot questions
Two feedback waves use the same question but different invitation channels. An overall percentage rises while each channel’s percentage stays the same. Review cohort definitions before interpreting the trend.
If nothing was unclear or difficult, say so. Skip questions about steps you did not experience; use not applicable where appropriate.
Which invitation route brought you to this questionnaire?
Use a non-identifying route description to inspect cohort composition.
What recent experience are you using to answer the feedback question?
Check whether waves refer to comparable experience rather than merely identical wording.
Does the stated time period match that experience?
Find period mismatch that can change which experience is reported.
Which part of this invitation differs from the one you saw previously, if any?
Probe invitation context without requiring someone to have answered an earlier wave.
If nothing was unclear or difficult, say so. Skip questions about steps you did not experience; use not applicable where appropriate. Which invitation route brought you to this questionnaire? What recent experience are you using to answer the feedback question? Does the stated time period match that experience? Which part of this invitation differs from the one you saw previously, if any?
Download the questions as text ↓
Examples to adapt, rather than a validated research instrument.
Choose the response format
Make room for the explanation.
| Question | Suggested format | What to preserve |
|---|---|---|
| Which invitation route brought you to this questionnaire? | Optional short open text | Use a non-identifying route description to inspect cohort composition. |
| What recent experience are you using to answer the feedback question? | Optional short open text | Check whether waves refer to comparable experience rather than merely identical wording. |
| Does the stated time period match that experience? | Optional short open text | Find period mismatch that can change which experience is reported. |
| Which part of this invitation differs from the one you saw previously, if any? | Optional short open text | Probe invitation context without requiring someone to have answered an earlier wave. |
Make questions optional where appropriate. If you add a rating scale, label its endpoints, keep one idea per question, and retain a follow-up for reasons. These examples are not a validated measurement instrument.
Before you send it
Check what your wording assumes.
Why did satisfaction improve this month?
What recent experience are you using to answer the feedback question?
The revision avoids assuming improvement and checks experience comparability.
Build with SurveyTeams
Adapt these pilot questions in SurveyTeams
Use these examples to draft your questionnaire. Create a survey draft, add questions, and check the respondent preview in SurveyTeams. Additional features depend on your account and plan.
Create your survey in SurveyTeams
Opens product registration. Example questions are not imported automatically.
Learn about the product ↗Run a focused feedback cycle
Plan the invitation, review and follow-up.
When and whom to ask
Pilot with people reached through each planned invitation route before comparing successive waves.
Who reviews the finding
The reporting reviewer owns the comparison; the recruitment owner records invitation channels and eligibility.
What to check after a change
Check whether any later overall movement is accompanied by within-channel movement and stable collection context.
Handle responses carefully
Do not request contact identifiers merely to identify a channel. Avoid publishing tiny identifiable groups; use an organization-approved aggregation rule.
A worked measurement study
Inspect the data. Trace the decision.
Every record here is synthetic. Use the rule to review your own evidence before taking action.
Read units and denominators with the source table. These are invented example records.
Work through the rule
Wave 1 overall = (16+40)/(20+80)=56%. Wave 2 overall = (64+10)/(80+20)=74%. Channel A remains 80% and B 50%; the mix changes.
Comparison note: the overall share rises from 56% to 74% in the synthetic sample while both channel shares remain unchanged. Investigate recruitment mix before claiming an experience change.
Invented records · inspect every count
| Wave | Channel | Answers | Favourable | Within-channel share |
|---|---|---|---|---|
| Wave 1 | A | 20 | 16 | 80% |
| Wave 1 | B | 80 | 40 | 50% |
| Wave 2 | A | 80 | 64 | 80% |
| Wave 2 | B | 20 | 10 | 50% |
On small screens, scroll a wide table sideways to see all columns.
Download example data (.csv) · Download method worksheet (.json)
Keep evidence and inference separate
Observed
Counts and shares within each channel
Supports descriptive decomposition of the overall change.
Unknown
Population composition and causal effects
Do not invent weights or attribute improvement.
Next check
Compare eligibility, timing and channel invitations
Retain counts with each reported share.
Before you send it
Questions, answered.
Did the service necessarily improve?
No. These invented numbers show how a respondent-mix change can move the overall percentage with unchanged group shares.
Should I automatically weight the answers?
No. Weighting needs a justified target population and method; this worksheet supplies neither.
What belongs beside the overall trend?
Group counts, group shares, question wording, collection period and invitation context.
Can I load this example automatically?
No. Copy or download the free-text pilot questions and adapt them in your draft. The registration link does not import them. The calculation worksheet is a separate manual example; verify supported fields and features in your account.
Continue exploring