Skip to content

Designing Effective Surveys

Writing clear questions, avoiding bias, choosing scales and analysing responses responsibly.

Editorial team 2 min read

Surveys are a common source of data about attitudes and behaviour. Their value depends almost entirely on design.

Define the Purpose

Know what decisions the survey will inform and what you need to learn. Every question should earn its place; long surveys lower response rates and quality.

Writing Good Questions

  • Use plain, specific language.
  • Ask one thing per question — avoid "Was the service fast and friendly?"
  • Avoid leading wording: "How much did you enjoy…" presumes enjoyment.
  • Provide balanced answer options, including "don't know" or "not applicable" where appropriate.
  • Ask about specific, recent behaviour rather than general habits.

Scales

Rating scales (such as five or seven points from "strongly disagree" to "strongly agree") should be consistent across questions, with labelled points.

Order and Flow

Start with easy, relevant questions; put sensitive and demographic questions later; watch for earlier questions influencing later answers.

Test First

Pilot with a small group, ask them what they understood each question to mean, and revise.

Sampling and Response

Consider who receives the survey and who responds. Low or skewed response rates limit what you can conclude; weighting helps only partly.

Analysis

Report the number of respondents and response rate, show the distribution of answers rather than only averages, and be cautious with small subgroups. Free-text answers are valuable; language models can help summarise them, with human checking.

Respect Respondents

Be clear about how data will be used, keep responses confidential as promised, and don't collect more personal data than needed.

More in Data science & analytics

All Data science & analytics guides →
Data science & analytics Guide · 2 min

Descriptive Statistics Essentials

Mean, median, mode, spread and shape: the summary numbers every analysis starts with, and when each one misleads.

Data science & analytics 2 min read 6 Mar 2026

Data science & analytics Guide · 2 min

Probability Basics for Data Work

The probability ideas analysts use every day: events, conditional probability, independence and Bayes' theorem.

Data science & analytics 2 min read 5 Mar 2026

Data science & analytics Guide · 2 min

Common Probability Distributions

Normal, binomial, Poisson, exponential and more: recognising the shapes data takes and what they imply.

Data science & analytics 2 min read 4 Mar 2026

Data science & analytics Guide · 2 min

Hypothesis Testing Explained

Null hypotheses, p-values and significance: what a hypothesis test tells you, and the misunderstandings to avoid.

Data science & analytics 2 min read 3 Mar 2026