Market Research: Foundations to Practice · Writing Unbiased Survey Questions
Scale Design and Balance
An unbalanced or inconsistent rating scale can distort results just as much as biased wording. This chapter covers what a genuinely well-constructed scale requires.
Rating scales should be symmetrical, offering an equal number of positive and negative response options on either side of a clear, genuinely neutral midpoint, since an unbalanced scale, such as one offering three positive options but only one negative option, structurally biases the distribution of responses toward the more generously represented end regardless of respondents' actual underlying sentiment [1].
Key Takeaways
- Rating scales should be symmetrical with a clear neutral midpoint; unbalanced scales structurally bias the response distribution.
- Scale labeling and direction should stay consistent throughout a survey; reversing polarity mid-survey is a classic source of contaminated data.
- Odd-numbered scales include an explicit neutral midpoint; even-numbered scales force a lean, sometimes deliberately to prevent easy non-answers.
- Fully labeling every scale point, not just the endpoints, generally improves comprehension and data reliability at modest layout cost.