Polls, Samples, and Fair Either-Or Questions

Write balanced questions and interpret public poll results without confusing participant preferences with population estimates.

Read participant preferences without overclaiming

A public either-or poll can describe the people who chose to answer. It usually cannot describe everyone. These guides cover question wording, response options, sample limitations, ordering effects, and responsible reporting.

Start with how to read an online poll before interpreting a response split.

Define who the result describes

Record who could see the poll, how respondents arrived, whether repeat voting was limited, and when responses were collected. The response count does not repair a sample that systematically excludes or attracts particular groups.

Keep the options parallel

Give both choices the same level of detail, time frame, and emotional tone. If neither, both, or unsure are legitimate responses, forcing two options can create a result that is easy to display but hard to interpret.

Report the limit beside the number

State that the result reflects participating visitors and avoid attaching a probability-sample margin of error to a self-selected poll. Keep the sample note visible wherever the percentage appears.

Read every poll in three layers

Decide what the poll result is allowed to mean

Question design and recruitment set the boundary of the claim before the first response is collected.

SituationBest starting methodWhy it fits
You are drafting the questionWording and response-option checkParallel language and complete response choices reduce avoidable measurement error.
You are reading an open web pollParticipant-sample interpretationThe result describes volunteers who answered, not a wider population by default.
A large response count looks persuasiveRepresentativeness auditMore volunteer responses do not correct coverage, recruitment, or nonresponse bias.

Guides in this topic

Read the question-writing guide before collecting responses, then use the sampling guides to keep the published claim inside the evidence.

How to Read an Online Poll Without Overclaiming

An open website poll describes its participating visitors. It usually does not estimate the opinion of a broader population.

8 minute read

How to Read an Online Poll Without Overclaiming

How to Write a Fair Either-Or Question

Keep both options parallel, define the same time frame, remove hidden assumptions, and offer neither if the choice is not exhaustive.

6 minute read

How to Write a Fair Either-Or Question

Sample Size vs. Representativeness in Polls

Sample size affects random sampling uncertainty, while representativeness depends on who could be selected, who responded, and how results were adjusted.

9 minute read

Sample Size vs. Representativeness in Polls

Inspect the public polls