Updated · By Pete Bromfield, former Head of Maths with IB examining experience

IA idea · Survey-based investigations

Does the wording change the answer? A split-sample survey experiment

AI SLAI HLAA SL Solid Also in: Statistics, Probability

Research question

If half your sample is randomly given one wording of a question (or a high 'anchor' number before an estimate) and half another, is there a statistically significant difference in their answers?

Make it yours, then agree it with your teacher.

Next step: plan this IA free — the planner opens with this question filled in. For feedback on your own draft, the IA package (€39 once) gives you 5 AI feedback credits and every annotated exemplar in full.

Why it makes a good exploration

It turns a survey into a controlled experiment. Random allocation lets you draw a cause-and-effect conclusion that ordinary surveys can't.

The mathematics you'll need

  • Random allocation and why it matters
  • Comparing two groups: means or proportions
  • t-test or chi-squared test, with conditions checked
  • Sample size needed to detect a chosen effect
  • HL: confidence interval for the difference

Where the data comes from

Two versions of an anonymous form allocated at random (e.g. by coin toss). Choose harmless questions (estimates of a quantity, opinions on a school matter).

Real data for this idea

  1. Primary source: Census at School New Zealand random sampler. Draw a random sample of past responses as a comparison for your own survey, not a substitute for it. Licence: Check the terms on the site.
  2. Also useful: Census at School USA (American Statistical Association): Census at School USA. The US random sampler gives the same kind of comparison sample. Licence: Check the terms on the site.

Census at School responses are voluntary, so they are not a random sample of all students: use them as a comparison, not as the population. Links checked October 2026; we link to the data and never copy it. More free data sets.

A possible outline

  1. Choose the effect to test and state the hypothesis.
  2. Work out the sample size.
  3. Randomise and collect.
  4. Run the test and check conditions.
  5. Reflect on what the effect means for other surveys.

Pitfalls that cost marks

  • Non-random allocation (e.g. one wording per class).
  • A difference found but the test's conditions not checked.
  • Sensitive questions.

Showing personal engagement

  • Choose wordings you think will matter.
  • Predict the size of the effect.
  • Present the result to whoever runs school surveys.

See Criterion C: personal engagement for what examiners look for.

Which course is it for?

CourseFitMaths to lean on
AA SLGood fitRandom allocation and why it matters; Comparing two groups: means or proportions
AA HLNot a natural fitThe mathematics is mainly from the AI course; at AA HL the exploration would need an AA-level approach (calculus, proof or probability theory) to reach the top of Criterion E.
AI SLGood fitRandom allocation and why it matters; Comparing two groups: means or proportions
AI HLGood fitRandom allocation and why it matters; Comparing two groups: means or proportions

Level: Solid. Needs some independent work beyond class examples. See how the IA differs between AA and AI, SL and HL.

How this idea reaches the top bands

Reflection (D)

For this idea, start with the weak points: non-random allocation (e.g. one wording per class); and a difference found but the test's conditions not checked. Say how each one affects your answer.

Use of mathematics (E)

SL: random allocation and why it matters; comparing two groups: means or proportions; t-test or chi-squared test, with conditions checked; sample size needed to detect a chosen effect, each explained in your own words and carried out correctly.

HL adds: confidence interval for the difference, each explained in your own words and carried out correctly.

How surveys explorations reach the top bands in general: Survey-based investigations IA ideas. Guides: A · B · C · D · E · self-grade sheet.

Taking it further

Test whether the effect differs between groups (a two-way table).

Extending it for HL

This idea already has HL mathematics in it: confidence interval for the difference. Make that the centre of the exploration and use it with full rigour.

Frequently asked questions

Which IB Maths course is this IA idea for?

It works for AI SL, AI HL and AA SL. We rate it Solid: it needs some independent work beyond class examples.

What mathematics does this IA use?

Random allocation and why it matters, comparing two groups: means or proportions, t-test or chi-squared test, with conditions checked, sample size needed to detect a chosen effect and hL: confidence interval for the difference.

Where can I get data for this IA?

Two versions of an anonymous form allocated at random (e.g. by coin toss). Choose harmless questions (estimates of a quantity, opinions on a school matter). Checked sources and tools: Census at School New Zealand, Census at School USA (American Statistical Association) and Desmos graphing calculator.

Turn this idea into your IA

The planner opens with “Does the wording change the answer? A split-sample survey experiment” filled in: the question, the maths and the data sources.

Plan this IA free

Your plan is kept in this browser. A free account keeps it with your drafts on any device: Join free · Sign in

Also: free IA self-check · A–E checklist (PDF) · have a draft? AI feedback or a review with Pete (€100)

Writing it up: how to write a Maths IA, step by step · structure and format · mistakes that cost marks · IA statistics, step by step

Similar ideas

All surveys ideas · AI SL ideas · AI HL ideas · AA SL ideas · All 239 IA ideas