Updated · By Pete Bromfield, former Head of Maths with IB examining experience

IA idea · Numerical methods & error analysis

When the computer gets it wrong: rounding error and cancellation

AA HLAA SLAI HL Ambitious Also in: Pure maths, Calculus

Research question

Why does a spreadsheet give badly wrong values of (1 − cos x)/x² for very small x, at what x does the error take over, and how can rewriting the expression fix it?

Make it yours, then agree it with your teacher.

Next step: plan this IA free — the planner opens with this question filled in. For feedback on your own draft, the IA package (€39 once) gives you 5 AI feedback credits and every annotated exemplar in full.

Why it makes a good exploration

Students trust technology. Finding exactly where it fails, and why, is a rigorous and surprising exploration of limits, series and floating-point arithmetic.

The mathematics you'll need

  • Limits (the true value tends to 1/2)
  • Maclaurin series for cos x
  • Relative error and catastrophic cancellation
  • Rewriting with trigonometric identities (2 sin²(x/2))
  • Log-log error plots

Where the data comes from

No data needed; experiment in a spreadsheet and on a GDC and compare.

A possible outline

  1. Find the limit with series.
  2. Tabulate the spreadsheet values as x shrinks.
  3. Explain the failure with cancellation.
  4. Fix it with an identity and compare.
  5. Reflect on trusting technology in your own IA.

Pitfalls that cost marks

  • Blaming 'the computer' without explaining the mechanism.
  • Not quantifying where the error takes over.
  • Using only one device.

Showing personal engagement

  • Find another expression that breaks the same way.
  • Compare your calculator, spreadsheet and Desmos.
  • Predict the x at which errors appear before testing.

See Criterion C: personal engagement for what examiners look for.

Which course is it for?

CourseFitMaths to lean on
AA SLFits — ambitious at SLLimits (the true value tends to 1/2); Maclaurin series for cos x
AA HLGood fitLimits (the true value tends to 1/2); Maclaurin series for cos x
AI SLNot a natural fitThe mathematics is mainly AA or HL (calculus or proof beyond AI SL); an AI SL version would need a data-driven, technology-based approach.
AI HLGood fitLimits (the true value tends to 1/2); Maclaurin series for cos x

Level: Ambitious. Suits confident students; expect to learn some mathematics on your own. See how the IA differs between AA and AI, SL and HL.

How this idea reaches the top bands

Reflection (D)

For this idea, start with the weak points: blaming 'the computer' without explaining the mechanism; and not quantifying where the error takes over. Say how each one affects your answer.

Use of mathematics (E)

SL: limits (the true value tends to 1/2); maclaurin series for cos x; relative error and catastrophic cancellation; rewriting with trigonometric identities (2 sin²(x/2)); log-log error plots, each explained in your own words and carried out correctly.

How numerical methods explorations reach the top bands in general: Numerical methods & error analysis IA ideas. Guides: A · B · C · D · E · self-grade sheet.

Taking it further

Investigate summing a series forwards and backwards and explain why the results differ.

Extending it for HL

Add an HL technique the question genuinely needs: what an HL numerical methods exploration adds.

Frequently asked questions

Which IB Maths course is this IA idea for?

It works for AA HL, AA SL and AI HL. We rate it Ambitious: it suits confident students, who should expect to learn some mathematics on their own.

What mathematics does this IA use?

Limits (the true value tends to 1/2), maclaurin series for cos x, relative error and catastrophic cancellation, rewriting with trigonometric identities (2 sin²(x/2)) and log-log error plots.

Where can I get data for this IA?

No data needed; experiment in a spreadsheet and on a GDC and compare. Checked sources and tools: Desmos graphing calculator.

Turn this idea into your IA

The planner opens with “When the computer gets it wrong: rounding error and cancellation” filled in: the question, the maths and the data sources.

Plan this IA free

Your plan is kept in this browser. A free account keeps it with your drafts on any device: Join free · Sign in

Also: free IA self-check · A–E checklist (PDF) · have a draft? AI feedback or a review with Pete (€100)

Writing it up: how to write a Maths IA, step by step · structure and format · mistakes that cost marks · IA modelling, step by step

Similar ideas

All numerical methods ideas · AA HL ideas · AA SL ideas · AI HL ideas · All 239 IA ideas