Mathematical Reasoning

The project began properly only when the community asked who had defined the problem, who would hold the data and who could stop the work. Practice and emerging evidence suggest that mathematical reasoning is a distinct determinant of outcomes within mathematical learning, but current approaches are inconsistent.

In Indonesia, Anika's team at a mixed urban and regional education network had been asked to explore mathematical Reasoning. The immediate pressure was practical: current approaches to mathematical reasoning are fragmented, poorly calibrated or insufficiently measured, making it difficult to distinguish real benefit from substitution, novelty or surveillance effects. People could see activity, outputs and confident recommendations, but those signals did not establish that capability, safety or agency had improved.

Anika resisted turning the scenario into a success story too early. As a learning support coordinator, Anika knew that a memorable example can clarify a research problem, but it cannot validate a causal claim. The team therefore framed one answerable question: How can AI support explanation, proof and relational thinking rather than answer production? The story gave the work human stakes; the question gave it a boundary.

The working hypothesis was specific enough to fail: Socratic prompts requiring justification will improve reasoning quality more than worked solutions. That wording changed the conversation. Instead of asking whether the idea sounded beneficial, the team had to compare conditions, define what improvement meant, and decide what evidence would count against the intervention. They also had to test whether a short-term gain concealed dependence, reduced understanding, new exclusion or a difficult handback when assistance disappeared.

The proposed study centred on diagnostic assessment, item-level telemetry, worked-example experiments, adaptive-practice trials. The design varied Primary variables: prompt style, solution visibility, problem type, expertise and observed reasoning rubric, explanation completeness, novel-problem score. Subgroup and accessibility analysis were not treated as optional additions. A result that helped an average participant while predictably harming a smaller group would not satisfy the programme's definition of success.

During the imagined pilot, the most useful moment was not a dramatic breakthrough. It was a disagreement. One participant completed the task faster but reported less control; another moved more slowly yet retained the process after support was withdrawn. Anika asked the team to record both observations without choosing a preferred ending. They were scenario prompts, not findings, and they exposed why performance alone could not carry the evaluation.

The team built recovery into the protocol. Participants could challenge a recommendation, inspect relevant reasoning, pause the intervention and resume unaided. Failure scenarios tested changed conditions and incomplete information. Delayed follow-up asked whether any advantage persisted and whether people could still act independently. This made the study less theatrical and more useful: the system had to support correction and handback, not merely produce an impressive first result.

The unknowns remained visible: Effect size, causal mechanism, subgroup variation, optimal dose, long-term persistence, transfer beyond the test context, implementation cost.. The principal risks included answer dependence, anxiety reinforcement, misleading mastery estimates, curriculum mismatch. None could be resolved by the narrative itself. They required sourced literature, approved ethics and accessibility review, a pre-registered protocol, traceable evidence and reproducible analysis.

If the hypothesis is supported, the value could extend beyond one pilot in education. Target: improve outcomes relating to mathematical reasoning while preserving agency, skill, dignity, accessibility and sustainable human capability. The same evidence could inform product requirements, assurance services, training, procurement criteria and policy guidance. If the hypothesis is not supported, that result would still be valuable by preventing a weak approach from scaling behind attractive claims.

At the closing review, Anika replaced the original programme claim with a more honest sentence: “We know what must be tested next.” Integrated assurance protocol for mathematical reasoning linking immediate performance, retained human capability, agency, wellbeing, equity, longitudinal adaptation, safe handback and recovery. For the people represented by the story, progress would not mean a system doing more. It would mean a person remaining more capable when the system stepped back.