Human-AI Cognition & Performance / AI Assistance Calibration
SUB-0015Confidence-Aware Assistance
Definition
Confidence-Aware Assistance examines the mechanisms, conditions and outcomes through which this factor shapes human cognition, learning, collaboration or sustainable performance in AI-supported settings.
Why this matters
Confidence-Aware Assistance may materially affect human capability, independence, confidence, safety and productivity. Poorly designed assistance can create hidden costs even where short-term output appears to improve.
Research questions
How should systems respond when either human or model confidence is low, high or mismatched?
Hypotheses
Escalation based on confidence mismatch will reduce high-confidence errors more than model-confidence thresholds alone.
Proposed methods
multi-arm assistance-level experiments; longitudinal usage analysis; skill-retention tests; preference elicitation; A/B testing; pre-registered analysis; active comparison; subgroup and accessibility analysis; delayed retention or longitudinal follow-up; adverse-effect capture; reproducibility testing; participant debrief
Stakeholders and beneficiaries
end users; UX researchers; AI developers; product managers; safety teams; employers; regulators; school counsellors; learner wellbeing teams