TY - JOUR
T1 - Assessing Confidence and Certainty of Students in an Undergraduate Linear Algebra Course
AU - Preheim, Michael
AU - Dorfmeister, Josef
AU - Snow, Ethan
N1 - Publisher Copyright:
© 2022, The Author(s).
PY - 2023/4
Y1 - 2023/4
N2 - Knowledge assessments in undergraduate STEM education commonly evaluate response correctness to determine learner proficiency. However, simultaneous evaluation of learner metacognition more accurately assesses the multiple dimensions of knowledge and has been shown to increase assessment validity and reliability. Motivation for researching these multidimensional methods has primarily been to identify guesswork and misinformation by evaluating the alignment of response correctness with the learner’s certainty that their provided response is correct. Learner confidence before assessment, however, has not been thoroughly investigated either alone or in conjunction with certainty for use in performance evaluation, especially at the undergraduate level. The objective of this study is to investigate the efficacy for assessing pre-assessment confidence and post-response certainty in relation to response correctness for students in an undergraduate linear algebra course. Due to the subjective nature of self-reflection, certainty was found to be more aligned with correctness than confidence. Though confidence and certainty levels were reported with similar overall averages, 32% of students demonstrated misaligned confidence and certainty. This study demonstrates the usefulness of a novel assessment method and presents insights that may inform teaching methods, improve examination structure, and identify concerning student behaviors early for corrective intervention.
AB - Knowledge assessments in undergraduate STEM education commonly evaluate response correctness to determine learner proficiency. However, simultaneous evaluation of learner metacognition more accurately assesses the multiple dimensions of knowledge and has been shown to increase assessment validity and reliability. Motivation for researching these multidimensional methods has primarily been to identify guesswork and misinformation by evaluating the alignment of response correctness with the learner’s certainty that their provided response is correct. Learner confidence before assessment, however, has not been thoroughly investigated either alone or in conjunction with certainty for use in performance evaluation, especially at the undergraduate level. The objective of this study is to investigate the efficacy for assessing pre-assessment confidence and post-response certainty in relation to response correctness for students in an undergraduate linear algebra course. Due to the subjective nature of self-reflection, certainty was found to be more aligned with correctness than confidence. Though confidence and certainty levels were reported with similar overall averages, 32% of students demonstrated misaligned confidence and certainty. This study demonstrates the usefulness of a novel assessment method and presents insights that may inform teaching methods, improve examination structure, and identify concerning student behaviors early for corrective intervention.
KW - Confidence and certainty
KW - Knowledge assessment
KW - Mathematics education
KW - Metacognition
KW - STEM education
KW - Undergraduate linear algebra
UR - http://www.scopus.com/inward/record.url?scp=85152565872&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85152565872&partnerID=8YFLogxK
U2 - 10.1007/s41979-022-00082-6
DO - 10.1007/s41979-022-00082-6
M3 - Article
AN - SCOPUS:85152565872
SN - 2520-8705
VL - 6
SP - 159
EP - 180
JO - Journal for STEM Education Research
JF - Journal for STEM Education Research
IS - 1
ER -