TY - JOUR
T1 - Development of a self-rated mixed methods skills assessment
T2 - The national institutes of health mixed methods research training program for the health sciences
AU - Guetterman, Timothy C.
AU - Creswell, John W.
AU - Wittink, Marsha
AU - Barg, Fran K.
AU - Castro, Felipe G.
AU - Dahlberg, Britt
AU - Watkins, Daphne C.
AU - Deutsch, Charles
AU - Gallo, Joseph J.
N1 - Publisher Copyright:
© 2017 The Alliance for Continuing Education in the Health Professions, the Association for Hospital Medical Education.
PY - 2017/3/1
Y1 - 2017/3/1
N2 - Introduction: Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: “Research question,” “Design/approach,” “Sampling,” “Data collection,” “Analysis,” and “Dissemination.” Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. Methods: We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness. Results: Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains. Discussion: This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.
AB - Introduction: Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: “Research question,” “Design/approach,” “Sampling,” “Data collection,” “Analysis,” and “Dissemination.” Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. Methods: We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness. Results: Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains. Discussion: This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.
KW - Faculty development
KW - Mixed methods research
KW - Mixed methods research
KW - Outcomes assessment
KW - Outcomes/impact assessment
KW - Professional development
KW - Research training
KW - Self-assessment
KW - Survey methodology
KW - Workforce development/issues
UR - http://www.scopus.com/inward/record.url?scp=85021097176&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85021097176&partnerID=8YFLogxK
U2 - 10.1097/CEH.0000000000000152
DO - 10.1097/CEH.0000000000000152
M3 - Article
C2 - 28562495
AN - SCOPUS:85021097176
SN - 0894-1912
VL - 37
SP - 76
EP - 82
JO - Journal of Continuing Education in the Health Professions
JF - Journal of Continuing Education in the Health Professions
IS - 2
ER -