TY - JOUR
T1 - Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum
AU - Mathews, Douglas R.
AU - Kunicki, Zachary J.
AU - Colby, Sarah E.
AU - Franzen-Castle, Lisa
AU - Kattelmann, Kendra K.
AU - Olfert, Melissa D.
AU - White, Adrienne A.
N1 - Funding Information:
This material is based on work that is supported by the National Institute of Food and Agriculture, US Department of Agriculture, under Award No. 2012-68001-19605. Other funding is from US Department of Agriculture Experiment Stations for the first 5 authors. The funding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. Data were taken from the dissertation of the first author. The work was done while he was a graduate student at the identified university affiliation and was part of the multistate study conducted by all authors.
Publisher Copyright:
© 2018 The Authors
PY - 2019/3
Y1 - 2019/3
N2 - Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.
AB - Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.
KW - cooking
KW - dyad interventions
KW - iCook 4-H
KW - program evaluation
KW - youth
UR - http://www.scopus.com/inward/record.url?scp=85056880082&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85056880082&partnerID=8YFLogxK
U2 - 10.1016/j.jneb.2018.10.014
DO - 10.1016/j.jneb.2018.10.014
M3 - Article
C2 - 30472311
AN - SCOPUS:85056880082
VL - 51
SP - S21-S29
JO - Journal of Nutrition Education
JF - Journal of Nutrition Education
SN - 1499-4046
IS - 3
ER -