Use of modified OSCEs to verify technical skill performance and competency of lay caregivers

Background. The demands on lay caregivers of blood and marrow stem-cell transplant recipients are complex. Effective caregiver education that clearly delineates and demonstrates what needs to be learned is needed, as well as a method to evaluate caregiver's skill-based competencies. Method. A pilot study was conducted to determine the feasibility of adapting objective structured clinical examinations (OSCEs) for teaching and evaluation in lay caregiver educational programs. A modified OSCE, a performance-based assessment process, with seven practice stations for the care of tunneled central lines was developed and tested with 13 laypersons. Inter-rater techniques were used to establish accuracy and reproducibility of the examination. Results. Reproducibility of station scenarios and accuracy in performance evaluation were supported by an overall kappa coefficient of 0.94, indicating excellent agreement. Participants' overall mean performance scores were 80% for knowledge and 94% for skills. Conclusion. The use of modified OSCEs for teaching and evaluating lay caregivers' competencies for complex care demands is feasible, accurate, and warrants further investigation.