TY - JOUR
T1 - Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education
AU - Zhang, Chao
AU - Miller, Connie
AU - Volkman, Kathleen
AU - Meza, Jane
AU - Jones, Katherine
PY - 2015/5/1
Y1 - 2015/5/1
N2 - The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.
AB - The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.
KW - Interprofessional education
KW - Simulation
KW - Targeted behavioral markers
KW - Team Performance Observation Tool
KW - Teamwork
UR - http://www.scopus.com/inward/record.url?scp=84928603538&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84928603538&partnerID=8YFLogxK
U2 - 10.3109/13561820.2014.982789
DO - 10.3109/13561820.2014.982789
M3 - Article
C2 - 25421454
AN - SCOPUS:84928603538
VL - 29
SP - 202
EP - 208
JO - Journal of Interprofessional Care
JF - Journal of Interprofessional Care
SN - 1356-1820
IS - 3
ER -