The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.

Original languageEnglish (US)
Pages (from-to)202-208
Number of pages7
JournalJournal of Interprofessional Care
Issue number3
StatePublished - May 1 2015


  • Interprofessional education
  • Simulation
  • Targeted behavioral markers
  • Team Performance Observation Tool
  • Teamwork

ASJC Scopus subject areas

  • Medicine(all)


Dive into the research topics of 'Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education'. Together they form a unique fingerprint.

Cite this