Review article| Volume 216, P184-191, September 2017

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools


      Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


        • Siassakos D.
        • Fox R.
        • Bristowe K.
        • Angouri J.
        • Hambly H.
        • Robson L.
        • et al.
        What makes maternity teams effective and safe? Lessons from a series of research on teamwork, leadership and team training.
        Acta Obstet Gynecol Scand. 2013; 92: 1239-1243
        • Gordon M.
        • Baker P.
        • Catchpole K.
        • Darbyshire D.
        • Schocken D.
        Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: a modified delphi study.
        Med Teach. 2015; 37: 572-577
        • Martijn L.
        • Jacobs A.
        • Amelink-Verburg M.
        • Wentzel R.
        • Buitendijk S.
        • Wensing M.
        Adverse outcomes in maternity care for women with a low risk profile in the netherlands: a case series analysis.
        BMC Pregnancy Childbirth. 2013; 13: 219
        • Confidential Enquiry into Maternal Deaths in the United Kingdom (CMACE)
        Saving mothers' lives: reviewing maternal deaths to make motherhood safer: 2006–2008. the eight report.
        BJOG. 2011; 118: 1-203
        • Siassakos D.
        • Bristowe K.
        • Draycott T.J.
        • Angouri J.
        • Hambly H.
        • Winter C.
        • et al.
        Clinical efficiency in a simulated emergency and relationship to team behaviours: a multisite cross-sectional study.
        BJOG. 2011; 118: 596-607
        • Fransen A.F.
        • van de Ven J.
        • Merién A.E.
        • de Wit-Zuurendonk L.
        • Houterman S.
        • Mol B.W.
        • et al.
        Effect of obstetric team training on team performance and medical technical skills: a randomised controlled trial.
        BJOG. 2012; 119: 1387-1393
        • Boet S.
        • Bould M.D.
        • Fung L.
        • Qosa H.
        • Perrier L.
        • Tavares W.
        • et al.
        Transfer of learning and patient outcome in simulated crisis resource management: a systematic review.
        Can J Anaesth. 2014; 61: 571-581
        • Cook D.A.
        • Hatala R.
        • Brydges R.
        • Zendejas B.
        • Szostek J.H.
        • Wang A.T.
        • et al.
        Technology-enhanced simulation for health professions education: a systematic review and meta-analysis.
        JAMA. 2011; 306: 978-988
        • Ericsson K.A.
        Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.
        Acad Med. 2004; 79: S70-81
        • McGaghie W.C.
        • Issenberg S.B.
        • Cohen E.R.
        • Barsuk J.H.
        • Wayne D.B.
        Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence.
        Acad Med. 2011; 86: 706-711
        • Bahl R.
        • Murphy D.J.
        • Strachan B.
        Non-technical skills for obstetricians conducting forceps and vacuum deliveries: qualitative analysis by interviews and video recordings.
        Eur J Obstet Gynecol Reprod Biol. 2010; 150: 147-151
        • Swing S.R.
        • Clyman S.G.
        • Holmboe E.S.
        • Williams R.G.
        Advancing resident assessment in graduate medical education.
        J Grad Med Educ. 2009; 1: 278-286
        • van der Vleuten C.P.
        • Schuwirth L.W.
        Assessing professional competence: from methods to programmes.
        Med Educ. 2005; 39: 309-317
        • Fletcher G.C.
        • McGeorge P.
        • Flin R.H.
        • Glavin R.J.
        • Maran N.J.
        The role of non-technical skills in anaesthesia: a review of current literature.
        Br J Anaesth. 2002; 88: 418-429
      1. OCEBM Levels of Evidence Working Group*. The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine. (Last accessed 14.06.2017).

        • Balki M.
        • Cooke M.E.
        • Dunington S.
        • Salman A.
        • Goldszmidt E.
        Unanticipated difficult airway in obstetric patients: development of a new algorithm for formative assessment in high-fidelity simulation.
        Anesthesiology. 2012; 117: 883-897
        • Kim J.
        • Neilipovitz D.
        • Cardinal P.
        • Chiu M.
        A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as CRM simulator study IB).
        Simul Healthc. 2009; 4: 6-16
        • Rovamo L.
        • Mattila M.M.
        • Andersson S.
        • Rosenberg P.
        Assessment of newborn resuscitation skills of physicians with a simulator manikin.
        Arch Dis Child Fetal Neonatal Ed. 2011; 96: F383-F389
        • Guise J.M.
        • Deering S.H.
        • Kanki B.G.
        • Osterweil P.
        • Li H.
        • Mori M.
        • et al.
        P. Osterweil, H. Li, M. Mori, et al., Validation of a tool to measure and promote clinical teamwork.
        Simul Healthc. 2008; 3: 217-223
        • Morgan P.J.
        • Pittini R.
        • Regehr G.
        • Marrs C.
        • Haley M.F.
        Evaluating teamwork in a simulated obstetric environment.
        Anesthesiology. 2007; 106: 907-915
        • Morgan P.J.
        • Tregunno D.
        • Pittini R.
        • Tarshis J.
        • Regehr G.
        • Desousa S.
        • et al.
        Determination of the psychometric properties of a behavioural marking system for obstetrical team training using high-fidelity simulationBMJ Qual Saf2120127882.
        BMJ Qual Saf. 2012; 21: 78-82
        • Tregunno D.
        • Pittini R.
        • Haley M.
        • Morgan P.J.
        Development and usability of a behavioural marking system for performance assessment of obstetrical teams.
        Qual Saf Health Care. 2009; 18: 393-396
        • Weller J.
        • Frengley R.
        • Torrie J.
        • Shulruf B.
        • Jolly B.
        • Hopley L.
        • et al.
        Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams.
        BMJ Qual Saf. 2011; 20: 216-222
        • Downing S.M.
        Reliability: on the reproducibility of assessment data.
        Med Educ. 2004; 38: 1006-1012
        • Rehim S.A.
        • DeMoor S.
        • Olmsted R.
        • Dent D.L.
        • Parker-Raley J.
        Tools for assessment of communication skills of hospital action teams: a systematic review.
        J Surg Educ. 2016; 74: 341-351
        • Cooper S.
        • Cant R.
        • Porter J.
        • Sellick K.
        • Somers G.
        • Kinsman L.
        • et al.
        Rating medical emergency teamwork performance: development of the team emergency assessment measure (TEAM).
        Resuscitation. 2010; 81: 446-452
        • Steinemann S.
        • Berg B.
        • DiTullio A.
        • Skinner A.
        • Terada K.
        • Anzelon K.
        • et al.
        Assessing teamwork in the trauma bay: introduction of a modified NOTECHS scale for trauma.
        Am J Surg. 2012; 203: 69-75
        • Reid J.
        • Stone K.
        • Brown J.
        • Caglar D.
        • Kobayashi A.
        • Lewis-Newby M.
        • et al.
        The simulation team assessment tool (STAT): Development, reliability and validation.
        Resuscitation. 2012; 83: 879-886
        • Frankel A.
        • Gardner R.
        • Maynard L.
        • Kelly A.
        Using the communication and teamwork skills (CATS) assessment to measure health care team performance.
        Jt Comm J Qual Patient Saf. 2007; 33: 549-558
        • Healey A.N.
        • Undre S.
        • Vincent C.A.
        Developing observational measures of performance in surgical teams.
        Qual Saf Health Care. 2004; 13: i33-40