Abstract
Teamwork performance is an essential component for the clinical efficiency of multi-professional
teams in obstetric care. As patient safety is related to teamwork performance, it
has become an important learning goal in simulation-based education. In order to improve
teamwork performance, reliable assessment tools are required. These can be used to
provide feedback during training courses, or to compare learning effects between different
types of training courses. The aim of the current study is to (1) identify the available
assessment tools to evaluate obstetric teamwork performance in a simulated environment,
and (2) evaluate their psychometric properties in order to identify the most valuable
tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to
identify articles describing assessment tools for the evaluation of obstetric teamwork
performance in a simulated environment. In order to evaluate the quality of the identified
assessment tools the standards and grading rules have been applied as recommended
by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational
Outcomes. The included studies were also assessed according to the Oxford Centre for
Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion
of five articles describing the following six tools: Clinical Teamwork Scale, Human
Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance,
Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool.
Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools.
Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and
a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive
validation, and the Teamwork Measurement Tool demonstrated promising results, however
it is recommended to further investigate its reliability.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to European Journal of Obstetrics and Gynecology and Reproductive BiologyAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- What makes maternity teams effective and safe? Lessons from a series of research on teamwork, leadership and team training.Acta Obstet Gynecol Scand. 2013; 92: 1239-1243
- Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: a modified delphi study.Med Teach. 2015; 37: 572-577
- Adverse outcomes in maternity care for women with a low risk profile in the netherlands: a case series analysis.BMC Pregnancy Childbirth. 2013; 13: 219
- Saving mothers' lives: reviewing maternal deaths to make motherhood safer: 2006–2008. the eight report.BJOG. 2011; 118: 1-203
- Clinical efficiency in a simulated emergency and relationship to team behaviours: a multisite cross-sectional study.BJOG. 2011; 118: 596-607
- Effect of obstetric team training on team performance and medical technical skills: a randomised controlled trial.BJOG. 2012; 119: 1387-1393
- Transfer of learning and patient outcome in simulated crisis resource management: a systematic review.Can J Anaesth. 2014; 61: 571-581
- Technology-enhanced simulation for health professions education: a systematic review and meta-analysis.JAMA. 2011; 306: 978-988
- Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains.Acad Med. 2004; 79: S70-81
- Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence.Acad Med. 2011; 86: 706-711
- Non-technical skills for obstetricians conducting forceps and vacuum deliveries: qualitative analysis by interviews and video recordings.Eur J Obstet Gynecol Reprod Biol. 2010; 150: 147-151
- Advancing resident assessment in graduate medical education.J Grad Med Educ. 2009; 1: 278-286
- Assessing professional competence: from methods to programmes.Med Educ. 2005; 39: 309-317
- The role of non-technical skills in anaesthesia: a review of current literature.Br J Anaesth. 2002; 88: 418-429
OCEBM Levels of Evidence Working Group*. The Oxford 2011 Levels of Evidence. Oxford Centre for Evidence-Based Medicine. http://www.cebm.net/index.aspx?o=5653 (Last accessed 14.06.2017).
- Unanticipated difficult airway in obstetric patients: development of a new algorithm for formative assessment in high-fidelity simulation.Anesthesiology. 2012; 117: 883-897
- A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as CRM simulator study IB).Simul Healthc. 2009; 4: 6-16
- Assessment of newborn resuscitation skills of physicians with a simulator manikin.Arch Dis Child Fetal Neonatal Ed. 2011; 96: F383-F389
- P. Osterweil, H. Li, M. Mori, et al., Validation of a tool to measure and promote clinical teamwork.Simul Healthc. 2008; 3: 217-223
- Evaluating teamwork in a simulated obstetric environment.Anesthesiology. 2007; 106: 907-915
- Determination of the psychometric properties of a behavioural marking system for obstetrical team training using high-fidelity simulationBMJ Qual Saf2120127882.BMJ Qual Saf. 2012; 21: 78-82
- Development and usability of a behavioural marking system for performance assessment of obstetrical teams.Qual Saf Health Care. 2009; 18: 393-396
- Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams.BMJ Qual Saf. 2011; 20: 216-222
- Reliability: on the reproducibility of assessment data.Med Educ. 2004; 38: 1006-1012
- Tools for assessment of communication skills of hospital action teams: a systematic review.J Surg Educ. 2016; 74: 341-351
- Rating medical emergency teamwork performance: development of the team emergency assessment measure (TEAM).Resuscitation. 2010; 81: 446-452
- Assessing teamwork in the trauma bay: introduction of a modified NOTECHS scale for trauma.Am J Surg. 2012; 203: 69-75
- The simulation team assessment tool (STAT): Development, reliability and validation.Resuscitation. 2012; 83: 879-886
- Using the communication and teamwork skills (CATS) assessment to measure health care team performance.Jt Comm J Qual Patient Saf. 2007; 33: 549-558
- Developing observational measures of performance in surgical teams.Qual Saf Health Care. 2004; 13: i33-40
Article info
Publication history
Published online: July 01, 2017
Accepted:
June 23,
2017
Received in revised form:
June 15,
2017
Received:
December 2,
2016
Identification
Copyright
© 2017 Published by Elsevier Ireland Ltd.
