-
Patient Simulation: A Literary Synthesis of Assessment Tools in Anesthesiology
-
Alice A. Edler, Ruth G. Fanning, Michael. I. Chen, Rebecca Claure, Dondee Almazan, Brain Struyk, Samuel C. Seiden
-
J Educ Eval Health Prof. 2009;6:3. Published online December 20, 2009
-
DOI: https://doi.org/10.3352/jeehp.2009.6.3
-
-
39,794
View
-
178
Download
-
14
Crossref
-
Abstract
PDF
- High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included ?占퐉odified Delphi Techniques??for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.
-
Citations
Citations to this article as recorded by
- Simulation-based summative assessment in healthcare: an overview of key principles for practice
Clément Buléon, Laurent Mattatia, Rebecca D. Minehart, Jenny W. Rudolph, Fernande J. Lois, Erwan Guillouet, Anne-Laure Philippon, Olivier Brissaud, Antoine Lefevre-Scelles, Dan Benhamou, François Lecomte, the SoFraSimS Assessment with simul group, Anne Be Advances in Simulation.2022;[Epub] CrossRef - Computer-Based Case Simulations for Assessment in Health Care: A Literature Review of Validity Evidence
Robyn C. Ward, Timothy J. Muckle, Michael J. Kremer, Mary Anne Krogh Evaluation & the Health Professions.2019; 42(1): 82. CrossRef - Competence Assessment Instruments in Perianesthesia Nursing Care: A Scoping Review of the Literature
Yunsuk Jeon, Riitta-Liisa Lakanmaa, Riitta Meretoja, Helena Leino-Kilpi Journal of PeriAnesthesia Nursing.2017; 32(6): 542. CrossRef - Training and Competency in Sedation Practice in Gastrointestinal Endoscopy
Ben Da, James Buxbaum Gastrointestinal Endoscopy Clinics of North America.2016; 26(3): 443. CrossRef - Linking Simulation-Based Educational Assessments and Patient-Related Outcomes
Ryan Brydges, Rose Hatala, Benjamin Zendejas, Patricia J. Erwin, David A. Cook Academic Medicine.2015; 90(2): 246. CrossRef - Simulation With PARTS (Phase-Augmented Research and Training Scenarios)
Carl J. Schick, Mona Weiss, Michaela Kolbe, Adrian Marty, Micha Dambach, Axel Knauth, Donat R. Spahn, Gudela Grote, Bastian Grande Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2015; 10(3): 178. CrossRef - Endoscopy nurse-administered propofol sedation performance. Development of an assessment tool and a reliability testing model
Jeppe Thue Jensen, Lars Konge, Ann Møller, Pernille Hornslet, Peter Vilmann Scandinavian Journal of Gastroenterology.2014; 49(8): 1014. CrossRef - Exploration of Specialty Certification for Nurse Anesthetists: Nonsurgical Pain Management as a Test Case
Steven Wooden, Sharron Docherty, Karen Plaus, Anthony Kusek, Charles Vacchiano Pain Management Nursing.2014; 15(4): 789. CrossRef - What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment
David A. Cook, Benjamin Zendejas, Stanley J. Hamstra, Rose Hatala, Ryan Brydges Advances in Health Sciences Education.2014; 19(2): 233. CrossRef - Technology-Enhanced Simulation to Assess Health Professionals
David A. Cook, Ryan Brydges, Benjamin Zendejas, Stanley J. Hamstra, Rose Hatala Academic Medicine.2013; 88(6): 872. CrossRef - Review article: Assessment in anesthesiology education
John R. Boulet, David Murray Canadian Journal of Anesthesia/Journal canadien d'anesthésie.2012; 59(2): 182. CrossRef - Review article: Simulation in anesthesia: state of the science and looking forward
Vicki R. LeBlanc Canadian Journal of Anesthesia/Journal canadien d'anesthésie.2012; 59(2): 193. CrossRef - Simulation and Quality Improvement in Anesthesiology
Christine S. Park Anesthesiology Clinics.2011; 29(1): 13. CrossRef - Performance in assessment: Consensus statement and recommendations from the Ottawa conference
Katharine Boursicot, Luci Etheridge, Zeryab Setna, Alison Sturrock, Jean Ker, Sydney Smee, Elango Sambandam Medical Teacher.2011; 33(5): 370. CrossRef
|