Tags

Type your tag names separated by a space and hit enter

Microsurgical lab testing is a reliable method for assessing ophthalmology residents' surgical skills.
Br J Ophthalmol. 2007 Dec; 91(12):1691-4.BJ

Abstract

BACKGROUND

Formal assessment of clinical competencies is necessary to ensure that all residents are acquiring important skills and, in the United States, will soon become a requirement for residency programme accreditation by the Accreditation Council for Graduate Medical Education (ACGME). The Eye Surgical Skills Assessment Test (ESSAT), a laboratory-based surgical skills obstacle course, was developed in response to the need for improved tools for the assessment of surgical skills during residency. The ESSAT has previously been shown to have face and content validity, and in this study we sought to determine its inter-rater reliability and, to some extent, its construct validity.

METHODS

Twenty-seven content experts (residency programme directors and faculty members involved with resident surgical training) watched videos of a junior resident and senior resident completing the three ESSAT stations (skin suturing, muscle recession, and phacoemulsification: wound construction & suturing technique) and completed assessment forms, both task-specific checklists and a global rating scale of performance.

RESULTS

The ESSAT showed strong inter-rater reliability for determining whether a resident "passed" a threshold of competency at each station for both the checklists and global rating scale. In addition, for each station, the senior resident was consistently rated above a "passing" threshold using either assessment form, whereas the junior resident was more often rated below (94% vs 30% passing on completed forms).

CONCLUSION

These results, along with the findings of our face and content validity analysis, support the reliability and validity of the ESSAT, and indicate that it could be a useful tool for improving the assessment of surgical skill during residency. The ESSAT is a tool that all residency programmes could implement as a part of their ophthalmic surgical curriculum and competency assessment, and may be useful to set a threshold of competence that all residents would need to achieve prior to entering the operating room.

Authors+Show Affiliations

Department of Ophthalmology, University of California-San Francisco, CA, USA.No affiliation info availableNo affiliation info availableNo affiliation info available

Pub Type(s)

Evaluation Study
Journal Article
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

17591670

Citation

Taylor, J B., et al. "Microsurgical Lab Testing Is a Reliable Method for Assessing Ophthalmology Residents' Surgical Skills." The British Journal of Ophthalmology, vol. 91, no. 12, 2007, pp. 1691-4.
Taylor JB, Binenbaum G, Tapino P, et al. Microsurgical lab testing is a reliable method for assessing ophthalmology residents' surgical skills. Br J Ophthalmol. 2007;91(12):1691-4.
Taylor, J. B., Binenbaum, G., Tapino, P., & Volpe, N. J. (2007). Microsurgical lab testing is a reliable method for assessing ophthalmology residents' surgical skills. The British Journal of Ophthalmology, 91(12), 1691-4.
Taylor JB, et al. Microsurgical Lab Testing Is a Reliable Method for Assessing Ophthalmology Residents' Surgical Skills. Br J Ophthalmol. 2007;91(12):1691-4. PubMed PMID: 17591670.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Microsurgical lab testing is a reliable method for assessing ophthalmology residents' surgical skills. AU - Taylor,J B, AU - Binenbaum,G, AU - Tapino,P, AU - Volpe,N J, Y1 - 2007/06/25/ PY - 2007/6/27/pubmed PY - 2007/12/7/medline PY - 2007/6/27/entrez SP - 1691 EP - 4 JF - The British journal of ophthalmology JO - Br J Ophthalmol VL - 91 IS - 12 N2 - BACKGROUND: Formal assessment of clinical competencies is necessary to ensure that all residents are acquiring important skills and, in the United States, will soon become a requirement for residency programme accreditation by the Accreditation Council for Graduate Medical Education (ACGME). The Eye Surgical Skills Assessment Test (ESSAT), a laboratory-based surgical skills obstacle course, was developed in response to the need for improved tools for the assessment of surgical skills during residency. The ESSAT has previously been shown to have face and content validity, and in this study we sought to determine its inter-rater reliability and, to some extent, its construct validity. METHODS: Twenty-seven content experts (residency programme directors and faculty members involved with resident surgical training) watched videos of a junior resident and senior resident completing the three ESSAT stations (skin suturing, muscle recession, and phacoemulsification: wound construction & suturing technique) and completed assessment forms, both task-specific checklists and a global rating scale of performance. RESULTS: The ESSAT showed strong inter-rater reliability for determining whether a resident "passed" a threshold of competency at each station for both the checklists and global rating scale. In addition, for each station, the senior resident was consistently rated above a "passing" threshold using either assessment form, whereas the junior resident was more often rated below (94% vs 30% passing on completed forms). CONCLUSION: These results, along with the findings of our face and content validity analysis, support the reliability and validity of the ESSAT, and indicate that it could be a useful tool for improving the assessment of surgical skill during residency. The ESSAT is a tool that all residency programmes could implement as a part of their ophthalmic surgical curriculum and competency assessment, and may be useful to set a threshold of competence that all residents would need to achieve prior to entering the operating room. SN - 1468-2079 UR - https://www.unboundmedicine.com/medline/citation/17591670/Microsurgical_lab_testing_is_a_reliable_method_for_assessing_ophthalmology_residents'_surgical_skills_ DB - PRIME DP - Unbound Medicine ER -