Tags

Type your tag names separated by a space and hit enter

Development and testing for an operative competency assessment tool for nasal septoplasty surgery.
Am J Rhinol Allergy. 2014 Jul-Aug; 28(4):e163-7.AJ

Abstract

BACKGROUND

Assessing surgical competency in otolaryngology is challenging, and residency programs are now responsible for ensuring the surgical competency of their graduates. Therefore, more objective assessment tools are being incorporated into the evaluation process. Objective structured assessment of technical skills (OSATSs) tools have been developed for multiple otolaryngology procedures. These include tonsillectomy, endoscopic sinus surgery, thyroidectomy, mastoidectomy, direct laryngoscopy, and rigid bronchoscopy. The purpose of this study was to develop and test a new assessment tool for septoplasty surgery and ensuring its feasibility, reliability, and construct validity. This study was designed to develop and test a valid, reliable, and feasible evaluation tool designed to measure the development of trainees' surgical skills in the operating room for septoplasty surgery.

METHODS

A new OSATSs-based instrument form for septoplasty was developed. During the study period of 2 years, 21 otolaryngology-head and neck surgery residents (ranging from postgraduate year 2 to 5) were evaluated intraoperatively by one faculty member obtaining a total of 175 evaluations. Surgical performance was rated using a seven-item task-specific checklist (TSC) and a global rating scale (GRS). The TSC assessed specific septoplasty technical skills, and the GRS assessed the overall surgical performance.

RESULTS

Our tool showed construct validity for both components of the assessment instrument, with increasing mean scores with advancing clinical levels. Cronbach's α, a measure of internal consistency, was 0.911 for TSC and 0.898 for GRS. Strong correlation between the TSC and GRS was established (r = 0.955; p < 0.01).

CONCLUSION

This study proved our educational tool to be a valid, reliable, and feasible method for assessing competency in septoplasty surgery. It can be integrated into surgical training programs to facilitate direct formative feedback. Assessing trainees' learning curves enables insight into their progression, ensuring their appropriate development.

Links

Publisher Full Text (DOI)

Authors+Show Affiliations

Obeid AA
Department of Otolaryngology and Head and Neck Surgery, College of Medicine, King Saud University, Riyadh, Saudi Arabia.
Al-Qahtani KH
No affiliation info available
Ashraf M
No affiliation info available
Alghamdi FR
No affiliation info available
Marglani O
No affiliation info available
Alherabi A
No affiliation info available

MeSH

Clinical CompetenceEducational MeasurementHumansInternship and ResidencyNasal SeptumProspective StudiesRhinoplasty

Pub Type(s)

Journal Article

Language

eng

PubMed ID

25197910

Citation

Obeid, Amani A., et al. "Development and Testing for an Operative Competency Assessment Tool for Nasal Septoplasty Surgery." American Journal of Rhinology & Allergy, vol. 28, no. 4, 2014, pp. e163-7.
Obeid AA, Al-Qahtani KH, Ashraf M, et al. Development and testing for an operative competency assessment tool for nasal septoplasty surgery. Am J Rhinol Allergy. 2014;28(4):e163-7.
Obeid, A. A., Al-Qahtani, K. H., Ashraf, M., Alghamdi, F. R., Marglani, O., & Alherabi, A. (2014). Development and testing for an operative competency assessment tool for nasal septoplasty surgery. American Journal of Rhinology & Allergy, 28(4), e163-7. https://doi.org/10.2500/ajra.2014.28.4051
Obeid AA, et al. Development and Testing for an Operative Competency Assessment Tool for Nasal Septoplasty Surgery. Am J Rhinol Allergy. 2014 Jul-Aug;28(4):e163-7. PubMed PMID: 25197910.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Development and testing for an operative competency assessment tool for nasal septoplasty surgery. AU - Obeid,Amani A, AU - Al-Qahtani,Khalid H, AU - Ashraf,Masooda, AU - Alghamdi,Fareed R, AU - Marglani,Osama, AU - Alherabi,Ameen, PY - 2014/9/9/entrez PY - 2014/9/10/pubmed PY - 2015/6/17/medline SP - e163 EP - 7 JF - American journal of rhinology & allergy JO - Am J Rhinol Allergy VL - 28 IS - 4 N2 - BACKGROUND: Assessing surgical competency in otolaryngology is challenging, and residency programs are now responsible for ensuring the surgical competency of their graduates. Therefore, more objective assessment tools are being incorporated into the evaluation process. Objective structured assessment of technical skills (OSATSs) tools have been developed for multiple otolaryngology procedures. These include tonsillectomy, endoscopic sinus surgery, thyroidectomy, mastoidectomy, direct laryngoscopy, and rigid bronchoscopy. The purpose of this study was to develop and test a new assessment tool for septoplasty surgery and ensuring its feasibility, reliability, and construct validity. This study was designed to develop and test a valid, reliable, and feasible evaluation tool designed to measure the development of trainees' surgical skills in the operating room for septoplasty surgery. METHODS: A new OSATSs-based instrument form for septoplasty was developed. During the study period of 2 years, 21 otolaryngology-head and neck surgery residents (ranging from postgraduate year 2 to 5) were evaluated intraoperatively by one faculty member obtaining a total of 175 evaluations. Surgical performance was rated using a seven-item task-specific checklist (TSC) and a global rating scale (GRS). The TSC assessed specific septoplasty technical skills, and the GRS assessed the overall surgical performance. RESULTS: Our tool showed construct validity for both components of the assessment instrument, with increasing mean scores with advancing clinical levels. Cronbach's α, a measure of internal consistency, was 0.911 for TSC and 0.898 for GRS. Strong correlation between the TSC and GRS was established (r = 0.955; p < 0.01). CONCLUSION: This study proved our educational tool to be a valid, reliable, and feasible method for assessing competency in septoplasty surgery. It can be integrated into surgical training programs to facilitate direct formative feedback. Assessing trainees' learning curves enables insight into their progression, ensuring their appropriate development. SN - 1945-8932 UR - https://www.unboundmedicine.com/medline/citation/25197910/Development_and_testing_for_an_operative_competency_assessment_tool_for_nasal_septoplasty_surgery_ DB - PRIME DP - Unbound Medicine ER -