Tags

Type your tag names separated by a space and hit enter

Resident evaluations: the use of daily evaluation forms in rheumatology ambulatory care.
J Rheumatol. 2009 Jun; 36(6):1298-303.JR

Abstract

OBJECTIVE

The in-training evaluation report (ITER) is widely used to assess clinical skills, but has limited validity and reliability. The purpose of our study was to assess the feasibility, validity, reliability, and effect on feedback of using daily evaluation forms to evaluate residents in ambulatory rheumatology clinics.

METHODS

An evaluation form was developed based on the Royal College of Physicians and Surgeons of Canada CanMEDS roles. There were 12 evaluation items including overall clinical competence. They were rated on a 5-point scale from unsatisfactory to outstanding. All internal medicine residents rotating on rheumatology were strongly encouraged to provide the form to their preceptor at the end of each clinic. A questionnaire was administered to residents and faculty.

RESULTS

Seventy-three internal medicine residents completed a 1-month rotation at University of Ottawa (n=26) and McMaster University (n=47). Faculty members completed a total of 637 evaluation forms. The number of evaluation forms ranged from 2 to 16 (mean 8.73) per resident. At an average of 8.73 forms per resident the reliability was 0.71 for the composite score. Fourteen forms would be required for a reliability of 0.8. The correlation between the objective structured clinical examination scores and the forms was 0.48 (p=not significant). Faculty and residents reported increased feedback following implementation of the forms.

CONCLUSION

The use of daily evaluation forms is feasible and provides very good reliability. Use of the evaluation forms increases feedback to residents on their performance. The forms were well received by faculty and residents.

Links

Publisher Full Text (DOI)

Authors+Show Affiliations

Humphrey-Murto S
Faculty of Medicine, University of Ottawa, The Ottawa Hospital-Riverside Campus, 1967 Riverside Drive, Box 37, Ottawa, Ontario K1H 7W9, Canada. shumphrey@ottawahospital.on.ca
Khalidi N
No affiliation info available
Smith CD
No affiliation info available
Kaminska E
No affiliation info available
Touchie C
No affiliation info available
Keely E
No affiliation info available
Wood TJ
No affiliation info available

MeSH

Ambulatory CareAmbulatory Care FacilitiesClinical CompetenceEducation, Medical, GraduateEducational MeasurementFeedbackHumansInternship and ResidencyMedical RecordsQuality of Health CareReproducibility of ResultsRheumatology

Pub Type(s)

Journal Article
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

19332624

Citation

Humphrey-Murto, Susan, et al. "Resident Evaluations: the Use of Daily Evaluation Forms in Rheumatology Ambulatory Care." The Journal of Rheumatology, vol. 36, no. 6, 2009, pp. 1298-303.
Humphrey-Murto S, Khalidi N, Smith CD, et al. Resident evaluations: the use of daily evaluation forms in rheumatology ambulatory care. J Rheumatol. 2009;36(6):1298-303.
Humphrey-Murto, S., Khalidi, N., Smith, C. D., Kaminska, E., Touchie, C., Keely, E., & Wood, T. J. (2009). Resident evaluations: the use of daily evaluation forms in rheumatology ambulatory care. The Journal of Rheumatology, 36(6), 1298-303. https://doi.org/10.3899/jrheum.080951
Humphrey-Murto S, et al. Resident Evaluations: the Use of Daily Evaluation Forms in Rheumatology Ambulatory Care. J Rheumatol. 2009;36(6):1298-303. PubMed PMID: 19332624.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Resident evaluations: the use of daily evaluation forms in rheumatology ambulatory care. AU - Humphrey-Murto,Susan, AU - Khalidi,Nader, AU - Smith,C Douglas, AU - Kaminska,Elzbieta, AU - Touchie,Claire, AU - Keely,Erin, AU - Wood,Timothy J, Y1 - 2009/03/30/ PY - 2009/4/1/entrez PY - 2009/4/1/pubmed PY - 2009/8/6/medline SP - 1298 EP - 303 JF - The Journal of rheumatology JO - J Rheumatol VL - 36 IS - 6 N2 - OBJECTIVE: The in-training evaluation report (ITER) is widely used to assess clinical skills, but has limited validity and reliability. The purpose of our study was to assess the feasibility, validity, reliability, and effect on feedback of using daily evaluation forms to evaluate residents in ambulatory rheumatology clinics. METHODS: An evaluation form was developed based on the Royal College of Physicians and Surgeons of Canada CanMEDS roles. There were 12 evaluation items including overall clinical competence. They were rated on a 5-point scale from unsatisfactory to outstanding. All internal medicine residents rotating on rheumatology were strongly encouraged to provide the form to their preceptor at the end of each clinic. A questionnaire was administered to residents and faculty. RESULTS: Seventy-three internal medicine residents completed a 1-month rotation at University of Ottawa (n=26) and McMaster University (n=47). Faculty members completed a total of 637 evaluation forms. The number of evaluation forms ranged from 2 to 16 (mean 8.73) per resident. At an average of 8.73 forms per resident the reliability was 0.71 for the composite score. Fourteen forms would be required for a reliability of 0.8. The correlation between the objective structured clinical examination scores and the forms was 0.48 (p=not significant). Faculty and residents reported increased feedback following implementation of the forms. CONCLUSION: The use of daily evaluation forms is feasible and provides very good reliability. Use of the evaluation forms increases feedback to residents on their performance. The forms were well received by faculty and residents. SN - 0315-162X UR - https://www.unboundmedicine.com/medline/citation/19332624/Resident_evaluations:_the_use_of_daily_evaluation_forms_in_rheumatology_ambulatory_care_ DB - PRIME DP - Unbound Medicine ER -