Tags

Type your tag names separated by a space and hit enter

Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students.
Arthritis Rheum. 2007 Jun 15; 57(5):869-76.AR

Abstract

OBJECTIVE

Objective structured clinical examination (OSCE) is a key part of medical student assessment. Currently, assessment is performed by medical examiners in situ. Our objective was to determine whether assessment by videotaped OSCE is as reliable as live OSCE assessment.

METHODS

Participants were 95 undergraduate medical students attending their musculoskeletal week at Freeman Hospital, Newcastle (UK). Student performance on OSCE stations for shoulder or knee examinations was assessed by experienced rheumatologists. The stations were also videotaped and scored by a rheumatologist independently. The examinations consisted of a 14-item checklist and a global rating scale (GRS).

RESULTS

Mean values for the shoulder OSCE checklist were 17.9 by live assessment and 17.4 by video (n = 50), and 20.9 and 20.0 for live and video knee assessment, respectively (n = 45). Intraclass correlation coefficients for shoulder and knee checklists were 0.55 and 0.58, respectively, indicating moderate reliability between live and video scores for the OSCE checklists. GRS scores were less reliable than checklist scores. There was 84% agreement in the classification of examination grades between live and video checklist scores for the shoulder and 87% agreement for the knee (kappa = 0.43 and 0.51, respectively; P < 0.001).

CONCLUSION

Video OSCE has the potential to be reliable and offers some advantages over live OSCE including more efficient use of examiners' time, increased fairness, and better monitoring of standards across various schools/sites. However, further work is needed to support our findings and to implement and evaluate the quality assurance issues identified in this work before justifiable recommendations can be made.

Links

Aggregator Full Text

Authors+Show Affiliations

Vivekananda-Schmidt P
Primary Care Sciences Research Centre, Keele University, Keele, North Staffordshire, UK. p.vivekananda-schmidt@shef.ac.uk
Lewis M
No affiliation info available
Coady D
No affiliation info available
Morley C
No affiliation info available
Kay L
No affiliation info available
Walker D
No affiliation info available
Hassell AB
No affiliation info available

MeSH

Audiovisual AidsCurriculumDiagnostic Techniques and ProceduresEducation, Medical, UndergraduateEducational TechnologyHumansKnee JointMusculoskeletal DiseasesPhysical ExaminationShoulder JointVideotape Recording

Pub Type(s)

Journal Article
Randomized Controlled Trial
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

17530689

Citation

Vivekananda-Schmidt, Pirashanthie, et al. "Exploring the Use of Videotaped Objective Structured Clinical Examination in the Assessment of Joint Examination Skills of Medical Students." Arthritis and Rheumatism, vol. 57, no. 5, 2007, pp. 869-76.
Vivekananda-Schmidt P, Lewis M, Coady D, et al. Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis Rheum. 2007;57(5):869-76.
Vivekananda-Schmidt, P., Lewis, M., Coady, D., Morley, C., Kay, L., Walker, D., & Hassell, A. B. (2007). Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis and Rheumatism, 57(5), 869-76.
Vivekananda-Schmidt P, et al. Exploring the Use of Videotaped Objective Structured Clinical Examination in the Assessment of Joint Examination Skills of Medical Students. Arthritis Rheum. 2007 Jun 15;57(5):869-76. PubMed PMID: 17530689.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. AU - Vivekananda-Schmidt,Pirashanthie, AU - Lewis,Martyn, AU - Coady,David, AU - Morley,Catherine, AU - Kay,Lesley, AU - Walker,David, AU - Hassell,Andrew B, PY - 2007/5/29/pubmed PY - 2007/7/11/medline PY - 2007/5/29/entrez SP - 869 EP - 76 JF - Arthritis and rheumatism JO - Arthritis Rheum VL - 57 IS - 5 N2 - OBJECTIVE: Objective structured clinical examination (OSCE) is a key part of medical student assessment. Currently, assessment is performed by medical examiners in situ. Our objective was to determine whether assessment by videotaped OSCE is as reliable as live OSCE assessment. METHODS: Participants were 95 undergraduate medical students attending their musculoskeletal week at Freeman Hospital, Newcastle (UK). Student performance on OSCE stations for shoulder or knee examinations was assessed by experienced rheumatologists. The stations were also videotaped and scored by a rheumatologist independently. The examinations consisted of a 14-item checklist and a global rating scale (GRS). RESULTS: Mean values for the shoulder OSCE checklist were 17.9 by live assessment and 17.4 by video (n = 50), and 20.9 and 20.0 for live and video knee assessment, respectively (n = 45). Intraclass correlation coefficients for shoulder and knee checklists were 0.55 and 0.58, respectively, indicating moderate reliability between live and video scores for the OSCE checklists. GRS scores were less reliable than checklist scores. There was 84% agreement in the classification of examination grades between live and video checklist scores for the shoulder and 87% agreement for the knee (kappa = 0.43 and 0.51, respectively; P < 0.001). CONCLUSION: Video OSCE has the potential to be reliable and offers some advantages over live OSCE including more efficient use of examiners' time, increased fairness, and better monitoring of standards across various schools/sites. However, further work is needed to support our findings and to implement and evaluate the quality assurance issues identified in this work before justifiable recommendations can be made. SN - 0004-3591 UR - https://www.unboundmedicine.com/medline/citation/17530689/Exploring_the_use_of_videotaped_objective_structured_clinical_examination_in_the_assessment_of_joint_examination_skills_of_medical_students_ L2 - https://doi.org/10.1002/art.22763 DB - PRIME DP - Unbound Medicine ER -