Tags

Type your tag names separated by a space and hit enter

Unintentional failure to assess for experience in senior undergraduate OSCE scoring.
Med Educ. 2008 Jul; 42(7):669-75.ME

Abstract

CONTEXT

One goal of undergraduate assessment is to test students' (future) performance. In the area of skills testing, the objective structured clinical examination (OSCE) has been of great value as a tool with which to test a number of skills in a limited time, with bias reduction and improved reliability. But can OSCEs measure undergraduate internship expertise in basic clinical skills?

METHODS

Undergraduate students (n = 32) were given a questionnaire listing 182 basic clinical skills. We asked them to score the number of times they had performed each skill during their internships (a 12-month period in Year 6). We assessed the students at the end of Year 5 (before the start of their internships) and again at the start of Year 7 (undergraduate training takes 7 years in Belgium, with internships during Year 6), using a 14-station OSCE assessing basic clinical skills. Global ratings were used to score performance. The relationship between internship experience and the OSCE Year 7 score was analysed using a linear regression model, controlling for variation in OSCE scores from Year 5. A multi-level analysis was performed considering students as level-1 units and stations as level-2 units.

RESULTS

Year 7 OSCE scores (post-internships) were not affected by the number of times that students practised basic medical skills during their internships.

DISCUSSION

Scores on OSCEs do not seem to reflect clinical expertise acquired during internships. Other more integrated assessment methods may prove to be more valid for testing final undergraduate skills levels.

Links

Aggregator Full Text

Authors+Show Affiliations

Peeraer G
Dean's Office, Faculty of Medicine, University of Antwerp, Antwerp, Belgium. griet.peeraer@ua.ac.be
Muijtjens AM
No affiliation info available
De Winter BY
No affiliation info available
Remmen R
No affiliation info available
Hendrickx K
No affiliation info available
Bossaert L
No affiliation info available
Scherpbier AJ
No affiliation info available

MeSH

AchievementAdultBelgiumClinical CompetenceCurriculumFemaleHumansInternship and ResidencyMaleSurveys and Questionnaires

Pub Type(s)

Journal Article
Multicenter Study

Language

eng

PubMed ID

18588647

Citation

Peeraer, Griet, et al. "Unintentional Failure to Assess for Experience in Senior Undergraduate OSCE Scoring." Medical Education, vol. 42, no. 7, 2008, pp. 669-75.
Peeraer G, Muijtjens AM, De Winter BY, et al. Unintentional failure to assess for experience in senior undergraduate OSCE scoring. Med Educ. 2008;42(7):669-75.
Peeraer, G., Muijtjens, A. M., De Winter, B. Y., Remmen, R., Hendrickx, K., Bossaert, L., & Scherpbier, A. J. (2008). Unintentional failure to assess for experience in senior undergraduate OSCE scoring. Medical Education, 42(7), 669-75. https://doi.org/10.1111/j.1365-2923.2008.03043.x
Peeraer G, et al. Unintentional Failure to Assess for Experience in Senior Undergraduate OSCE Scoring. Med Educ. 2008;42(7):669-75. PubMed PMID: 18588647.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Unintentional failure to assess for experience in senior undergraduate OSCE scoring. AU - Peeraer,Griet, AU - Muijtjens,Arno M M, AU - De Winter,Benedicte Y, AU - Remmen,Roy, AU - Hendrickx,Kristin, AU - Bossaert,Leo, AU - Scherpbier,Albert J J A, PY - 2008/7/1/pubmed PY - 2008/8/16/medline PY - 2008/7/1/entrez SP - 669 EP - 75 JF - Medical education JO - Med Educ VL - 42 IS - 7 N2 - CONTEXT: One goal of undergraduate assessment is to test students' (future) performance. In the area of skills testing, the objective structured clinical examination (OSCE) has been of great value as a tool with which to test a number of skills in a limited time, with bias reduction and improved reliability. But can OSCEs measure undergraduate internship expertise in basic clinical skills? METHODS: Undergraduate students (n = 32) were given a questionnaire listing 182 basic clinical skills. We asked them to score the number of times they had performed each skill during their internships (a 12-month period in Year 6). We assessed the students at the end of Year 5 (before the start of their internships) and again at the start of Year 7 (undergraduate training takes 7 years in Belgium, with internships during Year 6), using a 14-station OSCE assessing basic clinical skills. Global ratings were used to score performance. The relationship between internship experience and the OSCE Year 7 score was analysed using a linear regression model, controlling for variation in OSCE scores from Year 5. A multi-level analysis was performed considering students as level-1 units and stations as level-2 units. RESULTS: Year 7 OSCE scores (post-internships) were not affected by the number of times that students practised basic medical skills during their internships. DISCUSSION: Scores on OSCEs do not seem to reflect clinical expertise acquired during internships. Other more integrated assessment methods may prove to be more valid for testing final undergraduate skills levels. SN - 1365-2923 UR - https://www.unboundmedicine.com/medline/citation/18588647/Unintentional_failure_to_assess_for_experience_in_senior_undergraduate_OSCE_scoring_ L2 - https://doi.org/10.1111/j.1365-2923.2008.03043.x DB - PRIME DP - Unbound Medicine ER -