Tags

Type your tag names separated by a space and hit enter

Standard setting with dichotomous and constructed response items: some Rasch model approaches.
J Appl Meas. 2009; 10(4):438-54.JA

Abstract

Using real data comprising responses to both dichotomously scored and constructed response items, this paper shows how Rasch modeling may be used to facilitate standard-setting. The modeling uses Andrich's Extended Logistic Model, which is incorporated into the RUMM software package. After a review of the fundamental equations of the model, an application to Bookmark standard setting is given, showing how to calculate the bookmark difficulty location (BDL) for both dichomotous items and tests containing a mixture of item types. An example showing how the bookmark is set is also discussed. The Rasch model is then applied in various ways to the Angoff standard-setting methods. In the first Angoff approach, the judges' item ratings are compared to Rasch model expected scores, allowing the judges to find items where their ratings differ significantly from the Rasch model values. In the second Angoff approach, the distribution of item ratings are converted to a distribution of possible cutscores, from which a final cutscore may be selected. In the third Angoff approach, the Rasch model provides a comprehensive information set to the judges. For every total score on the test, the model provides a column of item ratings (expected scores) for the ability associated with the total score. The judges consider each column of item ratings as a whole and select the column that best fits the expected pattern of responses of a marginal candidate. The total score corresponding to the selected column is then the performance band cutscore.

Authors+Show Affiliations

Oxford University Centre for Educational Assessment, University of Oxford, Oxford OX2 6PY, UK. victoria.hayman@education.ox.ac.uk

Pub Type(s)

Journal Article

Language

eng

PubMed ID

19934530

Citation

MacCann, Robert G.. "Standard Setting With Dichotomous and Constructed Response Items: some Rasch Model Approaches." Journal of Applied Measurement, vol. 10, no. 4, 2009, pp. 438-54.
MacCann RG. Standard setting with dichotomous and constructed response items: some Rasch model approaches. J Appl Meas. 2009;10(4):438-54.
MacCann, R. G. (2009). Standard setting with dichotomous and constructed response items: some Rasch model approaches. Journal of Applied Measurement, 10(4), 438-54.
MacCann RG. Standard Setting With Dichotomous and Constructed Response Items: some Rasch Model Approaches. J Appl Meas. 2009;10(4):438-54. PubMed PMID: 19934530.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Standard setting with dichotomous and constructed response items: some Rasch model approaches. A1 - MacCann,Robert G, PY - 2009/11/26/entrez PY - 2009/11/26/pubmed PY - 2010/1/29/medline SP - 438 EP - 54 JF - Journal of applied measurement JO - J Appl Meas VL - 10 IS - 4 N2 - Using real data comprising responses to both dichotomously scored and constructed response items, this paper shows how Rasch modeling may be used to facilitate standard-setting. The modeling uses Andrich's Extended Logistic Model, which is incorporated into the RUMM software package. After a review of the fundamental equations of the model, an application to Bookmark standard setting is given, showing how to calculate the bookmark difficulty location (BDL) for both dichomotous items and tests containing a mixture of item types. An example showing how the bookmark is set is also discussed. The Rasch model is then applied in various ways to the Angoff standard-setting methods. In the first Angoff approach, the judges' item ratings are compared to Rasch model expected scores, allowing the judges to find items where their ratings differ significantly from the Rasch model values. In the second Angoff approach, the distribution of item ratings are converted to a distribution of possible cutscores, from which a final cutscore may be selected. In the third Angoff approach, the Rasch model provides a comprehensive information set to the judges. For every total score on the test, the model provides a column of item ratings (expected scores) for the ability associated with the total score. The judges consider each column of item ratings as a whole and select the column that best fits the expected pattern of responses of a marginal candidate. The total score corresponding to the selected column is then the performance band cutscore. SN - 1529-7713 UR - https://www.unboundmedicine.com/medline/citation/19934530/Standard_setting_with_dichotomous_and_constructed_response_items:_some_Rasch_model_approaches_ DB - PRIME DP - Unbound Medicine ER -