Tags

Type your tag names separated by a space and hit enter

Classical test theory and item response theory analyses of multi-item scales assessing parents' perceptions of their children's dental care.
Med Care. 2006 Nov; 44(11 Suppl 3):S60-8.MC

Abstract

BACKGROUND

Classical test theory and item response theory methods can provide useful and potentially different insights into the performance of items in a survey designed to elicit parental perceptions of dental care delivered to children in publicly funded programs.

OBJECTIVES

We sought to illustrate the use of both classical test theory and item response theory to evaluate survey instruments.

METHODS

: Using 2 years of cross-sectional data collected from enrollees in dental plans in 2001 and 2002, we studied families with children between ages 4 to 18 who were enrolled in 1 of 5 dental plans for 12 months or longer. The 2001 survey yielded a total of 2536 usable surveys and the 2002 survey yielded 2232 useable surveys (50% and 46% response rate, respectively) for a total sample size of 4036 children who used the plan for most or all of their care.

MEASURES

The beta version of the CAHPS(R) dental care survey instrument includes 2 global rating items (dental care, dental plan) and multi-item scales assessing getting needed care, getting care quickly, communication with dental providers, office staff, and customer service.

RESULTS

Item missing data rates were low. Item-scale correlations for hypothesized scales (corrected for overlap) tended to exceed correlations of items with other scales. Classical test theory analyses identified 5 of 10 communication items that did not perform well. Internal consistency reliability estimates for the scales ranged from 0.73 to 0.86. Item response theory painted a more promising picture than classical test theory for the 2 communication items that assessed access to an interpreter when needed.

CONCLUSIONS

The beta CAHPS(R) dental survey performed well and the revised instrument is recommended for future studies. Classical test theory and item response theory can provide complementary information about survey items.

Authors+Show Affiliations

RAND Health Program, Santa Monica, California, USA. drhays@ucla.eduNo affiliation info availableNo affiliation info availableNo affiliation info availableNo affiliation info available

Pub Type(s)

Journal Article
Research Support, N.I.H., Extramural
Research Support, U.S. Gov't, P.H.S.

Language

eng

PubMed ID

17060837

Citation

Hays, Ron D., et al. "Classical Test Theory and Item Response Theory Analyses of Multi-item Scales Assessing Parents' Perceptions of Their Children's Dental Care." Medical Care, vol. 44, no. 11 Suppl 3, 2006, pp. S60-8.
Hays RD, Brown J, Brown LU, et al. Classical test theory and item response theory analyses of multi-item scales assessing parents' perceptions of their children's dental care. Med Care. 2006;44(11 Suppl 3):S60-8.
Hays, R. D., Brown, J., Brown, L. U., Spritzer, K. L., & Crall, J. J. (2006). Classical test theory and item response theory analyses of multi-item scales assessing parents' perceptions of their children's dental care. Medical Care, 44(11 Suppl 3), S60-8.
Hays RD, et al. Classical Test Theory and Item Response Theory Analyses of Multi-item Scales Assessing Parents' Perceptions of Their Children's Dental Care. Med Care. 2006;44(11 Suppl 3):S60-8. PubMed PMID: 17060837.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Classical test theory and item response theory analyses of multi-item scales assessing parents' perceptions of their children's dental care. AU - Hays,Ron D, AU - Brown,Julie, AU - Brown,Lorraine U, AU - Spritzer,Karen L, AU - Crall,James J, PY - 2006/10/25/pubmed PY - 2007/2/24/medline PY - 2006/10/25/entrez SP - S60 EP - 8 JF - Medical care JO - Med Care VL - 44 IS - 11 Suppl 3 N2 - BACKGROUND: Classical test theory and item response theory methods can provide useful and potentially different insights into the performance of items in a survey designed to elicit parental perceptions of dental care delivered to children in publicly funded programs. OBJECTIVES: We sought to illustrate the use of both classical test theory and item response theory to evaluate survey instruments. METHODS: : Using 2 years of cross-sectional data collected from enrollees in dental plans in 2001 and 2002, we studied families with children between ages 4 to 18 who were enrolled in 1 of 5 dental plans for 12 months or longer. The 2001 survey yielded a total of 2536 usable surveys and the 2002 survey yielded 2232 useable surveys (50% and 46% response rate, respectively) for a total sample size of 4036 children who used the plan for most or all of their care. MEASURES: The beta version of the CAHPS(R) dental care survey instrument includes 2 global rating items (dental care, dental plan) and multi-item scales assessing getting needed care, getting care quickly, communication with dental providers, office staff, and customer service. RESULTS: Item missing data rates were low. Item-scale correlations for hypothesized scales (corrected for overlap) tended to exceed correlations of items with other scales. Classical test theory analyses identified 5 of 10 communication items that did not perform well. Internal consistency reliability estimates for the scales ranged from 0.73 to 0.86. Item response theory painted a more promising picture than classical test theory for the 2 communication items that assessed access to an interpreter when needed. CONCLUSIONS: The beta CAHPS(R) dental survey performed well and the revised instrument is recommended for future studies. Classical test theory and item response theory can provide complementary information about survey items. SN - 0025-7079 UR - https://www.unboundmedicine.com/medline/citation/17060837/Classical_test_theory_and_item_response_theory_analyses_of_multi_item_scales_assessing_parents'_perceptions_of_their_children's_dental_care_ L2 - https://doi.org/10.1097/01.mlr.0000245144.90229.d0 DB - PRIME DP - Unbound Medicine ER -