Tags

Type your tag names separated by a space and hit enter

Analyzing components of work samples to evaluate performance.
Mil Psychol. 1996; 8(3):161-77.MP

Abstract

A method is described in which work sample data were analyzed to reveal how aircraft maintenance technicians differed in troubleshooting performance after a training intervention. During the training phase of the study, approximately half the technicians received troubleshooting instruction from an intelligent tutoring system, and the remaining technicians received informal on-the-job training. Data from work samples, in which technicians verbally isolated simulated equipment failures, were collected from both groups before and after the training. The work sample data were then examined by subject matter experts who scored performance for overall proficiency and noted specific violations of good troubleshooting practice. These violations provided the basis for the components of performance examined in the work sample data. The results of this componential analysis allow more specific conclusions to be drawn regarding the effectiveness of the training intervention by revealing how the tutoring system improved technicians' troubleshooting (e.g., tutored technicians were more likely than untutored technicians to test components thoroughly to ensure they were faulty before replacing them).

Authors+Show Affiliations

Armstrong Laboratory, Human Resources Directorate, Brooks Air Force Base, Texas, USA.No affiliation info availableNo affiliation info availableNo affiliation info available

Pub Type(s)

Journal Article

Language

eng

PubMed ID

11540406

Citation

Pokorny, R A., et al. "Analyzing Components of Work Samples to Evaluate Performance." Military Psychology : the Official Journal of the Division of Military Psychology, American Psychological Association, vol. 8, no. 3, 1996, pp. 161-77.
Pokorny RA, Hall EP, Gallaway MA, et al. Analyzing components of work samples to evaluate performance. Mil Psychol. 1996;8(3):161-77.
Pokorny, R. A., Hall, E. P., Gallaway, M. A., & Dibble, E. (1996). Analyzing components of work samples to evaluate performance. Military Psychology : the Official Journal of the Division of Military Psychology, American Psychological Association, 8(3), 161-77.
Pokorny RA, et al. Analyzing Components of Work Samples to Evaluate Performance. Mil Psychol. 1996;8(3):161-77. PubMed PMID: 11540406.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Analyzing components of work samples to evaluate performance. AU - Pokorny,R A, AU - Hall,E P, AU - Gallaway,M A, AU - Dibble,E, PY - 1996/1/1/pubmed PY - 2001/9/11/medline PY - 1996/1/1/entrez SP - 161 EP - 77 JF - Military psychology : the official journal of the Division of Military Psychology, American Psychological Association JO - Mil Psychol VL - 8 IS - 3 N2 - A method is described in which work sample data were analyzed to reveal how aircraft maintenance technicians differed in troubleshooting performance after a training intervention. During the training phase of the study, approximately half the technicians received troubleshooting instruction from an intelligent tutoring system, and the remaining technicians received informal on-the-job training. Data from work samples, in which technicians verbally isolated simulated equipment failures, were collected from both groups before and after the training. The work sample data were then examined by subject matter experts who scored performance for overall proficiency and noted specific violations of good troubleshooting practice. These violations provided the basis for the components of performance examined in the work sample data. The results of this componential analysis allow more specific conclusions to be drawn regarding the effectiveness of the training intervention by revealing how the tutoring system improved technicians' troubleshooting (e.g., tutored technicians were more likely than untutored technicians to test components thoroughly to ensure they were faulty before replacing them). SN - 0899-5605 UR - https://www.unboundmedicine.com/medline/citation/11540406/Analyzing_components_of_work_samples_to_evaluate_performance_ L2 - http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=linkout&SEARCH=11540406.ui DB - PRIME DP - Unbound Medicine ER -