Tags

Type your tag names separated by a space and hit enter

Does situation awareness add to the validity of cognitive tests?
Hum Factors. 2006 Winter; 48(4):721-33.HF

Abstract

OBJECTIVE

Does adding situation awareness (SA) to a battery of cognitive tests improve prediction?

BACKGROUND

Identifying variables that predict skilled performance in a complex task aids in understanding the nature of skill and also aids in the selection of operators to perform that task. SA is thought to be an important predictor of performance. SA is often thought to be based on underlying cognitive mechanisms.

METHOD

Three performance measures taken from the Federal Aviation Administration's (FAA's) Air Traffic Scenarios Test, the low-fidelity simulation component of the FAA's controller selection battery, were used as criterion variables in a hierarchical regression. After predicting performance based on a battery of cognitive (e.g., intelligence, working memory, spatial memory) and noncognitive tests (e.g., cognitive style, personality, demographics), we added measures of SA.

RESULTS

SA did provide increases in prediction, but only when measured with the Situation Present Assessment Method, an on-line query method. When the same questions were asked off line, SA did not enter the model in two cases and improved prediction by only 2% in the third.

CONCLUSION

Thus, some measures of SA do show incremental validity, even against a backdrop of a large number of cognitive variables.

APPLICATION

On-line measures of SA can be a worthwhile addition to standard batteries of tests used to predict performance in cognitively oriented industrial tasks.

Authors+Show Affiliations

Department of Psychology, Texas Tech University, Lubbock 79409-2051, USA. frank.durso@ttu.eduNo affiliation info availableNo affiliation info available

Pub Type(s)

Comparative Study
Evaluation Study
Journal Article

Language

eng

PubMed ID

17240720

Citation

Durso, Francis T., et al. "Does Situation Awareness Add to the Validity of Cognitive Tests?" Human Factors, vol. 48, no. 4, 2006, pp. 721-33.
Durso FT, Bleckley MK, Dattel AR. Does situation awareness add to the validity of cognitive tests? Hum Factors. 2006;48(4):721-33.
Durso, F. T., Bleckley, M. K., & Dattel, A. R. (2006). Does situation awareness add to the validity of cognitive tests? Human Factors, 48(4), 721-33.
Durso FT, Bleckley MK, Dattel AR. Does Situation Awareness Add to the Validity of Cognitive Tests. Hum Factors. 2006;48(4):721-33. PubMed PMID: 17240720.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Does situation awareness add to the validity of cognitive tests? AU - Durso,Francis T, AU - Bleckley,M Kathryn, AU - Dattel,Andrew R, PY - 2007/1/24/pubmed PY - 2007/3/30/medline PY - 2007/1/24/entrez SP - 721 EP - 33 JF - Human factors JO - Hum Factors VL - 48 IS - 4 N2 - OBJECTIVE: Does adding situation awareness (SA) to a battery of cognitive tests improve prediction? BACKGROUND: Identifying variables that predict skilled performance in a complex task aids in understanding the nature of skill and also aids in the selection of operators to perform that task. SA is thought to be an important predictor of performance. SA is often thought to be based on underlying cognitive mechanisms. METHOD: Three performance measures taken from the Federal Aviation Administration's (FAA's) Air Traffic Scenarios Test, the low-fidelity simulation component of the FAA's controller selection battery, were used as criterion variables in a hierarchical regression. After predicting performance based on a battery of cognitive (e.g., intelligence, working memory, spatial memory) and noncognitive tests (e.g., cognitive style, personality, demographics), we added measures of SA. RESULTS: SA did provide increases in prediction, but only when measured with the Situation Present Assessment Method, an on-line query method. When the same questions were asked off line, SA did not enter the model in two cases and improved prediction by only 2% in the third. CONCLUSION: Thus, some measures of SA do show incremental validity, even against a backdrop of a large number of cognitive variables. APPLICATION: On-line measures of SA can be a worthwhile addition to standard batteries of tests used to predict performance in cognitively oriented industrial tasks. SN - 0018-7208 UR - https://www.unboundmedicine.com/medline/citation/17240720/Does_situation_awareness_add_to_the_validity_of_cognitive_tests L2 - https://journals.sagepub.com/doi/10.1518/001872006779166316?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub=pubmed DB - PRIME DP - Unbound Medicine ER -